Jul 17 04:49:25.191969 ip-10-0-129-234 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 04:49:25.653756 ip-10-0-129-234 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 04:49:25.653756 ip-10-0-129-234 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 04:49:25.653756 ip-10-0-129-234 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 04:49:25.653756 ip-10-0-129-234 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 04:49:25.653756 ip-10-0-129-234 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 04:49:25.655014 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.654878    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 04:49:25.660485 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660469    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 04:49:25.660485 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660486    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660490    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660494    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660499    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660503    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660507    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660510    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660513    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660516    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660518    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660522    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660524    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660532    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660535    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660538    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660540    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660543    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660545    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660548    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660550    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 04:49:25.660568 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660553    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660555    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660558    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660560    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660564    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660569    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660572    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660575    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660578    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660581    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660584    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660587    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660590    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660593    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660595    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660598    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660600    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660603    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660605    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660607    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 04:49:25.661062 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660610    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660612    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660615    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660618    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660633    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660637    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660640    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660642    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660645    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660647    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660650    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660652    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660654    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660657    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660660    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660662    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660665    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660668    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660670    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660673    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 04:49:25.661697 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660676    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660678    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660681    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660683    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660686    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660688    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660691    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660693    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660696    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660698    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660703    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660705    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660707    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660710    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660721    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660726    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660730    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660734    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660738    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 04:49:25.662460 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660742    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660745    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660747    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660749    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660752    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660754    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660757    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660760    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660762    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660765    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660767    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660770    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660773    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660777    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660780    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660782    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660785    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660788    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 04:49:25.662940 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.660791    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 04:49:25.664256 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664238    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 04:49:25.664256 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664256    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664260    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664263    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664266    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664269    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664271    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664274    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664276    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664279    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664281    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664284    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664287    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664289    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664292    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664294    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664297    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664299    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664302    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664305    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 04:49:25.664318 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664308    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664310    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664313    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664316    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664318    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664321    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664323    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664326    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664329    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664332    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664335    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664337    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664340    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664342    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664345    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664349    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664353    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664355    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664358    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 04:49:25.664796 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664361    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664363    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664365    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664368    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664370    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664372    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664376    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664380    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664383    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664386    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664388    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664391    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664394    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664397    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664400    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664402    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664405    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664407    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664410    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 04:49:25.665260 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664413    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664415    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664418    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664420    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664422    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664425    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664427    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664431    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664435    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664438    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664440    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664443    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664446    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664449    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664451    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664454    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664456    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664459    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664461    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664464    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 04:49:25.665734 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664467    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664469    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664472    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664474    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664476    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664479    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664482    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664485    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664488    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664491    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664494    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664496    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664499    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664501    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664504    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664506    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664509    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664511    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664514    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664516    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 04:49:25.666222 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664518    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664943    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664948    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664951    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664954    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664956    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664959    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664961    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664964    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664966    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664969    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664971    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664974    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664977    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664980    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664982    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664985    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664989    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664992    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664995    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 04:49:25.666823 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.664999    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665001    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665004    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665006    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665008    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665011    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665013    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665016    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665018    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665021    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665023    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665026    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665028    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665030    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665033    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665035    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665038    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665042    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665045    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 04:49:25.667297 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665048    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665050    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665053    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665056    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665058    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665062    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665065    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665067    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665072    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665075    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665078    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665081    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665085    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665087    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665090    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665092    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665094    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665097    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665099    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665102    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 04:49:25.667763 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665104    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665106    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665109    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665111    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665114    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665116    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665118    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665121    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665123    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665126    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665128    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665130    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665133    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665135    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665137    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665140    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665142    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665145    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665149    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665151    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 04:49:25.668274 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665153    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665156    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665158    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665161    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665164    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665167    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665169    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665171    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665174    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665176    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665179    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665182    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665184    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665187    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665189    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665191    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665194    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665197    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665199    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665201    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 04:49:25.668773 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665204    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665282    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665292    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665309    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665316    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665322    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665328    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665332    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665337    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665340    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665343    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665346    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665349    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665353    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665355    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665358    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665361    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665365    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665368    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665373    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665376    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665379    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665381    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665385    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 04:49:25.669251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665388    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665391    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665394    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665397    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665400    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665402    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665405    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665408    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665411    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665415    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665418    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665420    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665423    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665426    2564 flags.go:64] FLAG: --enable-server="true"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665428    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665432    2564 flags.go:64] FLAG: --event-burst="100"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665435    2564 flags.go:64] FLAG: --event-qps="50"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665438    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665441    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665444    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665447    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665450    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665453    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665458    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665461    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 04:49:25.669864 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665464    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665468    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665470    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665473    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665476    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665478    2564 flags.go:64] FLAG: --feature-gates=""
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665482    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665485    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665488    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665491    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665493    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665496    2564 flags.go:64] FLAG: --help="false"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665499    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-129-234.ec2.internal"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665502    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665505    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665507    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665511    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665514    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665517    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665519    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665522    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665525    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665528    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665531    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 04:49:25.670474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665534    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665537    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665540    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665543    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665545    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665548    2564 flags.go:64] FLAG: --lock-file=""
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665553    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665555    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665558    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665564    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665567    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665570    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665573    2564 flags.go:64] FLAG: --logging-format="text"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665575    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665579    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665581    2564 flags.go:64] FLAG: --manifest-url=""
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665584    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665594    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665597    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665601    2564 flags.go:64] FLAG: --max-pods="110"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665603    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665606    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665609    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665611    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665614    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 04:49:25.671060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665617    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665620    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665641    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665644    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665647    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665650    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665653    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665658    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665661    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665664    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665666    2564 flags.go:64] FLAG: --port="10250"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665669    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665672    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a92a63021d7fa117"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665675    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665681    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665684    2564 flags.go:64] FLAG: --register-node="true"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665687    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665691    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665694    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665697    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665700    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665703    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665706    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665709    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665712    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 04:49:25.671672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665714    2564 flags.go:64] FLAG: --runonce="false"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665717    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665720    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665723    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665725    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665729    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665731    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665734    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665737    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665740    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665743    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665746    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665748    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665751    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665755    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665757    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665763    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665766    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665769    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665773    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665776    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665780    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665783    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665785    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665788    2564 flags.go:64] FLAG: --v="2"
Jul 17 04:49:25.672268 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665792    2564 flags.go:64] FLAG: --version="false"
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665797    2564 flags.go:64] FLAG: --vmodule=""
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665801    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.665804    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665932    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665937    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665941    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665944    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665947    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665949    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665952    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665956    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665960    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665963    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665965    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665968    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665970    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665973    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665975    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665978    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 04:49:25.672883 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665980    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665983    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665985    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665987    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665990    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665992    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665994    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.665997    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666001    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666004    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666006    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666009    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666012    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666014    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666018    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666021    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666023    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666026    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666030    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666032    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 04:49:25.673402 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666035    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666037    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666040    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666042    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666045    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666047    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666050    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666052    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666054    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666057    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666059    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666062    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666064    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666067    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666070    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666072    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666074    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666077    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666079    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666082    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 04:49:25.673980 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666085    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666088    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666090    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666093    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666095    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666098    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666100    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666103    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666107    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666111    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666115    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666118    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666120    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666123    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666126    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666128    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666131    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666134    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666137    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666139    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 04:49:25.674442 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666142    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666144    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666147    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666149    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666152    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666155    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666157    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666159    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666162    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666164    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666167    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666169    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666173    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666176    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666178    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666180    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666183    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666185    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666188    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666190    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 04:49:25.674934 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666195    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 04:49:25.675426 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666198    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 04:49:25.675426 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.666205    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 04:49:25.675426 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.666826    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 04:49:25.675426 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.674002    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 04:49:25.675426 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.674018    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 04:49:25.675426 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.675194    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 04:49:25.675426 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.675204    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 04:49:25.675426 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675272    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 04:49:25.675426 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675278    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 04:49:25.675426 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675282    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 04:49:25.675426 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675285    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 04:49:25.675426 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675288    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 04:49:25.675426 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675291    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 04:49:25.675426 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675294    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 04:49:25.675426 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675297    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675300    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675303    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675305    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675308    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675310    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675313    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675315    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675318    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675320    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675323    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675325    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675328    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675330    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675333    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675335    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675337    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675341    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675344    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675346    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 04:49:25.675815 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675348    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675351    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675355    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675357    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675360    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675362    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675365    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675367    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675370    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675372    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675375    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675377    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675380    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675383    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675385    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675388    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675390    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675392    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675395    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675398    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 04:49:25.676289 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675400    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675403    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675405    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675407    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675409    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675412    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675414    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675417    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675419    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675422    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675425    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675428    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675430    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675433    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675437    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675439    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675442    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675444    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675447    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675449    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 04:49:25.676768 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675451    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675454    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675456    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675458    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675461    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675463    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675467    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675471    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675473    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675476    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675478    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675481    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675483    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675485    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675488    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675490    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675492    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675495    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675498    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 04:49:25.677249 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675500    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 04:49:25.677783 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675503    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 04:49:25.677783 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675505    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 04:49:25.677783 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675508    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 04:49:25.677783 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675511    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 04:49:25.677783 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675513    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 04:49:25.677783 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675515    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 04:49:25.677783 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675518    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 04:49:25.677783 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675521    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 04:49:25.677783 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675523    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 04:49:25.677783 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675526    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 04:49:25.677783 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675529    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 04:49:25.677783 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675533    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 04:49:25.677783 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.675539    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 04:49:25.677783 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675699    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675704    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675708    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675710    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675714    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675718    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675721    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675723    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675726    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675728    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675731    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675733    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675736    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675739    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675741    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675743    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675746    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675748    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675751    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675753    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 04:49:25.678130 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675756    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675758    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675761    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675764    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675766    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675769    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675771    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675774    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675776    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675779    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675781    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675784    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675786    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675789    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675791    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675794    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675796    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675799    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675802    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 04:49:25.678613 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675805    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675808    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675811    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675814    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675816    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675819    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675821    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675824    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675827    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675830    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675833    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675835    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675838    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675840    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675843    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675845    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675848    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675851    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675854    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675856    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 04:49:25.679067 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675859    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675862    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675864    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675867    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675869    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675871    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675873    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675876    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675878    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675881    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675883    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675885    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675888    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675890    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675893    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675895    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675897    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675899    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675902    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675904    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 04:49:25.679546 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675907    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675909    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675912    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675914    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675916    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675919    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675921    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675924    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675926    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675929    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675932    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675934    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675937    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675939    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675942    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675944    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675947    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675949    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675952    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 04:49:25.680039 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:25.675955    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 04:49:25.680489 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.675961    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 04:49:25.680489 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.676071    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 04:49:25.680489 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.678592    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 04:49:25.680489 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.680252    2564 server.go:1019] "Starting client certificate rotation"
Jul 17 04:49:25.680489 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.680362    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 04:49:25.680489 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.680399    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 04:49:25.683751 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.683737    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 04:49:25.687591 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.687574    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 04:49:25.699637 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.699606    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 17 04:49:25.701969 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.701950    2564 log.go:25] "Validated CRI v1 image API"
Jul 17 04:49:25.703662 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.703616    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 04:49:25.707722 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.707703    2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a98864d1-6019-4c25-be70-cd804d8c63bd:/dev/nvme0n1p3 c3ba06e9-ca15-4f8b-93c3-a2fe54acdde6:/dev/nvme0n1p4]
Jul 17 04:49:25.707779 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.707721    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 04:49:25.713872 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.713752    2564 manager.go:216] Machine: {Timestamp:2026-07-17 04:49:25.712366482 +0000 UTC m=+0.389972819 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3090712 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20b9f636678ec5bfbfd59a78d5ec11 SystemUUID:ec20b9f6-3667-8ec5-bfbf-d59a78d5ec11 BootID:a2428444-34eb-4498-82fa-2229103d2c4a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:33:cb:22:0e:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:33:cb:22:0e:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:2a:6b:50:b5:01 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 04:49:25.713872 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.713868    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 04:49:25.713997 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.713963    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 04:49:25.716677 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.716661    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 04:49:25.717429 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.717401    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 04:49:25.717584 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.717433    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-234.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 04:49:25.718482 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.718471    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 04:49:25.718515 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.718484    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 04:49:25.718515 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.718493    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 04:49:25.718515 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.718509    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 04:49:25.720299 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.720288    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 04:49:25.723648 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.723620    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 04:49:25.723817 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.723807    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 04:49:25.723854 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.723838    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 04:49:25.723854 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.723847    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 04:49:25.723913 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.723861    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 04:49:25.723913 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.723873    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 17 04:49:25.723913 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.723881    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 04:49:25.724330 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.724318    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 04:49:25.724365 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.724338    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 04:49:25.726868 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.726850    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 04:49:25.729236 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.729221    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 04:49:25.729296 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.729253    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 04:49:25.730796 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.730783    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 04:49:25.730847 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.730802    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 04:49:25.730847 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.730808    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 04:49:25.730847 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.730814    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 04:49:25.730847 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.730825    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 04:49:25.730847 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.730834    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 04:49:25.730847 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.730846    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 04:49:25.731045 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.730853    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 04:49:25.731045 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.730859    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 04:49:25.731045 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.730864    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 04:49:25.731045 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.730872    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 04:49:25.731045 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.730877    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 04:49:25.731727 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.731716    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 04:49:25.731727 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.731728    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 04:49:25.735071 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.735046    2564 server.go:1268] "Started kubelet"
Jul 17 04:49:25.735177 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.735146    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 04:49:25.735238 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.735156    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 04:49:25.735238 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.735225    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 04:49:25.739414 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.739388    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 04:49:25.739441 ip-10-0-129-234 systemd[1]: Started Kubernetes Kubelet.
Jul 17 04:49:25.740024 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.739518    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 04:49:25.740024 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.739782    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-234.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 04:49:25.740170 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.740136    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 04:49:25.740781 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.740760    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 04:49:25.741859 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.741842    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 04:49:25.746765 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.745620    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-234.ec2.internal.18c2fa71063c910b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-234.ec2.internal,UID:ip-10-0-129-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-234.ec2.internal,},FirstTimestamp:2026-07-17 04:49:25.735018763 +0000 UTC m=+0.412625101,LastTimestamp:2026-07-17 04:49:25.735018763 +0000 UTC m=+0.412625101,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-234.ec2.internal,}"
Jul 17 04:49:25.751179 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.751163    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 04:49:25.751257 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.751174    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 04:49:25.751336 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.751310    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-234.ec2.internal\" not found"
Jul 17 04:49:25.752059 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.751921    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 04:49:25.752407 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.752211    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 04:49:25.752407 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.752225    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 04:49:25.752407 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.752353    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 04:49:25.752407 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.752361    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 04:49:25.752598 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.752524    2564 factory.go:153] Registering CRI-O factory
Jul 17 04:49:25.752761 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.752735    2564 factory.go:223] Registration of the crio container factory successfully
Jul 17 04:49:25.752895 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.752870    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 04:49:25.752895 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.752886    2564 factory.go:55] Registering systemd factory
Jul 17 04:49:25.752895 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.752895    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 17 04:49:25.753042 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.752917    2564 factory.go:103] Registering Raw factory
Jul 17 04:49:25.753042 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.752930    2564 manager.go:1196] Started watching for new ooms in manager
Jul 17 04:49:25.753561 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.753539    2564 manager.go:349] Starting recovery of all containers
Jul 17 04:49:25.757486 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.757457    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 17 04:49:25.757600 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.757561    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 17 04:49:25.761162 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.761137    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p6ggp"
Jul 17 04:49:25.763599 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.763586    2564 manager.go:354] Recovery completed
Jul 17 04:49:25.765087 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.764973    2564 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 17 04:49:25.766817 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.766787    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p6ggp"
Jul 17 04:49:25.768467 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.768455    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 04:49:25.770803 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.770752    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 04:49:25.770883 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.770815    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 04:49:25.770883 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.770826    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasSufficientPID"
Jul 17 04:49:25.771409 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.771388    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 04:49:25.771409 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.771408    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 04:49:25.771514 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.771424    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 04:49:25.771514 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.771398    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 04:49:25.772384 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.772365    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 04:49:25.772493 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.772395    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 04:49:25.772493 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.772403    2564 policy_none.go:49] "None policy: Start"
Jul 17 04:49:25.772493 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.772417    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 04:49:25.772493 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.772427    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 04:49:25.772493 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.772405    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasSufficientPID"
Jul 17 04:49:25.772829 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.772758    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-234.ec2.internal.18c2fa71085e8fca  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-234.ec2.internal,UID:ip-10-0-129-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-234.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-234.ec2.internal,},FirstTimestamp:2026-07-17 04:49:25.770801098 +0000 UTC m=+0.448407437,LastTimestamp:2026-07-17 04:49:25.770801098 +0000 UTC m=+0.448407437,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-234.ec2.internal,}"
Jul 17 04:49:25.773409 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.773395    2564 policy_none.go:47] "Start"
Jul 17 04:49:25.814234 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.814219    2564 manager.go:337] "Starting Device Plugin manager"
Jul 17 04:49:25.819993 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.814250    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 04:49:25.819993 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.814258    2564 server.go:87] "Starting device plugin registration server"
Jul 17 04:49:25.819993 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.814504    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 04:49:25.819993 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.814516    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 04:49:25.819993 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.814608    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 04:49:25.819993 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.814705    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 04:49:25.819993 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.814712    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 04:49:25.819993 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.815282    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 04:49:25.819993 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.815319    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-234.ec2.internal\" not found"
Jul 17 04:49:25.849259 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.849229    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 04:49:25.850542 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.850527    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 04:49:25.850650 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.850567    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 04:49:25.850650 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.850590    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 04:49:25.850650 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.850642    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 04:49:25.852961 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.852945    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 04:49:25.915736 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.915647    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 04:49:25.916667 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.916650    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 04:49:25.916764 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.916683    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 04:49:25.916764 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.916697    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasSufficientPID"
Jul 17 04:49:25.916764 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.916727    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-234.ec2.internal"
Jul 17 04:49:25.927532 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.927512    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-234.ec2.internal"
Jul 17 04:49:25.927621 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.927539    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-234.ec2.internal\": node \"ip-10-0-129-234.ec2.internal\" not found"
Jul 17 04:49:25.949183 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.949160    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-234.ec2.internal\" not found"
Jul 17 04:49:25.951218 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.951198    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-234.ec2.internal"]
Jul 17 04:49:25.951300 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.951275    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 04:49:25.952830 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.952814    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 04:49:25.952830 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.952826    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3910d06d0c033a0348614d5b0f9ead4c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal\" (UID: \"3910d06d0c033a0348614d5b0f9ead4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal"
Jul 17 04:49:25.952969 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.952840    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 04:49:25.952969 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.952845    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3910d06d0c033a0348614d5b0f9ead4c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal\" (UID: \"3910d06d0c033a0348614d5b0f9ead4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal"
Jul 17 04:49:25.952969 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.952855    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasSufficientPID"
Jul 17 04:49:25.954249 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.954234    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 04:49:25.954365 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.954350    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal"
Jul 17 04:49:25.954428 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.954379    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 04:49:25.955050 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.955034    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 04:49:25.955050 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.955043    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 04:49:25.955189 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.955061    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 04:49:25.955189 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.955071    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasSufficientPID"
Jul 17 04:49:25.955189 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.955061    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 04:49:25.955189 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.955091    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasSufficientPID"
Jul 17 04:49:25.956190 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.956177    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-234.ec2.internal"
Jul 17 04:49:25.956247 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.956200    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 04:49:25.956926 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.956900    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 04:49:25.956926 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.956928    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 04:49:25.957048 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:25.956939    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeHasSufficientPID"
Jul 17 04:49:25.981286 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.981254    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-234.ec2.internal\" not found" node="ip-10-0-129-234.ec2.internal"
Jul 17 04:49:25.985618 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:25.985601    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-234.ec2.internal\" not found" node="ip-10-0-129-234.ec2.internal"
Jul 17 04:49:26.049393 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:26.049366    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-234.ec2.internal\" not found"
Jul 17 04:49:26.053712 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.053695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3910d06d0c033a0348614d5b0f9ead4c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal\" (UID: \"3910d06d0c033a0348614d5b0f9ead4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal"
Jul 17 04:49:26.053759 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.053721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3910d06d0c033a0348614d5b0f9ead4c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal\" (UID: \"3910d06d0c033a0348614d5b0f9ead4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal"
Jul 17 04:49:26.053759 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.053744    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f00b257fb549beca1ce15bbf5a89e032-config\") pod \"kube-apiserver-proxy-ip-10-0-129-234.ec2.internal\" (UID: \"f00b257fb549beca1ce15bbf5a89e032\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-234.ec2.internal"
Jul 17 04:49:26.053837 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.053800    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3910d06d0c033a0348614d5b0f9ead4c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal\" (UID: \"3910d06d0c033a0348614d5b0f9ead4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal"
Jul 17 04:49:26.053837 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.053807    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3910d06d0c033a0348614d5b0f9ead4c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal\" (UID: \"3910d06d0c033a0348614d5b0f9ead4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal"
Jul 17 04:49:26.149935 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:26.149887    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-234.ec2.internal\" not found"
Jul 17 04:49:26.154206 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.154191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f00b257fb549beca1ce15bbf5a89e032-config\") pod \"kube-apiserver-proxy-ip-10-0-129-234.ec2.internal\" (UID: \"f00b257fb549beca1ce15bbf5a89e032\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-234.ec2.internal"
Jul 17 04:49:26.154258 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.154237    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f00b257fb549beca1ce15bbf5a89e032-config\") pod \"kube-apiserver-proxy-ip-10-0-129-234.ec2.internal\" (UID: \"f00b257fb549beca1ce15bbf5a89e032\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-234.ec2.internal"
Jul 17 04:49:26.250761 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:26.250688    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-234.ec2.internal\" not found"
Jul 17 04:49:26.284204 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.284176    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal"
Jul 17 04:49:26.288808 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.288650    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-234.ec2.internal"
Jul 17 04:49:26.351558 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:26.351510    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-234.ec2.internal\" not found"
Jul 17 04:49:26.451975 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:26.451929    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-234.ec2.internal\" not found"
Jul 17 04:49:26.552377 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:26.552287    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-234.ec2.internal\" not found"
Jul 17 04:49:26.652881 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:26.652843    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-234.ec2.internal\" not found"
Jul 17 04:49:26.679142 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.679121    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 04:49:26.679702 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.679271    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 04:49:26.753343 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:26.753317    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-234.ec2.internal\" not found"
Jul 17 04:49:26.759591 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.759569    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 04:49:26.772222 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.772188    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 04:44:26 +0000 UTC" deadline="2028-04-22 01:49:28.105819508 +0000 UTC"
Jul 17 04:49:26.772222 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.772221    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15477h0m1.33360169s"
Jul 17 04:49:26.776616 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:26.776584    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00b257fb549beca1ce15bbf5a89e032.slice/crio-f634641f6967e6dca276589ae5f2214f07585849052c1e2f6edeb70264eb586b WatchSource:0}: Error finding container f634641f6967e6dca276589ae5f2214f07585849052c1e2f6edeb70264eb586b: Status 404 returned error can't find the container with id f634641f6967e6dca276589ae5f2214f07585849052c1e2f6edeb70264eb586b
Jul 17 04:49:26.776972 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:26.776949    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3910d06d0c033a0348614d5b0f9ead4c.slice/crio-17c2d9bdacb0917403917457ac22e4efbe8bae0a8d74c1aeebc6f13ce4c4ba00 WatchSource:0}: Error finding container 17c2d9bdacb0917403917457ac22e4efbe8bae0a8d74c1aeebc6f13ce4c4ba00: Status 404 returned error can't find the container with id 17c2d9bdacb0917403917457ac22e4efbe8bae0a8d74c1aeebc6f13ce4c4ba00
Jul 17 04:49:26.782577 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.782555    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 04:49:26.782730 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.782715    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 04:49:26.851997 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.851899    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-234.ec2.internal"
Jul 17 04:49:26.854051 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.854000    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-234.ec2.internal" event={"ID":"f00b257fb549beca1ce15bbf5a89e032","Type":"ContainerStarted","Data":"f634641f6967e6dca276589ae5f2214f07585849052c1e2f6edeb70264eb586b"}
Jul 17 04:49:26.854954 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.854932    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal" event={"ID":"3910d06d0c033a0348614d5b0f9ead4c","Type":"ContainerStarted","Data":"17c2d9bdacb0917403917457ac22e4efbe8bae0a8d74c1aeebc6f13ce4c4ba00"}
Jul 17 04:49:26.860132 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.860117    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 04:49:26.862543 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.862529    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal"
Jul 17 04:49:26.878252 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:26.878236    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 04:49:27.033050 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.033020    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 04:49:27.724526 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.724492    2564 apiserver.go:52] "Watching apiserver"
Jul 17 04:49:27.735223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.735193    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 04:49:27.735708 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.735670    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-l8nc2","openshift-network-operator/iptables-alerter-t6ttc","openshift-ovn-kubernetes/ovnkube-node-vhvmc","kube-system/global-pull-secret-syncer-tr4jx","kube-system/konnectivity-agent-cvz5q","openshift-cluster-node-tuning-operator/tuned-phhzw","openshift-dns/node-resolver-28dgh","openshift-multus/multus-additional-cni-plugins-9qntz","openshift-multus/multus-mktcn","kube-system/kube-apiserver-proxy-ip-10-0-129-234.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw","openshift-image-registry/node-ca-d4sqb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal","openshift-multus/network-metrics-daemon-hfzzb"]
Jul 17 04:49:27.737404 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.737378    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d4sqb"
Jul 17 04:49:27.739118 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.739093    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t6ttc"
Jul 17 04:49:27.740175 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.740153    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 04:49:27.740278 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.740153    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 04:49:27.740339 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.740286    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 04:49:27.740536 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.740519    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8kszg\""
Jul 17 04:49:27.743321 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.740940    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.743321 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.741719    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 04:49:27.743321 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.741760    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 04:49:27.743321 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.741972    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-znb26\""
Jul 17 04:49:27.743321 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.742117    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:27.743321 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:27.742214    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:27.743321 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.742294    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 04:49:27.743633 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.743613    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cvz5q"
Jul 17 04:49:27.744431 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.744408    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 04:49:27.744514 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.744491    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 04:49:27.744640 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.744625    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 04:49:27.744863 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.744843    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 04:49:27.745122 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.745102    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.745500 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.745483    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4hb6h\""
Jul 17 04:49:27.745625 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.745578    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 04:49:27.745625 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.745599    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 04:49:27.746326 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.746028    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 04:49:27.746326 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.746158    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kkhjl\""
Jul 17 04:49:27.746475 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.746407    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 04:49:27.747875 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.747855    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 04:49:27.747968 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.747894    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xrqkr\""
Jul 17 04:49:27.747968 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.747917    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 04:49:27.748136 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.748119    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:27.748221 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:27.748202    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:27.749828 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.749807    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.751812 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.751792    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 04:49:27.751938 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.751917    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 04:49:27.752250 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.752232    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 04:49:27.753293 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.753268    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 04:49:27.753832 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.753811    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-58jsd\""
Jul 17 04:49:27.754334 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.754092    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 04:49:27.754334 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.754273    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.754650 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.754631    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 04:49:27.757533 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.757262    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dfx6f\""
Jul 17 04:49:27.757672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.757636    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 04:49:27.759590 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.759570    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-28dgh"
Jul 17 04:49:27.761261 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.761242    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.762028 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.762006    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 04:49:27.762328 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.762309    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wpst4\""
Jul 17 04:49:27.762521 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.762502    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 04:49:27.763067 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.763046    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:27.763147 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:27.763124    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:27.764163 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764141    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-etc-openvswitch\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.764317 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764292    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-var-lib-kubelet\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.764410 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-host\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.764410 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764357    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wt2d\" (UniqueName: \"kubernetes.io/projected/9a51bc06-925e-4002-a7d0-f5e239dc83d9-kube-api-access-8wt2d\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.764410 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-os-release\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.764410 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba97ada7-a006-40a4-a0ef-513d06d8645a-serviceca\") pod \"node-ca-d4sqb\" (UID: \"ba97ada7-a006-40a4-a0ef-513d06d8645a\") " pod="openshift-image-registry/node-ca-d4sqb"
Jul 17 04:49:27.764565 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pngxm\" (UniqueName: \"kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm\") pod \"network-check-target-l8nc2\" (UID: \"9514d6c6-a71f-4861-a495-84df181bdbfd\") " pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:27.764565 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764457    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-run-openvswitch\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.764565 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764481    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a51bc06-925e-4002-a7d0-f5e239dc83d9-tmp\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.764565 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764505    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-multus-daemon-config\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.764565 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764528    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2085722b-2750-43c8-be34-b946f6052541-host-slash\") pod \"iptables-alerter-t6ttc\" (UID: \"2085722b-2750-43c8-be34-b946f6052541\") " pod="openshift-network-operator/iptables-alerter-t6ttc"
Jul 17 04:49:27.764565 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glz67\" (UniqueName: \"kubernetes.io/projected/67982dd2-375d-410d-9aed-935ff75fa7c7-kube-api-access-glz67\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.764817 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/043d9bc2-3514-4d10-b995-a2e6783e6939-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.764817 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764602    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-var-lib-cni-multus\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.764817 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764687    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s274w\" (UniqueName: \"kubernetes.io/projected/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-kube-api-access-s274w\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.764817 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764740    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbhcm\" (UniqueName: \"kubernetes.io/projected/0a1a5036-08c3-4598-8271-0b3e5746e98f-kube-api-access-gbhcm\") pod \"node-resolver-28dgh\" (UID: \"0a1a5036-08c3-4598-8271-0b3e5746e98f\") " pod="openshift-dns/node-resolver-28dgh"
Jul 17 04:49:27.764817 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764751    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 04:49:27.764817 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-systemd-units\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.764817 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764776    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 04:49:27.765066 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764818    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-cni-bin\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.765066 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764845    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-var-lib-cni-bin\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.765066 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764870    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-var-lib-kubelet\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.765066 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vl2b\" (UniqueName: \"kubernetes.io/projected/ba97ada7-a006-40a4-a0ef-513d06d8645a-kube-api-access-4vl2b\") pod \"node-ca-d4sqb\" (UID: \"ba97ada7-a006-40a4-a0ef-513d06d8645a\") " pod="openshift-image-registry/node-ca-d4sqb"
Jul 17 04:49:27.765066 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764935    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-kubelet\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.765066 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764964    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 04:49:27.765066 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764687    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lxwc4\""
Jul 17 04:49:27.765066 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.764966    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-systemd\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.765374 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765099    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-multus-cni-dir\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.765374 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-run-k8s-cni-cncf-io\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.765374 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765150    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a1a5036-08c3-4598-8271-0b3e5746e98f-hosts-file\") pod \"node-resolver-28dgh\" (UID: \"0a1a5036-08c3-4598-8271-0b3e5746e98f\") " pod="openshift-dns/node-resolver-28dgh"
Jul 17 04:49:27.765374 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765174    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-run-systemd\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.765374 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765198    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-lib-modules\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.765374 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765218    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-tuned\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.765374 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765257    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-kubernetes\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.765374 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765276    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-cni-binary-copy\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.765374 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765291    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-hostroot\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.765374 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765322    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67982dd2-375d-410d-9aed-935ff75fa7c7-ovn-node-metrics-cert\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.765374 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765365    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wddvr\" (UniqueName: \"kubernetes.io/projected/17c170e0-f040-42d6-9047-9afaa449d88e-kube-api-access-wddvr\") pod \"network-metrics-daemon-hfzzb\" (UID: \"17c170e0-f040-42d6-9047-9afaa449d88e\") " pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-run\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765415    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/043d9bc2-3514-4d10-b995-a2e6783e6939-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-system-cni-dir\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765471    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-multus-conf-dir\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765501    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-var-lib-openvswitch\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765527    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-node-log\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765584    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-run-ovn-kubernetes\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765625    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-sysconfig\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765691    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-run-netns\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-slash\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-run-ovn\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67982dd2-375d-410d-9aed-935ff75fa7c7-ovnkube-config\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765779    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67982dd2-375d-410d-9aed-935ff75fa7c7-env-overrides\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765795    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67982dd2-375d-410d-9aed-935ff75fa7c7-ovnkube-script-lib\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765811    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6-konnectivity-ca\") pod \"konnectivity-agent-cvz5q\" (UID: \"cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6\") " pod="kube-system/konnectivity-agent-cvz5q"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765852    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-modprobe-d\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.765965 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765868    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a1a5036-08c3-4598-8271-0b3e5746e98f-tmp-dir\") pod \"node-resolver-28dgh\" (UID: \"0a1a5036-08c3-4598-8271-0b3e5746e98f\") " pod="openshift-dns/node-resolver-28dgh"
Jul 17 04:49:27.766829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765882    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-run-netns\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.766829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765904    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6-agent-certs\") pod \"konnectivity-agent-cvz5q\" (UID: \"cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6\") " pod="kube-system/konnectivity-agent-cvz5q"
Jul 17 04:49:27.766829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765931    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba97ada7-a006-40a4-a0ef-513d06d8645a-host\") pod \"node-ca-d4sqb\" (UID: \"ba97ada7-a006-40a4-a0ef-513d06d8645a\") " pod="openshift-image-registry/node-ca-d4sqb"
Jul 17 04:49:27.766829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765959    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2085722b-2750-43c8-be34-b946f6052541-iptables-alerter-script\") pod \"iptables-alerter-t6ttc\" (UID: \"2085722b-2750-43c8-be34-b946f6052541\") " pod="openshift-network-operator/iptables-alerter-t6ttc"
Jul 17 04:49:27.766829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.765985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-sysctl-d\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.766829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766002    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-sysctl-conf\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.766829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766064    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/043d9bc2-3514-4d10-b995-a2e6783e6939-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.766829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766086    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-cni-netd\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.766829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766109    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-sys\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.766829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766131    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/043d9bc2-3514-4d10-b995-a2e6783e6939-system-cni-dir\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.766829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766174    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/043d9bc2-3514-4d10-b995-a2e6783e6939-cnibin\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.766829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766200    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/043d9bc2-3514-4d10-b995-a2e6783e6939-os-release\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.766829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-etc-kubernetes\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.766829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766267    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-log-socket\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.766829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.766829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766346    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs\") pod \"network-metrics-daemon-hfzzb\" (UID: \"17c170e0-f040-42d6-9047-9afaa449d88e\") " pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:27.767645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766383    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/043d9bc2-3514-4d10-b995-a2e6783e6939-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.767645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6tvf\" (UniqueName: \"kubernetes.io/projected/043d9bc2-3514-4d10-b995-a2e6783e6939-kube-api-access-w6tvf\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.767645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766449    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8c59\" (UniqueName: \"kubernetes.io/projected/2085722b-2750-43c8-be34-b946f6052541-kube-api-access-w8c59\") pod \"iptables-alerter-t6ttc\" (UID: \"2085722b-2750-43c8-be34-b946f6052541\") " pod="openshift-network-operator/iptables-alerter-t6ttc"
Jul 17 04:49:27.767645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766471    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-cnibin\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.767645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766492    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 04:49:27.767645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766493    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-multus-socket-dir-parent\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.767645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.766529    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-run-multus-certs\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.791225 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.791199    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 04:49:27.796960 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.796936    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-njvfk"
Jul 17 04:49:27.805331 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.805302    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-njvfk"
Jul 17 04:49:27.852591 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.852562    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 04:49:27.867267 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2085722b-2750-43c8-be34-b946f6052541-iptables-alerter-script\") pod \"iptables-alerter-t6ttc\" (UID: \"2085722b-2750-43c8-be34-b946f6052541\") " pod="openshift-network-operator/iptables-alerter-t6ttc"
Jul 17 04:49:27.867436 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867277    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-sysctl-d\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.867436 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867306    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-sysctl-conf\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.867436 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/043d9bc2-3514-4d10-b995-a2e6783e6939-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.867436 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867358    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-cni-netd\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.867436 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-sys\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.867436 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/043d9bc2-3514-4d10-b995-a2e6783e6939-system-cni-dir\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.867436 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867430    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-sysctl-d\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.867844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/043d9bc2-3514-4d10-b995-a2e6783e6939-cnibin\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.867844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867478    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/043d9bc2-3514-4d10-b995-a2e6783e6939-cnibin\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.867844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867488    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/043d9bc2-3514-4d10-b995-a2e6783e6939-os-release\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.867844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-etc-kubernetes\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.867844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867541    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-log-socket\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.867844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867563    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.867844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867589    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs\") pod \"network-metrics-daemon-hfzzb\" (UID: \"17c170e0-f040-42d6-9047-9afaa449d88e\") " pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:27.867844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867625    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/043d9bc2-3514-4d10-b995-a2e6783e6939-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.867844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867621    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-sysctl-conf\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.867844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867653    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6tvf\" (UniqueName: \"kubernetes.io/projected/043d9bc2-3514-4d10-b995-a2e6783e6939-kube-api-access-w6tvf\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.867844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8c59\" (UniqueName: \"kubernetes.io/projected/2085722b-2750-43c8-be34-b946f6052541-kube-api-access-w8c59\") pod \"iptables-alerter-t6ttc\" (UID: \"2085722b-2750-43c8-be34-b946f6052541\") " pod="openshift-network-operator/iptables-alerter-t6ttc"
Jul 17 04:49:27.867844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-cnibin\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.867844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867730    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-multus-socket-dir-parent\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.867844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867784    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-run-multus-certs\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.867844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867808    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-device-dir\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.867844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867837    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw9ln\" (UniqueName: \"kubernetes.io/projected/577ed248-8bbf-4edc-a5de-c97774dbc981-kube-api-access-xw9ln\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867867    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-etc-openvswitch\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867886    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-var-lib-kubelet\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867915    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2085722b-2750-43c8-be34-b946f6052541-iptables-alerter-script\") pod \"iptables-alerter-t6ttc\" (UID: \"2085722b-2750-43c8-be34-b946f6052541\") " pod="openshift-network-operator/iptables-alerter-t6ttc"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.867999    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-sys\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868048    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-cni-netd\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868170    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/043d9bc2-3514-4d10-b995-a2e6783e6939-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868226    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/043d9bc2-3514-4d10-b995-a2e6783e6939-system-cni-dir\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868267    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-log-socket\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868323    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-host\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868349    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wt2d\" (UniqueName: \"kubernetes.io/projected/9a51bc06-925e-4002-a7d0-f5e239dc83d9-kube-api-access-8wt2d\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868359    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-etc-kubernetes\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868364    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-os-release\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868381    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868402    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba97ada7-a006-40a4-a0ef-513d06d8645a-serviceca\") pod \"node-ca-d4sqb\" (UID: \"ba97ada7-a006-40a4-a0ef-513d06d8645a\") " pod="openshift-image-registry/node-ca-d4sqb"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-os-release\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868428    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pngxm\" (UniqueName: \"kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm\") pod \"network-check-target-l8nc2\" (UID: \"9514d6c6-a71f-4861-a495-84df181bdbfd\") " pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868453    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-run-openvswitch\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.868645 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:27.868484    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868478    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a51bc06-925e-4002-a7d0-f5e239dc83d9-tmp\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-multus-daemon-config\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:27.868560    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs podName:17c170e0-f040-42d6-9047-9afaa449d88e nodeName:}" failed. No retries permitted until 2026-07-17 04:49:28.368538905 +0000 UTC m=+3.046145251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs") pod "network-metrics-daemon-hfzzb" (UID: "17c170e0-f040-42d6-9047-9afaa449d88e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2085722b-2750-43c8-be34-b946f6052541-host-slash\") pod \"iptables-alerter-t6ttc\" (UID: \"2085722b-2750-43c8-be34-b946f6052541\") " pod="openshift-network-operator/iptables-alerter-t6ttc"
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glz67\" (UniqueName: \"kubernetes.io/projected/67982dd2-375d-410d-9aed-935ff75fa7c7-kube-api-access-glz67\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868639    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/043d9bc2-3514-4d10-b995-a2e6783e6939-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868661    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-cnibin\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-var-lib-cni-multus\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868698    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s274w\" (UniqueName: \"kubernetes.io/projected/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-kube-api-access-s274w\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868727    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-multus-socket-dir-parent\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbhcm\" (UniqueName: \"kubernetes.io/projected/0a1a5036-08c3-4598-8271-0b3e5746e98f-kube-api-access-gbhcm\") pod \"node-resolver-28dgh\" (UID: \"0a1a5036-08c3-4598-8271-0b3e5746e98f\") " pod="openshift-dns/node-resolver-28dgh"
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868759    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-run-multus-certs\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868781    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret\") pod \"global-pull-secret-syncer-tr4jx\" (UID: \"cd3883fe-1e59-474f-aa19-3b3fae77ab85\") " pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-etc-openvswitch\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868880    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-var-lib-kubelet\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868922    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-host\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.869376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.868326    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/043d9bc2-3514-4d10-b995-a2e6783e6939-os-release\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869090    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-multus-daemon-config\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-run-openvswitch\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869238    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/043d9bc2-3514-4d10-b995-a2e6783e6939-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869262    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2085722b-2750-43c8-be34-b946f6052541-host-slash\") pod \"iptables-alerter-t6ttc\" (UID: \"2085722b-2750-43c8-be34-b946f6052541\") " pod="openshift-network-operator/iptables-alerter-t6ttc"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869286    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-systemd-units\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869323    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-cni-bin\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-var-lib-cni-bin\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869376    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-var-lib-kubelet\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vl2b\" (UniqueName: \"kubernetes.io/projected/ba97ada7-a006-40a4-a0ef-513d06d8645a-kube-api-access-4vl2b\") pod \"node-ca-d4sqb\" (UID: \"ba97ada7-a006-40a4-a0ef-513d06d8645a\") " pod="openshift-image-registry/node-ca-d4sqb"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869399    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-systemd-units\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-socket-dir\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869443    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869475    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-var-lib-cni-multus\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869539    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-sys-fs\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-kubelet\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.870244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869627    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-var-lib-cni-bin\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869651    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-kubelet\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869676    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-cni-bin\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-var-lib-kubelet\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869753    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/043d9bc2-3514-4d10-b995-a2e6783e6939-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869757    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba97ada7-a006-40a4-a0ef-513d06d8645a-serviceca\") pod \"node-ca-d4sqb\" (UID: \"ba97ada7-a006-40a4-a0ef-513d06d8645a\") " pod="openshift-image-registry/node-ca-d4sqb"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869772    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-systemd\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-multus-cni-dir\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869861    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-systemd\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-run-k8s-cni-cncf-io\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869980    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-multus-cni-dir\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.869982    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a1a5036-08c3-4598-8271-0b3e5746e98f-hosts-file\") pod \"node-resolver-28dgh\" (UID: \"0a1a5036-08c3-4598-8271-0b3e5746e98f\") " pod="openshift-dns/node-resolver-28dgh"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870008    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-run-k8s-cni-cncf-io\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870030    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd3883fe-1e59-474f-aa19-3b3fae77ab85-dbus\") pod \"global-pull-secret-syncer-tr4jx\" (UID: \"cd3883fe-1e59-474f-aa19-3b3fae77ab85\") " pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870033    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a1a5036-08c3-4598-8271-0b3e5746e98f-hosts-file\") pod \"node-resolver-28dgh\" (UID: \"0a1a5036-08c3-4598-8271-0b3e5746e98f\") " pod="openshift-dns/node-resolver-28dgh"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870051    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-run-systemd\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-lib-modules\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870109    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-tuned\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.871316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870117    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-run-systemd\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870138    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd3883fe-1e59-474f-aa19-3b3fae77ab85-kubelet-config\") pod \"global-pull-secret-syncer-tr4jx\" (UID: \"cd3883fe-1e59-474f-aa19-3b3fae77ab85\") " pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870164    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-kubernetes\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870190    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-lib-modules\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870190    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-cni-binary-copy\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870247    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-kubernetes\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-hostroot\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67982dd2-375d-410d-9aed-935ff75fa7c7-ovn-node-metrics-cert\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870368    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wddvr\" (UniqueName: \"kubernetes.io/projected/17c170e0-f040-42d6-9047-9afaa449d88e-kube-api-access-wddvr\") pod \"network-metrics-daemon-hfzzb\" (UID: \"17c170e0-f040-42d6-9047-9afaa449d88e\") " pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870351    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-hostroot\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.870980    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-run\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871031    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/043d9bc2-3514-4d10-b995-a2e6783e6939-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871072    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-system-cni-dir\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871107    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-multus-conf-dir\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871138    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-var-lib-openvswitch\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871169    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-node-log\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-run-ovn-kubernetes\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871226    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-sysconfig\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.872223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871260    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-run-netns\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.873144 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871261    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-cni-binary-copy\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.873144 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871295    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-slash\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.873144 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871325    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-run-ovn\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.873144 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871357    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67982dd2-375d-410d-9aed-935ff75fa7c7-ovnkube-config\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.873144 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67982dd2-375d-410d-9aed-935ff75fa7c7-env-overrides\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.873144 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67982dd2-375d-410d-9aed-935ff75fa7c7-ovnkube-script-lib\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.873144 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871449    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-registration-dir\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.873144 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871486    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6-konnectivity-ca\") pod \"konnectivity-agent-cvz5q\" (UID: \"cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6\") " pod="kube-system/konnectivity-agent-cvz5q"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.875621    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-modprobe-d\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.875670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a1a5036-08c3-4598-8271-0b3e5746e98f-tmp-dir\") pod \"node-resolver-28dgh\" (UID: \"0a1a5036-08c3-4598-8271-0b3e5746e98f\") " pod="openshift-dns/node-resolver-28dgh"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.875730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.875771    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-run-netns\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.875806    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6-agent-certs\") pod \"konnectivity-agent-cvz5q\" (UID: \"cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6\") " pod="kube-system/konnectivity-agent-cvz5q"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.875834    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba97ada7-a006-40a4-a0ef-513d06d8645a-host\") pod \"node-ca-d4sqb\" (UID: \"ba97ada7-a006-40a4-a0ef-513d06d8645a\") " pod="openshift-image-registry/node-ca-d4sqb"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.872379    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-run\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.872535    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/043d9bc2-3514-4d10-b995-a2e6783e6939-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.872690    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-var-lib-openvswitch\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.872766    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-node-log\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.872805    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-multus-conf-dir\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.875963    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67982dd2-375d-410d-9aed-935ff75fa7c7-env-overrides\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.873441    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67982dd2-375d-410d-9aed-935ff75fa7c7-ovnkube-config\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.873463    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a51bc06-925e-4002-a7d0-f5e239dc83d9-tmp\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.873987    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67982dd2-375d-410d-9aed-935ff75fa7c7-ovnkube-script-lib\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.874123    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6-konnectivity-ca\") pod \"konnectivity-agent-cvz5q\" (UID: \"cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6\") " pod="kube-system/konnectivity-agent-cvz5q"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.873323    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-tuned\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.876443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.872017    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-sysconfig\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.877458 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.871614    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-run-ovn-kubernetes\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.877458 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.872323    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-system-cni-dir\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.877458 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.876159    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9a51bc06-925e-4002-a7d0-f5e239dc83d9-etc-modprobe-d\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.877458 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.872267    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-slash\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.877458 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.876232    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-host-run-netns\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.877458 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.872177    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-host-run-netns\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.877458 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.872367    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67982dd2-375d-410d-9aed-935ff75fa7c7-run-ovn\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.877458 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.876365    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a1a5036-08c3-4598-8271-0b3e5746e98f-tmp-dir\") pod \"node-resolver-28dgh\" (UID: \"0a1a5036-08c3-4598-8271-0b3e5746e98f\") " pod="openshift-dns/node-resolver-28dgh"
Jul 17 04:49:27.877458 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.876426    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba97ada7-a006-40a4-a0ef-513d06d8645a-host\") pod \"node-ca-d4sqb\" (UID: \"ba97ada7-a006-40a4-a0ef-513d06d8645a\") " pod="openshift-image-registry/node-ca-d4sqb"
Jul 17 04:49:27.877458 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.876516    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67982dd2-375d-410d-9aed-935ff75fa7c7-ovn-node-metrics-cert\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.881800 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.878674    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8c59\" (UniqueName: \"kubernetes.io/projected/2085722b-2750-43c8-be34-b946f6052541-kube-api-access-w8c59\") pod \"iptables-alerter-t6ttc\" (UID: \"2085722b-2750-43c8-be34-b946f6052541\") " pod="openshift-network-operator/iptables-alerter-t6ttc"
Jul 17 04:49:27.881800 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.879088    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6-agent-certs\") pod \"konnectivity-agent-cvz5q\" (UID: \"cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6\") " pod="kube-system/konnectivity-agent-cvz5q"
Jul 17 04:49:27.881800 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.880115    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6tvf\" (UniqueName: \"kubernetes.io/projected/043d9bc2-3514-4d10-b995-a2e6783e6939-kube-api-access-w6tvf\") pod \"multus-additional-cni-plugins-9qntz\" (UID: \"043d9bc2-3514-4d10-b995-a2e6783e6939\") " pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:27.881800 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:27.881766    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 04:49:27.882435 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:27.882411    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 04:49:27.882586 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:27.882439    2564 projected.go:196] Error preparing data for projected volume kube-api-access-pngxm for pod openshift-network-diagnostics/network-check-target-l8nc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 04:49:27.882586 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:27.882508    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm podName:9514d6c6-a71f-4861-a495-84df181bdbfd nodeName:}" failed. No retries permitted until 2026-07-17 04:49:28.382488254 +0000 UTC m=+3.060094608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pngxm" (UniqueName: "kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm") pod "network-check-target-l8nc2" (UID: "9514d6c6-a71f-4861-a495-84df181bdbfd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 04:49:27.882586 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.882527    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glz67\" (UniqueName: \"kubernetes.io/projected/67982dd2-375d-410d-9aed-935ff75fa7c7-kube-api-access-glz67\") pod \"ovnkube-node-vhvmc\" (UID: \"67982dd2-375d-410d-9aed-935ff75fa7c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:27.882882 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.882375    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s274w\" (UniqueName: \"kubernetes.io/projected/f99dd7be-8ce9-480d-a3a7-32da596b6ab3-kube-api-access-s274w\") pod \"multus-mktcn\" (UID: \"f99dd7be-8ce9-480d-a3a7-32da596b6ab3\") " pod="openshift-multus/multus-mktcn"
Jul 17 04:49:27.883164 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.883134    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vl2b\" (UniqueName: \"kubernetes.io/projected/ba97ada7-a006-40a4-a0ef-513d06d8645a-kube-api-access-4vl2b\") pod \"node-ca-d4sqb\" (UID: \"ba97ada7-a006-40a4-a0ef-513d06d8645a\") " pod="openshift-image-registry/node-ca-d4sqb"
Jul 17 04:49:27.883258 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.883135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbhcm\" (UniqueName: \"kubernetes.io/projected/0a1a5036-08c3-4598-8271-0b3e5746e98f-kube-api-access-gbhcm\") pod \"node-resolver-28dgh\" (UID: \"0a1a5036-08c3-4598-8271-0b3e5746e98f\") " pod="openshift-dns/node-resolver-28dgh"
Jul 17 04:49:27.884015 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.883997    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wt2d\" (UniqueName: \"kubernetes.io/projected/9a51bc06-925e-4002-a7d0-f5e239dc83d9-kube-api-access-8wt2d\") pod \"tuned-phhzw\" (UID: \"9a51bc06-925e-4002-a7d0-f5e239dc83d9\") " pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:27.884803 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.884784    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wddvr\" (UniqueName: \"kubernetes.io/projected/17c170e0-f040-42d6-9047-9afaa449d88e-kube-api-access-wddvr\") pod \"network-metrics-daemon-hfzzb\" (UID: \"17c170e0-f040-42d6-9047-9afaa449d88e\") " pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:27.976206 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976109    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd3883fe-1e59-474f-aa19-3b3fae77ab85-dbus\") pod \"global-pull-secret-syncer-tr4jx\" (UID: \"cd3883fe-1e59-474f-aa19-3b3fae77ab85\") " pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:27.976206 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976151    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd3883fe-1e59-474f-aa19-3b3fae77ab85-kubelet-config\") pod \"global-pull-secret-syncer-tr4jx\" (UID: \"cd3883fe-1e59-474f-aa19-3b3fae77ab85\") " pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:27.976206 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-registration-dir\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.976471 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976216    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.976471 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976263    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-device-dir\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.976471 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976287    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw9ln\" (UniqueName: \"kubernetes.io/projected/577ed248-8bbf-4edc-a5de-c97774dbc981-kube-api-access-xw9ln\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.976471 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976291    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd3883fe-1e59-474f-aa19-3b3fae77ab85-kubelet-config\") pod \"global-pull-secret-syncer-tr4jx\" (UID: \"cd3883fe-1e59-474f-aa19-3b3fae77ab85\") " pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:27.976471 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976302    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-registration-dir\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.976471 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976330    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret\") pod \"global-pull-secret-syncer-tr4jx\" (UID: \"cd3883fe-1e59-474f-aa19-3b3fae77ab85\") " pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:27.976471 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976345    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd3883fe-1e59-474f-aa19-3b3fae77ab85-dbus\") pod \"global-pull-secret-syncer-tr4jx\" (UID: \"cd3883fe-1e59-474f-aa19-3b3fae77ab85\") " pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:27.976471 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976355    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.976471 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976361    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-device-dir\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.976471 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-socket-dir\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.976471 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.976471 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:27.976456    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 04:49:27.977046 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976486    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-socket-dir\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.977046 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976519    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-sys-fs\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.977046 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976560    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.977046 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:27.976573    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret podName:cd3883fe-1e59-474f-aa19-3b3fae77ab85 nodeName:}" failed. No retries permitted until 2026-07-17 04:49:28.476548527 +0000 UTC m=+3.154154860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret") pod "global-pull-secret-syncer-tr4jx" (UID: "cd3883fe-1e59-474f-aa19-3b3fae77ab85") : object "kube-system"/"original-pull-secret" not registered
Jul 17 04:49:27.977046 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.976607    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/577ed248-8bbf-4edc-a5de-c97774dbc981-sys-fs\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:27.986901 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:27.986871    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw9ln\" (UniqueName: \"kubernetes.io/projected/577ed248-8bbf-4edc-a5de-c97774dbc981-kube-api-access-xw9ln\") pod \"aws-ebs-csi-driver-node-t9ctw\" (UID: \"577ed248-8bbf-4edc-a5de-c97774dbc981\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:28.052686 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:28.052630    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d4sqb"
Jul 17 04:49:28.064749 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:28.064716    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t6ttc"
Jul 17 04:49:28.075050 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:28.075016    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:28.080052 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:28.080027    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cvz5q"
Jul 17 04:49:28.087851 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:28.087827    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-phhzw"
Jul 17 04:49:28.096434 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:28.096405    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9qntz"
Jul 17 04:49:28.105238 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:28.105215    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mktcn"
Jul 17 04:49:28.114005 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:28.113981    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-28dgh"
Jul 17 04:49:28.121880 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:28.121856    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw"
Jul 17 04:49:28.380183 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:28.380095    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs\") pod \"network-metrics-daemon-hfzzb\" (UID: \"17c170e0-f040-42d6-9047-9afaa449d88e\") " pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:28.380331 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:28.380267    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 04:49:28.380396 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:28.380354    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs podName:17c170e0-f040-42d6-9047-9afaa449d88e nodeName:}" failed. No retries permitted until 2026-07-17 04:49:29.380330518 +0000 UTC m=+4.057936869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs") pod "network-metrics-daemon-hfzzb" (UID: "17c170e0-f040-42d6-9047-9afaa449d88e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 04:49:28.481099 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:28.481060    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret\") pod \"global-pull-secret-syncer-tr4jx\" (UID: \"cd3883fe-1e59-474f-aa19-3b3fae77ab85\") " pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:28.481273 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:28.481158    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pngxm\" (UniqueName: \"kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm\") pod \"network-check-target-l8nc2\" (UID: \"9514d6c6-a71f-4861-a495-84df181bdbfd\") " pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:28.481273 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:28.481251    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 04:49:28.481273 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:28.481267    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 04:49:28.481438 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:28.481286    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 04:49:28.481438 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:28.481301    2564 projected.go:196] Error preparing data for projected volume kube-api-access-pngxm for pod openshift-network-diagnostics/network-check-target-l8nc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 04:49:28.481438 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:28.481330    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret podName:cd3883fe-1e59-474f-aa19-3b3fae77ab85 nodeName:}" failed. No retries permitted until 2026-07-17 04:49:29.481307193 +0000 UTC m=+4.158913534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret") pod "global-pull-secret-syncer-tr4jx" (UID: "cd3883fe-1e59-474f-aa19-3b3fae77ab85") : object "kube-system"/"original-pull-secret" not registered
Jul 17 04:49:28.481438 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:28.481352    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm podName:9514d6c6-a71f-4861-a495-84df181bdbfd nodeName:}" failed. No retries permitted until 2026-07-17 04:49:29.481338549 +0000 UTC m=+4.158944875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pngxm" (UniqueName: "kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm") pod "network-check-target-l8nc2" (UID: "9514d6c6-a71f-4861-a495-84df181bdbfd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 04:49:28.808241 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:28.808136    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 04:44:28 +0000 UTC" deadline="2028-03-09 20:03:57.961081919 +0000 UTC"
Jul 17 04:49:28.808241 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:28.808175    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14439h14m29.152911614s"
Jul 17 04:49:28.919634 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:28.919595    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb83c3ec_3edd_47c8_8ac9_c0a227dbbfa6.slice/crio-23ed0a0dff3fd9c2a1bf6a57d12268aefe32a32ac6c405cad1ee9f868bf01769 WatchSource:0}: Error finding container 23ed0a0dff3fd9c2a1bf6a57d12268aefe32a32ac6c405cad1ee9f868bf01769: Status 404 returned error can't find the container with id 23ed0a0dff3fd9c2a1bf6a57d12268aefe32a32ac6c405cad1ee9f868bf01769
Jul 17 04:49:28.922680 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:28.922556    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf99dd7be_8ce9_480d_a3a7_32da596b6ab3.slice/crio-ef6d598422e507ed0f8346491b56f578ff059431874740b2eff3bd941affe75c WatchSource:0}: Error finding container ef6d598422e507ed0f8346491b56f578ff059431874740b2eff3bd941affe75c: Status 404 returned error can't find the container with id ef6d598422e507ed0f8346491b56f578ff059431874740b2eff3bd941affe75c
Jul 17 04:49:28.930495 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:28.930293    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2085722b_2750_43c8_be34_b946f6052541.slice/crio-b3e5b15dc4e833716b121e6fe9b196f5afe5ad38ee265e4935bd360b36b56013 WatchSource:0}: Error finding container b3e5b15dc4e833716b121e6fe9b196f5afe5ad38ee265e4935bd360b36b56013: Status 404 returned error can't find the container with id b3e5b15dc4e833716b121e6fe9b196f5afe5ad38ee265e4935bd360b36b56013
Jul 17 04:49:28.937255 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:49:28.936885    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod043d9bc2_3514_4d10_b995_a2e6783e6939.slice/crio-1a64e3d62539a25c1ecf9cdd6a87f2ae5078d16323c282b7156dc02bb0858f3d WatchSource:0}: Error finding container 1a64e3d62539a25c1ecf9cdd6a87f2ae5078d16323c282b7156dc02bb0858f3d: Status 404 returned error can't find the container with id 1a64e3d62539a25c1ecf9cdd6a87f2ae5078d16323c282b7156dc02bb0858f3d
Jul 17 04:49:29.388882 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.388683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs\") pod \"network-metrics-daemon-hfzzb\" (UID: \"17c170e0-f040-42d6-9047-9afaa449d88e\") " pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:29.389079 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:29.388854    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 04:49:29.389079 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:29.389031    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs podName:17c170e0-f040-42d6-9047-9afaa449d88e nodeName:}" failed. No retries permitted until 2026-07-17 04:49:31.389007899 +0000 UTC m=+6.066614224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs") pod "network-metrics-daemon-hfzzb" (UID: "17c170e0-f040-42d6-9047-9afaa449d88e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 04:49:29.491361 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.490889    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pngxm\" (UniqueName: \"kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm\") pod \"network-check-target-l8nc2\" (UID: \"9514d6c6-a71f-4861-a495-84df181bdbfd\") " pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:29.491361 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.490944    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret\") pod \"global-pull-secret-syncer-tr4jx\" (UID: \"cd3883fe-1e59-474f-aa19-3b3fae77ab85\") " pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:29.491361 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:29.491089    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 04:49:29.491361 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:29.491098    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 04:49:29.491361 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:29.491111    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 04:49:29.491361 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:29.491124    2564 projected.go:196] Error preparing data for projected volume kube-api-access-pngxm for pod openshift-network-diagnostics/network-check-target-l8nc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 04:49:29.491361 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:29.491179    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret podName:cd3883fe-1e59-474f-aa19-3b3fae77ab85 nodeName:}" failed. No retries permitted until 2026-07-17 04:49:31.491156476 +0000 UTC m=+6.168762826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret") pod "global-pull-secret-syncer-tr4jx" (UID: "cd3883fe-1e59-474f-aa19-3b3fae77ab85") : object "kube-system"/"original-pull-secret" not registered
Jul 17 04:49:29.491361 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:29.491200    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm podName:9514d6c6-a71f-4861-a495-84df181bdbfd nodeName:}" failed. No retries permitted until 2026-07-17 04:49:31.491190428 +0000 UTC m=+6.168796760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pngxm" (UniqueName: "kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm") pod "network-check-target-l8nc2" (UID: "9514d6c6-a71f-4861-a495-84df181bdbfd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 04:49:29.809037 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.808891    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 04:44:28 +0000 UTC" deadline="2028-01-10 08:01:21.252039764 +0000 UTC"
Jul 17 04:49:29.809037 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.808968    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13011h11m51.443077472s"
Jul 17 04:49:29.859564 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.859527    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:29.859782 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:29.859719    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:29.860177 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.860154    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:29.860292 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:29.860270    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:29.860366 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.860351    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:29.860469 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:29.860447    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:29.872600 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.872469    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qntz" event={"ID":"043d9bc2-3514-4d10-b995-a2e6783e6939","Type":"ContainerStarted","Data":"1a64e3d62539a25c1ecf9cdd6a87f2ae5078d16323c282b7156dc02bb0858f3d"}
Jul 17 04:49:29.878069 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.877959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d4sqb" event={"ID":"ba97ada7-a006-40a4-a0ef-513d06d8645a","Type":"ContainerStarted","Data":"16e3a7bb14dc35f87e294b948c2aacb90e0c8e0e091fadabae2d669b5d05dd91"}
Jul 17 04:49:29.882705 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.882664    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t6ttc" event={"ID":"2085722b-2750-43c8-be34-b946f6052541","Type":"ContainerStarted","Data":"b3e5b15dc4e833716b121e6fe9b196f5afe5ad38ee265e4935bd360b36b56013"}
Jul 17 04:49:29.892719 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.892633    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mktcn" event={"ID":"f99dd7be-8ce9-480d-a3a7-32da596b6ab3","Type":"ContainerStarted","Data":"ef6d598422e507ed0f8346491b56f578ff059431874740b2eff3bd941affe75c"}
Jul 17 04:49:29.901604 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.901560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-234.ec2.internal" event={"ID":"f00b257fb549beca1ce15bbf5a89e032","Type":"ContainerStarted","Data":"07cf880d738b02adfe96636a3cf71373b819477a76ab5b0f829dc2319bdf212c"}
Jul 17 04:49:29.913484 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.913439    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-28dgh" event={"ID":"0a1a5036-08c3-4598-8271-0b3e5746e98f","Type":"ContainerStarted","Data":"6fe2c30222481b8539e19144b6a391a13f710fea2fed3bd498486c43dba10031"}
Jul 17 04:49:29.918475 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.918409    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-234.ec2.internal" podStartSLOduration=2.9183850209999997 podStartE2EDuration="2.918385021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 04:49:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:49:29.917671067 +0000 UTC m=+4.595277417" watchObservedRunningTime="2026-07-17 04:49:29.918385021 +0000 UTC m=+4.595991400"
Jul 17 04:49:29.924932 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.924806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc" event={"ID":"67982dd2-375d-410d-9aed-935ff75fa7c7","Type":"ContainerStarted","Data":"9af47de33a4f75014e55c93df2a5a7f0c000569e10b474fe898bce42706eb99d"}
Jul 17 04:49:29.930262 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.930218    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-phhzw" event={"ID":"9a51bc06-925e-4002-a7d0-f5e239dc83d9","Type":"ContainerStarted","Data":"786b8e49ebcc0221ab4542d9e571624b0dcfa121247932704aa2cd6cb86fedf0"}
Jul 17 04:49:29.944479 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.944427    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cvz5q" event={"ID":"cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6","Type":"ContainerStarted","Data":"23ed0a0dff3fd9c2a1bf6a57d12268aefe32a32ac6c405cad1ee9f868bf01769"}
Jul 17 04:49:29.967768 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.967722    2564 generic.go:356] "Generic (PLEG): container finished" podID="3910d06d0c033a0348614d5b0f9ead4c" containerID="2b3d7dc03c7e61d523fa223b9d0cba05b98dea23e4abefcd72c3604c9ff9543b" exitCode=0
Jul 17 04:49:29.967966 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.967849    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal" event={"ID":"3910d06d0c033a0348614d5b0f9ead4c","Type":"ContainerDied","Data":"2b3d7dc03c7e61d523fa223b9d0cba05b98dea23e4abefcd72c3604c9ff9543b"}
Jul 17 04:49:29.974025 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:29.973983    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw" event={"ID":"577ed248-8bbf-4edc-a5de-c97774dbc981","Type":"ContainerStarted","Data":"c163bc50c14a9b13adf4e4a8eb03e5dc59517661776cf68963a8ca08b1f1b3ca"}
Jul 17 04:49:30.983808 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:30.983772    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal" event={"ID":"3910d06d0c033a0348614d5b0f9ead4c","Type":"ContainerStarted","Data":"55e05afd40472c7ff7e54e19e6d11dcf7daa04ae3e4bcf07713f57a34ac9e7fa"}
Jul 17 04:49:31.000138 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:31.000077    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-234.ec2.internal" podStartSLOduration=4.000052369 podStartE2EDuration="4.000052369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 04:49:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:49:30.99996462 +0000 UTC m=+5.677570970" watchObservedRunningTime="2026-07-17 04:49:31.000052369 +0000 UTC m=+5.677658739"
Jul 17 04:49:31.408860 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:31.408756    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs\") pod \"network-metrics-daemon-hfzzb\" (UID: \"17c170e0-f040-42d6-9047-9afaa449d88e\") " pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:31.409050 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:31.408888    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 04:49:31.409050 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:31.408949    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs podName:17c170e0-f040-42d6-9047-9afaa449d88e nodeName:}" failed. No retries permitted until 2026-07-17 04:49:35.408933809 +0000 UTC m=+10.086540138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs") pod "network-metrics-daemon-hfzzb" (UID: "17c170e0-f040-42d6-9047-9afaa449d88e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 04:49:31.510917 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:31.510005    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pngxm\" (UniqueName: \"kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm\") pod \"network-check-target-l8nc2\" (UID: \"9514d6c6-a71f-4861-a495-84df181bdbfd\") " pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:31.510917 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:31.510073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret\") pod \"global-pull-secret-syncer-tr4jx\" (UID: \"cd3883fe-1e59-474f-aa19-3b3fae77ab85\") " pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:31.510917 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:31.510266    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 04:49:31.510917 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:31.510331    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret podName:cd3883fe-1e59-474f-aa19-3b3fae77ab85 nodeName:}" failed. No retries permitted until 2026-07-17 04:49:35.510312571 +0000 UTC m=+10.187918904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret") pod "global-pull-secret-syncer-tr4jx" (UID: "cd3883fe-1e59-474f-aa19-3b3fae77ab85") : object "kube-system"/"original-pull-secret" not registered
Jul 17 04:49:31.510917 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:31.510792    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 04:49:31.510917 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:31.510812    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 04:49:31.510917 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:31.510829    2564 projected.go:196] Error preparing data for projected volume kube-api-access-pngxm for pod openshift-network-diagnostics/network-check-target-l8nc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 04:49:31.510917 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:31.510877    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm podName:9514d6c6-a71f-4861-a495-84df181bdbfd nodeName:}" failed. No retries permitted until 2026-07-17 04:49:35.510862301 +0000 UTC m=+10.188468629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pngxm" (UniqueName: "kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm") pod "network-check-target-l8nc2" (UID: "9514d6c6-a71f-4861-a495-84df181bdbfd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 04:49:31.851776 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:31.850905    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:31.851776 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:31.851043    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:31.851776 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:31.851443    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:31.851776 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:31.851564    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:31.851776 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:31.851614    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:31.851776 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:31.851685    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:33.851981 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:33.851940    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:33.852447 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:33.851940    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:33.852447 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:33.852098    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:33.852447 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:33.851940    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:33.852447 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:33.852175    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:33.852447 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:33.852292    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:35.445973 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:35.445303    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs\") pod \"network-metrics-daemon-hfzzb\" (UID: \"17c170e0-f040-42d6-9047-9afaa449d88e\") " pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:35.445973 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:35.445515    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 04:49:35.445973 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:35.445584    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs podName:17c170e0-f040-42d6-9047-9afaa449d88e nodeName:}" failed. No retries permitted until 2026-07-17 04:49:43.445563011 +0000 UTC m=+18.123169344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs") pod "network-metrics-daemon-hfzzb" (UID: "17c170e0-f040-42d6-9047-9afaa449d88e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 04:49:35.546242 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:35.546161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pngxm\" (UniqueName: \"kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm\") pod \"network-check-target-l8nc2\" (UID: \"9514d6c6-a71f-4861-a495-84df181bdbfd\") " pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:35.546432 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:35.546265    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret\") pod \"global-pull-secret-syncer-tr4jx\" (UID: \"cd3883fe-1e59-474f-aa19-3b3fae77ab85\") " pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:35.546432 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:35.546345    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 04:49:35.546432 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:35.546367    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 04:49:35.546432 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:35.546380    2564 projected.go:196] Error preparing data for projected volume kube-api-access-pngxm for pod openshift-network-diagnostics/network-check-target-l8nc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 04:49:35.546432 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:35.546415    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 04:49:35.546682 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:35.546443    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm podName:9514d6c6-a71f-4861-a495-84df181bdbfd nodeName:}" failed. No retries permitted until 2026-07-17 04:49:43.546424164 +0000 UTC m=+18.224030517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pngxm" (UniqueName: "kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm") pod "network-check-target-l8nc2" (UID: "9514d6c6-a71f-4861-a495-84df181bdbfd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 04:49:35.546682 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:35.546462    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret podName:cd3883fe-1e59-474f-aa19-3b3fae77ab85 nodeName:}" failed. No retries permitted until 2026-07-17 04:49:43.546452863 +0000 UTC m=+18.224059189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret") pod "global-pull-secret-syncer-tr4jx" (UID: "cd3883fe-1e59-474f-aa19-3b3fae77ab85") : object "kube-system"/"original-pull-secret" not registered
Jul 17 04:49:35.855275 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:35.855187    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:35.855452 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:35.855328    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:35.855887 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:35.855743    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:35.855887 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:35.855856    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:35.856060 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:35.855933    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:35.856060 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:35.855853    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:37.852850 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:37.852754    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:37.853323 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:37.852754    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:37.853323 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:37.852900    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:37.853323 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:37.852765    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:37.853323 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:37.852963    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:37.853323 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:37.853018    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:39.851184 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:39.851139    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:39.851184 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:39.851167    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:39.851744 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:39.851148    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:39.851744 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:39.851271    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:39.851744 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:39.851325    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:39.851744 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:39.851401    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:41.851082 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:41.851045    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:41.851559 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:41.851173    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:41.851932 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:41.851912    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:41.852029 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:41.852010    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:41.852230 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:41.852193    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:41.852362 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:41.852307    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:43.507793 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:43.507757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs\") pod \"network-metrics-daemon-hfzzb\" (UID: \"17c170e0-f040-42d6-9047-9afaa449d88e\") " pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:43.508280 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:43.507933    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 04:49:43.508280 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:43.508006    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs podName:17c170e0-f040-42d6-9047-9afaa449d88e nodeName:}" failed. No retries permitted until 2026-07-17 04:49:59.507984095 +0000 UTC m=+34.185590418 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs") pod "network-metrics-daemon-hfzzb" (UID: "17c170e0-f040-42d6-9047-9afaa449d88e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 04:49:43.608636 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:43.608572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pngxm\" (UniqueName: \"kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm\") pod \"network-check-target-l8nc2\" (UID: \"9514d6c6-a71f-4861-a495-84df181bdbfd\") " pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:43.608814 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:43.608645    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret\") pod \"global-pull-secret-syncer-tr4jx\" (UID: \"cd3883fe-1e59-474f-aa19-3b3fae77ab85\") " pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:43.608814 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:43.608760    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 04:49:43.608814 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:43.608757    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 04:49:43.608814 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:43.608793    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 04:49:43.608814 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:43.608803    2564 projected.go:196] Error preparing data for projected volume kube-api-access-pngxm for pod openshift-network-diagnostics/network-check-target-l8nc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 04:49:43.609012 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:43.608828    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret podName:cd3883fe-1e59-474f-aa19-3b3fae77ab85 nodeName:}" failed. No retries permitted until 2026-07-17 04:49:59.60880959 +0000 UTC m=+34.286415918 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret") pod "global-pull-secret-syncer-tr4jx" (UID: "cd3883fe-1e59-474f-aa19-3b3fae77ab85") : object "kube-system"/"original-pull-secret" not registered
Jul 17 04:49:43.609012 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:43.608847    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm podName:9514d6c6-a71f-4861-a495-84df181bdbfd nodeName:}" failed. No retries permitted until 2026-07-17 04:49:59.608835548 +0000 UTC m=+34.286441872 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pngxm" (UniqueName: "kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm") pod "network-check-target-l8nc2" (UID: "9514d6c6-a71f-4861-a495-84df181bdbfd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 04:49:43.850997 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:43.850958    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:43.851201 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:43.850964    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:43.851201 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:43.851107    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:43.851201 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:43.851157    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:43.851421 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:43.851246    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:43.851421 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:43.851316    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:45.851776 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:45.851738    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:45.852172 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:45.851854    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:45.852172 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:45.851870    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:45.852172 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:45.851927    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:45.852172 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:45.851954    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:45.852172 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:45.852041    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:47.851600 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:47.851565    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:47.852053 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:47.851565    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:47.852053 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:47.851692    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:47.852053 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:47.851711    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:47.852053 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:47.851810    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:47.852053 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:47.851887    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:49.025294 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:49.025255    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cvz5q" event={"ID":"cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6","Type":"ContainerStarted","Data":"43aa5b2c07c485bfd33292919fd91ee2630b4489cfecce629c502de13afe1198"}
Jul 17 04:49:49.028157 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:49.028125    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw" event={"ID":"577ed248-8bbf-4edc-a5de-c97774dbc981","Type":"ContainerStarted","Data":"4e5a4af58754094f7edeb769308f40cbc9e59a2e3e9745dc2c7f48652cc4f1ef"}
Jul 17 04:49:49.030198 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:49.030162    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qntz" event={"ID":"043d9bc2-3514-4d10-b995-a2e6783e6939","Type":"ContainerStarted","Data":"4b49e5ec22663d8d25cdc6cc05cb586c77aa88c4c0780b9cfaf89f37d02c3f34"}
Jul 17 04:49:49.031370 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:49.031348    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d4sqb" event={"ID":"ba97ada7-a006-40a4-a0ef-513d06d8645a","Type":"ContainerStarted","Data":"c1a720fd41caf47aaf8574897ef56b59ddbef026cfcc9f1b9f247998f0da71df"}
Jul 17 04:49:49.036760 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:49.036718    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mktcn" event={"ID":"f99dd7be-8ce9-480d-a3a7-32da596b6ab3","Type":"ContainerStarted","Data":"b40f5f2316c5404b1029cb1ec304886894c5d234cfc8fcd41daef8c6850f7bdb"}
Jul 17 04:49:49.038420 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:49.038394    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-28dgh" event={"ID":"0a1a5036-08c3-4598-8271-0b3e5746e98f","Type":"ContainerStarted","Data":"1daae00fde8efb2d65a3532901086b38d470f22ee8a952e6993671b31efb7421"}
Jul 17 04:49:49.039915 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:49.039861    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cvz5q" podStartSLOduration=7.426157324 podStartE2EDuration="23.03984231s" totalImagesPullingTime="15.613684986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:49:49.039393988 +0000 UTC m=+23.717000336" watchObservedRunningTime="2026-07-17 04:49:49.03984231 +0000 UTC m=+23.717448694"
Jul 17 04:49:49.040964 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:49.040743    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc" event={"ID":"67982dd2-375d-410d-9aed-935ff75fa7c7","Type":"ContainerStarted","Data":"f1a637e2c2f897670cbd1604e43718e01cfa6581d7ccaab982fe6482f858db1e"}
Jul 17 04:49:49.042646 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:49.042603    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-phhzw" event={"ID":"9a51bc06-925e-4002-a7d0-f5e239dc83d9","Type":"ContainerStarted","Data":"98c8ec6d8718e5025284f86a5d9fff24996c1978786d7dc722292e7de30cd9d6"}
Jul 17 04:49:49.054152 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:49.053970    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-28dgh" podStartSLOduration=2.225594187 podStartE2EDuration="22.05395456s" totalImagesPullingTime="19.828360373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 04:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:49:49.053415132 +0000 UTC m=+23.731021481" watchObservedRunningTime="2026-07-17 04:49:49.05395456 +0000 UTC m=+23.731560905"
Jul 17 04:49:49.092508 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:49.092462    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mktcn" podStartSLOduration=3.173027304 podStartE2EDuration="23.092446718s" totalImagesPullingTime="19.919419414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 04:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:49:49.091651604 +0000 UTC m=+23.769257951" watchObservedRunningTime="2026-07-17 04:49:49.092446718 +0000 UTC m=+23.770053064"
Jul 17 04:49:49.105212 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:49.105171    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d4sqb" podStartSLOduration=3.314864552 podStartE2EDuration="23.105155604s" totalImagesPullingTime="19.790291052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 04:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:49:49.104934116 +0000 UTC m=+23.782540462" watchObservedRunningTime="2026-07-17 04:49:49.105155604 +0000 UTC m=+23.782761951"
Jul 17 04:49:49.120969 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:49.120913    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-phhzw" podStartSLOduration=3.279507347 podStartE2EDuration="23.120896082s" totalImagesPullingTime="19.841388735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 04:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:49:49.120405052 +0000 UTC m=+23.798011401" watchObservedRunningTime="2026-07-17 04:49:49.120896082 +0000 UTC m=+23.798502427"
Jul 17 04:49:49.851059 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:49.850970    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:49.851059 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:49.851003    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:49.851059 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:49.850972    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:49.851359 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:49.851114    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:49.851359 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:49.851204    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:49.851359 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:49.851315    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:50.046474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:50.046393    2564 generic.go:356] "Generic (PLEG): container finished" podID="043d9bc2-3514-4d10-b995-a2e6783e6939" containerID="4b49e5ec22663d8d25cdc6cc05cb586c77aa88c4c0780b9cfaf89f37d02c3f34" exitCode=0
Jul 17 04:49:50.047168 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:50.046482    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qntz" event={"ID":"043d9bc2-3514-4d10-b995-a2e6783e6939","Type":"ContainerDied","Data":"4b49e5ec22663d8d25cdc6cc05cb586c77aa88c4c0780b9cfaf89f37d02c3f34"}
Jul 17 04:49:50.055644 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:50.055600    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc" event={"ID":"67982dd2-375d-410d-9aed-935ff75fa7c7","Type":"ContainerStarted","Data":"4135fc39805bdce4615ac61a6ce66a66f5f852dcdc2b6637c4a7f446504db4d7"}
Jul 17 04:49:50.055760 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:50.055699    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc" event={"ID":"67982dd2-375d-410d-9aed-935ff75fa7c7","Type":"ContainerStarted","Data":"384e79a22403bff106301c9493bdfec73630284516ef29fc620826eea9f4510c"}
Jul 17 04:49:50.055760 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:50.055744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc" event={"ID":"67982dd2-375d-410d-9aed-935ff75fa7c7","Type":"ContainerStarted","Data":"1411a32461ca84026357dd02d68ec5884b4d03fcb277de31d96ff467ff9fe5cc"}
Jul 17 04:49:50.055832 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:50.055788    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc" event={"ID":"67982dd2-375d-410d-9aed-935ff75fa7c7","Type":"ContainerStarted","Data":"fa616cc577082dcc118da1a88edefee57c1f57df56aed632c9a6f8f624de699f"}
Jul 17 04:49:50.055867 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:50.055837    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc" event={"ID":"67982dd2-375d-410d-9aed-935ff75fa7c7","Type":"ContainerStarted","Data":"7562e12d09db09f93ec6d5ebf86d07611e556bf28de3d4fbc255a37e8d2176e7"}
Jul 17 04:49:50.371329 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:50.371303    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 04:49:50.416004 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:50.415966    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cvz5q"
Jul 17 04:49:50.416565 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:50.416541    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cvz5q"
Jul 17 04:49:50.832980 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:50.832838    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T04:49:50.371320998Z","UUID":"8b75c9e3-db59-4711-9203-49254e2abb40","Handler":null,"Name":"","Endpoint":""}
Jul 17 04:49:50.834364 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:50.834346    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 04:49:50.834484 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:50.834381    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 04:49:51.059825 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:51.059786    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw" event={"ID":"577ed248-8bbf-4edc-a5de-c97774dbc981","Type":"ContainerStarted","Data":"46bd30dc50c642e2538ca84af72c4316152a4e2b8d090c68689993f519175f5c"}
Jul 17 04:49:51.061501 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:51.061437    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t6ttc" event={"ID":"2085722b-2750-43c8-be34-b946f6052541","Type":"ContainerStarted","Data":"968576ae4ae96de5bc29975ebe45c47e730f6a03410a50d44994c59b64354532"}
Jul 17 04:49:51.079165 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:51.079114    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t6ttc" podStartSLOduration=5.243521437 podStartE2EDuration="25.079095411s" totalImagesPullingTime="19.835573974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 04:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:49:51.078538162 +0000 UTC m=+25.756144509" watchObservedRunningTime="2026-07-17 04:49:51.079095411 +0000 UTC m=+25.756701757"
Jul 17 04:49:51.851581 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:51.851545    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:51.851765 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:51.851545    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:51.851765 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:51.851683    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:51.851765 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:51.851724    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:51.851765 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:51.851553    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:51.852356 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:51.852319    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:52.066333 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:52.066095    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw" event={"ID":"577ed248-8bbf-4edc-a5de-c97774dbc981","Type":"ContainerStarted","Data":"10d506b27db255e2d5d2c47c6e7f740d642fac340a34fa936d7b3ada6fa590cb"}
Jul 17 04:49:52.069606 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:52.069574    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc" event={"ID":"67982dd2-375d-410d-9aed-935ff75fa7c7","Type":"ContainerStarted","Data":"541250198cf0efb75acbd129eb43e6c0d85467635bcb4fe21f88156240251284"}
Jul 17 04:49:52.069785 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:52.069661    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 17 04:49:52.084805 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:52.084752    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9ctw" podStartSLOduration=6.738209759 podStartE2EDuration="25.084734566s" totalImagesPullingTime="18.346524807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 04:49:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:49:52.083142428 +0000 UTC m=+26.760748774" watchObservedRunningTime="2026-07-17 04:49:52.084734566 +0000 UTC m=+26.762340911"
Jul 17 04:49:53.760880 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:53.760842    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cvz5q"
Jul 17 04:49:53.761423 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:53.760968    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 17 04:49:53.761533 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:53.761513    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cvz5q"
Jul 17 04:49:53.854565 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:53.854535    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:53.854762 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:53.854535    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:53.854762 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:53.854671    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:53.854762 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:53.854686    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:53.854913 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:53.854770    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:53.854913 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:53.854865    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:55.078297 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:55.078052    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qntz" event={"ID":"043d9bc2-3514-4d10-b995-a2e6783e6939","Type":"ContainerStarted","Data":"3affe6d14721dc71217b7b0fc48d0d34e0781842184fd6fa86dd93f80fb8bd5b"}
Jul 17 04:49:55.084954 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:55.084929    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc" event={"ID":"67982dd2-375d-410d-9aed-935ff75fa7c7","Type":"ContainerStarted","Data":"b726ea8f067b94cd85d68c13319f3b99c0c5e6b15edb4f4f0f0e18fd2caf959a"}
Jul 17 04:49:55.085886 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:55.085681    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:55.085886 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:55.085780    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:55.104379 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:55.104354    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:55.124956 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:55.124913    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc" podStartSLOduration=9.217275332 podStartE2EDuration="29.124898539s" totalImagesPullingTime="19.907623207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 04:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:49:55.123259959 +0000 UTC m=+29.800866328" watchObservedRunningTime="2026-07-17 04:49:55.124898539 +0000 UTC m=+29.802504885"
Jul 17 04:49:55.851466 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:55.851438    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:55.851725 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:55.851511    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:55.851725 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:55.851521    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:55.851725 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:55.851607    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:55.851725 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:55.851684    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:55.851856 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:55.851787    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:56.088923 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:56.088890    2564 generic.go:356] "Generic (PLEG): container finished" podID="043d9bc2-3514-4d10-b995-a2e6783e6939" containerID="3affe6d14721dc71217b7b0fc48d0d34e0781842184fd6fa86dd93f80fb8bd5b" exitCode=0
Jul 17 04:49:56.089407 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:56.088970    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qntz" event={"ID":"043d9bc2-3514-4d10-b995-a2e6783e6939","Type":"ContainerDied","Data":"3affe6d14721dc71217b7b0fc48d0d34e0781842184fd6fa86dd93f80fb8bd5b"}
Jul 17 04:49:56.089407 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:56.089381    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:56.106667 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:56.106579    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:49:56.786164 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:56.786132    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tr4jx"]
Jul 17 04:49:56.786362 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:56.786284    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:56.786577 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:56.786544    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:56.791024 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:56.790993    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l8nc2"]
Jul 17 04:49:56.791287 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:56.791068    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hfzzb"]
Jul 17 04:49:56.791287 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:56.791164    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:56.791287 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:56.791164    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:56.791287 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:56.791252    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:56.791505 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:56.791308    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:57.854607 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:57.854576    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:57.854991 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:57.854695    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:49:58.094613 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:58.094577    2564 generic.go:356] "Generic (PLEG): container finished" podID="043d9bc2-3514-4d10-b995-a2e6783e6939" containerID="3c5ce83f62fed8963a62173ac27f552d391768a63026f0bfd1673e35302af835" exitCode=0
Jul 17 04:49:58.094820 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:58.094663    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qntz" event={"ID":"043d9bc2-3514-4d10-b995-a2e6783e6939","Type":"ContainerDied","Data":"3c5ce83f62fed8963a62173ac27f552d391768a63026f0bfd1673e35302af835"}
Jul 17 04:49:58.851742 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:58.851536    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:58.851856 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:58.851555    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:58.851856 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:58.851838    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:49:58.851968 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:58.851906    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:49:59.099992 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:59.099902    2564 generic.go:356] "Generic (PLEG): container finished" podID="043d9bc2-3514-4d10-b995-a2e6783e6939" containerID="c8d8f51878f4f93f8bec7a1c56b584398d3946171c584cd07cb68fe7b2cc808f" exitCode=0
Jul 17 04:49:59.099992 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:59.099965    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qntz" event={"ID":"043d9bc2-3514-4d10-b995-a2e6783e6939","Type":"ContainerDied","Data":"c8d8f51878f4f93f8bec7a1c56b584398d3946171c584cd07cb68fe7b2cc808f"}
Jul 17 04:49:59.517456 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:59.517366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs\") pod \"network-metrics-daemon-hfzzb\" (UID: \"17c170e0-f040-42d6-9047-9afaa449d88e\") " pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:49:59.517610 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:59.517533    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 04:49:59.517696 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:59.517613    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs podName:17c170e0-f040-42d6-9047-9afaa449d88e nodeName:}" failed. No retries permitted until 2026-07-17 04:50:31.517592496 +0000 UTC m=+66.195198833 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs") pod "network-metrics-daemon-hfzzb" (UID: "17c170e0-f040-42d6-9047-9afaa449d88e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 04:49:59.617736 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:59.617698    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pngxm\" (UniqueName: \"kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm\") pod \"network-check-target-l8nc2\" (UID: \"9514d6c6-a71f-4861-a495-84df181bdbfd\") " pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:49:59.617736 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:59.617739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret\") pod \"global-pull-secret-syncer-tr4jx\" (UID: \"cd3883fe-1e59-474f-aa19-3b3fae77ab85\") " pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:59.617987 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:59.617862    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 04:49:59.617987 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:59.617922    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 04:49:59.617987 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:59.617941    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret podName:cd3883fe-1e59-474f-aa19-3b3fae77ab85 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:31.617909854 +0000 UTC m=+66.295516202 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret") pod "global-pull-secret-syncer-tr4jx" (UID: "cd3883fe-1e59-474f-aa19-3b3fae77ab85") : object "kube-system"/"original-pull-secret" not registered
Jul 17 04:49:59.617987 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:59.617947    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 04:49:59.617987 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:59.617961    2564 projected.go:196] Error preparing data for projected volume kube-api-access-pngxm for pod openshift-network-diagnostics/network-check-target-l8nc2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 04:49:59.618215 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:59.618019    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm podName:9514d6c6-a71f-4861-a495-84df181bdbfd nodeName:}" failed. No retries permitted until 2026-07-17 04:50:31.618001573 +0000 UTC m=+66.295607900 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pngxm" (UniqueName: "kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm") pod "network-check-target-l8nc2" (UID: "9514d6c6-a71f-4861-a495-84df181bdbfd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 04:49:59.851844 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:49:59.851812    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:49:59.852025 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:49:59.851915    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tr4jx" podUID="cd3883fe-1e59-474f-aa19-3b3fae77ab85"
Jul 17 04:50:00.851318 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:00.851279    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:50:00.851318 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:00.851303    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:50:00.851890 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:00.851410    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfzzb" podUID="17c170e0-f040-42d6-9047-9afaa449d88e"
Jul 17 04:50:00.851890 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:00.851559    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l8nc2" podUID="9514d6c6-a71f-4861-a495-84df181bdbfd"
Jul 17 04:50:01.674472 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.674441    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-234.ec2.internal" event="NodeReady"
Jul 17 04:50:01.674683 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.674599    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 04:50:01.708051 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.708016    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6ccbf75cf7-m72x7"]
Jul 17 04:50:01.709903 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.709887    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.713121 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.712919    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 17 04:50:01.713249 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.713189    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 17 04:50:01.713309 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.713247    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 17 04:50:01.713415 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.713379    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bbzx9\""
Jul 17 04:50:01.718672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.718648    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 17 04:50:01.722942 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.722919    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p5n24"]
Jul 17 04:50:01.724751 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.724734    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:01.727054 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.727034    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 04:50:01.727166 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.727138    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kswzc\""
Jul 17 04:50:01.727388 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.727374    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 04:50:01.730420 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.730404    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ccbf75cf7-m72x7"]
Jul 17 04:50:01.731250 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.731232    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dl657"]
Jul 17 04:50:01.732823 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.732808    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dl657"
Jul 17 04:50:01.735245 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.735226    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 04:50:01.735781 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.735759    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-swxjd\""
Jul 17 04:50:01.736003 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.735985    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 04:50:01.736182 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.736165    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 04:50:01.737078 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.737058    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p5n24"]
Jul 17 04:50:01.742887 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.742870    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dl657"]
Jul 17 04:50:01.833937 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.833892    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lpds\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-kube-api-access-8lpds\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.833937 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.833948    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m879l\" (UniqueName: \"kubernetes.io/projected/a9591e1b-18f6-4987-9642-e41e6641d6e6-kube-api-access-m879l\") pod \"ingress-canary-dl657\" (UID: \"a9591e1b-18f6-4987-9642-e41e6641d6e6\") " pod="openshift-ingress-canary/ingress-canary-dl657"
Jul 17 04:50:01.834160 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.833980    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9591e1b-18f6-4987-9642-e41e6641d6e6-cert\") pod \"ingress-canary-dl657\" (UID: \"a9591e1b-18f6-4987-9642-e41e6641d6e6\") " pod="openshift-ingress-canary/ingress-canary-dl657"
Jul 17 04:50:01.834160 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.834023    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d993fee-35d5-44ee-a130-69e06e36c348-installation-pull-secrets\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.834160 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.834056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-bound-sa-token\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.834160 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.834080    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d993fee-35d5-44ee-a130-69e06e36c348-image-registry-private-configuration\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.834160 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.834102    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d993fee-35d5-44ee-a130-69e06e36c348-ca-trust-extracted\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.834160 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.834119    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d993fee-35d5-44ee-a130-69e06e36c348-registry-certificates\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.834160 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.834146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d993fee-35d5-44ee-a130-69e06e36c348-trusted-ca\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.834427 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.834172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/702ad1b9-6061-4808-9fe6-721eee836531-config-volume\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:01.834427 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.834190    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.834427 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.834212    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/702ad1b9-6061-4808-9fe6-721eee836531-tmp-dir\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:01.834427 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.834260    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74dk9\" (UniqueName: \"kubernetes.io/projected/702ad1b9-6061-4808-9fe6-721eee836531-kube-api-access-74dk9\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:01.834427 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.834287    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:01.851192 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.851156    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:50:01.853993 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.853973    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 04:50:01.935568 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.935479    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lpds\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-kube-api-access-8lpds\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.935568 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.935534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m879l\" (UniqueName: \"kubernetes.io/projected/a9591e1b-18f6-4987-9642-e41e6641d6e6-kube-api-access-m879l\") pod \"ingress-canary-dl657\" (UID: \"a9591e1b-18f6-4987-9642-e41e6641d6e6\") " pod="openshift-ingress-canary/ingress-canary-dl657"
Jul 17 04:50:01.935861 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.935572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9591e1b-18f6-4987-9642-e41e6641d6e6-cert\") pod \"ingress-canary-dl657\" (UID: \"a9591e1b-18f6-4987-9642-e41e6641d6e6\") " pod="openshift-ingress-canary/ingress-canary-dl657"
Jul 17 04:50:01.935861 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.935604    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d993fee-35d5-44ee-a130-69e06e36c348-installation-pull-secrets\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.935861 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.935648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-bound-sa-token\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.935861 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.935675    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d993fee-35d5-44ee-a130-69e06e36c348-image-registry-private-configuration\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.935861 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.935694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d993fee-35d5-44ee-a130-69e06e36c348-ca-trust-extracted\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.935861 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.935712    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d993fee-35d5-44ee-a130-69e06e36c348-registry-certificates\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.935861 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.935738    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d993fee-35d5-44ee-a130-69e06e36c348-trusted-ca\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.935861 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.935774    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/702ad1b9-6061-4808-9fe6-721eee836531-config-volume\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:01.935861 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.935808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.935861 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.935833    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/702ad1b9-6061-4808-9fe6-721eee836531-tmp-dir\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:01.935861 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.935850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74dk9\" (UniqueName: \"kubernetes.io/projected/702ad1b9-6061-4808-9fe6-721eee836531-kube-api-access-74dk9\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:01.935861 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.935866    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:01.936297 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:01.935997    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 04:50:01.936297 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:01.936042    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls podName:702ad1b9-6061-4808-9fe6-721eee836531 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:02.436028282 +0000 UTC m=+37.113634606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls") pod "dns-default-p5n24" (UID: "702ad1b9-6061-4808-9fe6-721eee836531") : secret "dns-default-metrics-tls" not found
Jul 17 04:50:01.936297 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.936113    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d993fee-35d5-44ee-a130-69e06e36c348-ca-trust-extracted\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.936297 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:01.936284    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 04:50:01.936297 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:01.936297    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccbf75cf7-m72x7: secret "image-registry-tls" not found
Jul 17 04:50:01.936524 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:01.936334    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls podName:0d993fee-35d5-44ee-a130-69e06e36c348 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:02.43631853 +0000 UTC m=+37.113924873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls") pod "image-registry-6ccbf75cf7-m72x7" (UID: "0d993fee-35d5-44ee-a130-69e06e36c348") : secret "image-registry-tls" not found
Jul 17 04:50:01.936524 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.936510    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/702ad1b9-6061-4808-9fe6-721eee836531-config-volume\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:01.936649 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.936584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/702ad1b9-6061-4808-9fe6-721eee836531-tmp-dir\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:01.937004 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.936978    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d993fee-35d5-44ee-a130-69e06e36c348-registry-certificates\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.937439 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.937418    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d993fee-35d5-44ee-a130-69e06e36c348-trusted-ca\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.940859 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.940837    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d993fee-35d5-44ee-a130-69e06e36c348-installation-pull-secrets\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.940988 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.940862    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9591e1b-18f6-4987-9642-e41e6641d6e6-cert\") pod \"ingress-canary-dl657\" (UID: \"a9591e1b-18f6-4987-9642-e41e6641d6e6\") " pod="openshift-ingress-canary/ingress-canary-dl657"
Jul 17 04:50:01.940988 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.940909    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d993fee-35d5-44ee-a130-69e06e36c348-image-registry-private-configuration\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.944743 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.944717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m879l\" (UniqueName: \"kubernetes.io/projected/a9591e1b-18f6-4987-9642-e41e6641d6e6-kube-api-access-m879l\") pod \"ingress-canary-dl657\" (UID: \"a9591e1b-18f6-4987-9642-e41e6641d6e6\") " pod="openshift-ingress-canary/ingress-canary-dl657"
Jul 17 04:50:01.945365 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.945337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lpds\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-kube-api-access-8lpds\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.945573 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.945548    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-bound-sa-token\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:01.947207 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:01.947185    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74dk9\" (UniqueName: \"kubernetes.io/projected/702ad1b9-6061-4808-9fe6-721eee836531-kube-api-access-74dk9\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:02.041904 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:02.041868    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dl657"
Jul 17 04:50:02.199672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:02.199415    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dl657"]
Jul 17 04:50:02.204036 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:50:02.203991    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9591e1b_18f6_4987_9642_e41e6641d6e6.slice/crio-1cbd58d688f00277f0983e8be09843ef4c5528ebd3dcf3d2aaf4aabe355f8e25 WatchSource:0}: Error finding container 1cbd58d688f00277f0983e8be09843ef4c5528ebd3dcf3d2aaf4aabe355f8e25: Status 404 returned error can't find the container with id 1cbd58d688f00277f0983e8be09843ef4c5528ebd3dcf3d2aaf4aabe355f8e25
Jul 17 04:50:02.439882 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:02.439839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:02.440074 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:02.439971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:02.440074 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:02.440018    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 04:50:02.440171 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:02.440088    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 04:50:02.440171 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:02.440102    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccbf75cf7-m72x7: secret "image-registry-tls" not found
Jul 17 04:50:02.440171 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:02.440103    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls podName:702ad1b9-6061-4808-9fe6-721eee836531 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:03.440079372 +0000 UTC m=+38.117685728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls") pod "dns-default-p5n24" (UID: "702ad1b9-6061-4808-9fe6-721eee836531") : secret "dns-default-metrics-tls" not found
Jul 17 04:50:02.440171 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:02.440144    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls podName:0d993fee-35d5-44ee-a130-69e06e36c348 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:03.440128841 +0000 UTC m=+38.117735165 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls") pod "image-registry-6ccbf75cf7-m72x7" (UID: "0d993fee-35d5-44ee-a130-69e06e36c348") : secret "image-registry-tls" not found
Jul 17 04:50:02.851409 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:02.851371    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:50:02.851599 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:02.851371    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:50:02.854747 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:02.854722    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 04:50:02.855733 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:02.855712    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zwbtr\""
Jul 17 04:50:02.855818 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:02.855736    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 04:50:02.855969 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:02.855950    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 04:50:02.855969 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:02.855969    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mhn7j\""
Jul 17 04:50:03.112254 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:03.112177    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dl657" event={"ID":"a9591e1b-18f6-4987-9642-e41e6641d6e6","Type":"ContainerStarted","Data":"1cbd58d688f00277f0983e8be09843ef4c5528ebd3dcf3d2aaf4aabe355f8e25"}
Jul 17 04:50:03.449643 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:03.449547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:03.449643 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:03.449590    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:03.449854 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:03.449730    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 04:50:03.449854 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:03.449740    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 04:50:03.449854 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:03.449763    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccbf75cf7-m72x7: secret "image-registry-tls" not found
Jul 17 04:50:03.449854 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:03.449810    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls podName:702ad1b9-6061-4808-9fe6-721eee836531 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:05.44978862 +0000 UTC m=+40.127394944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls") pod "dns-default-p5n24" (UID: "702ad1b9-6061-4808-9fe6-721eee836531") : secret "dns-default-metrics-tls" not found
Jul 17 04:50:03.449854 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:03.449834    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls podName:0d993fee-35d5-44ee-a130-69e06e36c348 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:05.449826072 +0000 UTC m=+40.127432395 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls") pod "image-registry-6ccbf75cf7-m72x7" (UID: "0d993fee-35d5-44ee-a130-69e06e36c348") : secret "image-registry-tls" not found
Jul 17 04:50:04.119365 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:04.119273    2564 generic.go:356] "Generic (PLEG): container finished" podID="043d9bc2-3514-4d10-b995-a2e6783e6939" containerID="313897d613a355ced2953d5c60887f1cc6acd76b0041fa097d8872ea18603f29" exitCode=0
Jul 17 04:50:04.119365 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:04.119350    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qntz" event={"ID":"043d9bc2-3514-4d10-b995-a2e6783e6939","Type":"ContainerDied","Data":"313897d613a355ced2953d5c60887f1cc6acd76b0041fa097d8872ea18603f29"}
Jul 17 04:50:05.125661 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:05.125605    2564 generic.go:356] "Generic (PLEG): container finished" podID="043d9bc2-3514-4d10-b995-a2e6783e6939" containerID="866a5779841e405be988a01eaedae80f1c1e432ff77f8abe16e0b37bcd25cc67" exitCode=0
Jul 17 04:50:05.126099 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:05.125694    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qntz" event={"ID":"043d9bc2-3514-4d10-b995-a2e6783e6939","Type":"ContainerDied","Data":"866a5779841e405be988a01eaedae80f1c1e432ff77f8abe16e0b37bcd25cc67"}
Jul 17 04:50:05.467234 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:05.467147    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:05.467234 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:05.467193    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:05.467436 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:05.467302    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 04:50:05.467436 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:05.467322    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccbf75cf7-m72x7: secret "image-registry-tls" not found
Jul 17 04:50:05.467436 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:05.467343    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 04:50:05.467436 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:05.467370    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls podName:0d993fee-35d5-44ee-a130-69e06e36c348 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:09.467355491 +0000 UTC m=+44.144961815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls") pod "image-registry-6ccbf75cf7-m72x7" (UID: "0d993fee-35d5-44ee-a130-69e06e36c348") : secret "image-registry-tls" not found
Jul 17 04:50:05.467436 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:05.467393    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls podName:702ad1b9-6061-4808-9fe6-721eee836531 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:09.467377929 +0000 UTC m=+44.144984273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls") pod "dns-default-p5n24" (UID: "702ad1b9-6061-4808-9fe6-721eee836531") : secret "dns-default-metrics-tls" not found
Jul 17 04:50:06.098915 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:06.098740    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:06.132499 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:06.132465    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qntz" event={"ID":"043d9bc2-3514-4d10-b995-a2e6783e6939","Type":"ContainerStarted","Data":"0cd4f4751b437efa1e61926cce15df73caaa4d794e12d4cc5376d2a998246338"}
Jul 17 04:50:06.161288 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:06.161224    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9qntz" podStartSLOduration=9.000260153 podStartE2EDuration="40.161203719s" totalImagesPullingTime="31.160943566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 04:49:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:50:06.159306924 +0000 UTC m=+40.836913266" watchObservedRunningTime="2026-07-17 04:50:06.161203719 +0000 UTC m=+40.838810065"
Jul 17 04:50:06.281732 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:06.281635    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:06.381014 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:06.380984    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:07.136217 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:07.136182    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dl657" event={"ID":"a9591e1b-18f6-4987-9642-e41e6641d6e6","Type":"ContainerStarted","Data":"e96f07f5624099d9357759513518cc33c3a6ef9c0865aa95ac19c1f6a0d593ef"}
Jul 17 04:50:07.152823 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:07.152763    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dl657" podStartSLOduration=2.274072872 podStartE2EDuration="6.152741605s" totalImagesPullingTime="3.878668733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:50:07.152416359 +0000 UTC m=+41.830022705" watchObservedRunningTime="2026-07-17 04:50:07.152741605 +0000 UTC m=+41.830347955"
Jul 17 04:50:09.499839 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:09.499801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:09.499839 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:09.499851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:09.500256 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:09.499955    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 04:50:09.500256 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:09.499972    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccbf75cf7-m72x7: secret "image-registry-tls" not found
Jul 17 04:50:09.500256 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:09.499987    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 04:50:09.500256 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:09.500026    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls podName:0d993fee-35d5-44ee-a130-69e06e36c348 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:17.500011363 +0000 UTC m=+52.177617688 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls") pod "image-registry-6ccbf75cf7-m72x7" (UID: "0d993fee-35d5-44ee-a130-69e06e36c348") : secret "image-registry-tls" not found
Jul 17 04:50:09.500256 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:09.500041    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls podName:702ad1b9-6061-4808-9fe6-721eee836531 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:17.500035132 +0000 UTC m=+52.177641455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls") pod "dns-default-p5n24" (UID: "702ad1b9-6061-4808-9fe6-721eee836531") : secret "dns-default-metrics-tls" not found
Jul 17 04:50:12.492567 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:12.492534    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:12.549377 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:12.549325    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:12.953413 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:12.953371    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:13.022402 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:13.022363    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:13.122987 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:13.122951    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:13.222876 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:13.222775    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:13.280592 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:13.280550    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:13.940287 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:13.940251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:14.041175 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:14.041143    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:14.343002 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:14.342971    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:14.443517 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:14.443480    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:17.564863 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:17.564818    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:17.564863 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:17.564861    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:17.565338 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:17.564964    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 04:50:17.565338 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:17.564980    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 04:50:17.565338 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:17.565002    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccbf75cf7-m72x7: secret "image-registry-tls" not found
Jul 17 04:50:17.565338 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:17.565015    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls podName:702ad1b9-6061-4808-9fe6-721eee836531 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:33.565001508 +0000 UTC m=+68.242607832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls") pod "dns-default-p5n24" (UID: "702ad1b9-6061-4808-9fe6-721eee836531") : secret "dns-default-metrics-tls" not found
Jul 17 04:50:17.565338 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:17.565060    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls podName:0d993fee-35d5-44ee-a130-69e06e36c348 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:33.565041951 +0000 UTC m=+68.242648274 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls") pod "image-registry-6ccbf75cf7-m72x7" (UID: "0d993fee-35d5-44ee-a130-69e06e36c348") : secret "image-registry-tls" not found
Jul 17 04:50:20.025033 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:20.025000    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:20.127379 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:20.127342    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:21.096305 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:21.096247    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:21.148833 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:21.148798    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:23.629851 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:23.629812    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:24.473501 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.473462    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-8dssn"]
Jul 17 04:50:24.476080 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.476058    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8dssn"
Jul 17 04:50:24.478890 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.478866    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wcdvr\""
Jul 17 04:50:24.480674 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.480650    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk"]
Jul 17 04:50:24.482563 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.482306    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk"
Jul 17 04:50:24.486602 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.486577    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 17 04:50:24.486756 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.486606    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 17 04:50:24.486756 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.486646    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 17 04:50:24.486756 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.486722    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 17 04:50:24.487230 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.487208    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4lspg\""
Jul 17 04:50:24.488385 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.488308    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-8dssn"]
Jul 17 04:50:24.498169 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.498144    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk"]
Jul 17 04:50:24.498851 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.498830    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"]
Jul 17 04:50:24.500792 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.500771    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"]
Jul 17 04:50:24.500925 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.500906    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:24.502583 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.502564    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"
Jul 17 04:50:24.507702 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.507674    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 17 04:50:24.507881 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.507854    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jh4ts\""
Jul 17 04:50:24.508004 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.507890    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 17 04:50:24.508004 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.507696    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 04:50:24.508004 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.507985    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-phtx5\""
Jul 17 04:50:24.508162 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.507770    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 04:50:24.508162 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.507845    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 17 04:50:24.508162 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.507696    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 17 04:50:24.508926 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.508904    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 17 04:50:24.513241 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.513215    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/217df4f8-8a0e-4805-8af7-6e122bfd7497-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-4xxjk\" (UID: \"217df4f8-8a0e-4805-8af7-6e122bfd7497\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk"
Jul 17 04:50:24.513394 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.513245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aceeef42-5510-49c6-a843-be129763ac26-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-9tn2p\" (UID: \"aceeef42-5510-49c6-a843-be129763ac26\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:24.513394 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.513287    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8989z\" (UniqueName: \"kubernetes.io/projected/91c02549-ae8f-473f-a1ea-523e1b503878-kube-api-access-8989z\") pod \"cluster-samples-operator-79b7c55f87-qp2cl\" (UID: \"91c02549-ae8f-473f-a1ea-523e1b503878\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"
Jul 17 04:50:24.513394 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.513320    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/217df4f8-8a0e-4805-8af7-6e122bfd7497-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-4xxjk\" (UID: \"217df4f8-8a0e-4805-8af7-6e122bfd7497\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk"
Jul 17 04:50:24.513394 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.513363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqxx9\" (UniqueName: \"kubernetes.io/projected/e62a827f-4187-4896-a666-36ac4234d400-kube-api-access-pqxx9\") pod \"network-check-source-7bc5b6bf85-8dssn\" (UID: \"e62a827f-4187-4896-a666-36ac4234d400\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8dssn"
Jul 17 04:50:24.513590 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.513394    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tn2p\" (UID: \"aceeef42-5510-49c6-a843-be129763ac26\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:24.513590 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.513466    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qp2cl\" (UID: \"91c02549-ae8f-473f-a1ea-523e1b503878\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"
Jul 17 04:50:24.513590 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.513567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npjwc\" (UniqueName: \"kubernetes.io/projected/217df4f8-8a0e-4805-8af7-6e122bfd7497-kube-api-access-npjwc\") pod \"kube-storage-version-migrator-operator-7658d9b749-4xxjk\" (UID: \"217df4f8-8a0e-4805-8af7-6e122bfd7497\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk"
Jul 17 04:50:24.513760 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.513594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ds2g\" (UniqueName: \"kubernetes.io/projected/aceeef42-5510-49c6-a843-be129763ac26-kube-api-access-6ds2g\") pod \"cluster-monitoring-operator-76cf8966f8-9tn2p\" (UID: \"aceeef42-5510-49c6-a843-be129763ac26\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:24.513836 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.513541    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"]
Jul 17 04:50:24.514344 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.514323    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"]
Jul 17 04:50:24.611776 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.611729    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-665g2"]
Jul 17 04:50:24.613904 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.613881    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.614080 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.613949    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/217df4f8-8a0e-4805-8af7-6e122bfd7497-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-4xxjk\" (UID: \"217df4f8-8a0e-4805-8af7-6e122bfd7497\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk"
Jul 17 04:50:24.614080 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.613986    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aceeef42-5510-49c6-a843-be129763ac26-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-9tn2p\" (UID: \"aceeef42-5510-49c6-a843-be129763ac26\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:24.614080 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.614013    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8989z\" (UniqueName: \"kubernetes.io/projected/91c02549-ae8f-473f-a1ea-523e1b503878-kube-api-access-8989z\") pod \"cluster-samples-operator-79b7c55f87-qp2cl\" (UID: \"91c02549-ae8f-473f-a1ea-523e1b503878\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"
Jul 17 04:50:24.614080 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.614030    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/217df4f8-8a0e-4805-8af7-6e122bfd7497-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-4xxjk\" (UID: \"217df4f8-8a0e-4805-8af7-6e122bfd7497\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk"
Jul 17 04:50:24.614080 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.614079    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqxx9\" (UniqueName: \"kubernetes.io/projected/e62a827f-4187-4896-a666-36ac4234d400-kube-api-access-pqxx9\") pod \"network-check-source-7bc5b6bf85-8dssn\" (UID: \"e62a827f-4187-4896-a666-36ac4234d400\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8dssn"
Jul 17 04:50:24.614325 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.614108    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tn2p\" (UID: \"aceeef42-5510-49c6-a843-be129763ac26\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:24.614325 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.614150    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qp2cl\" (UID: \"91c02549-ae8f-473f-a1ea-523e1b503878\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"
Jul 17 04:50:24.614325 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:24.614241    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 04:50:24.614325 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:24.614308    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls podName:91c02549-ae8f-473f-a1ea-523e1b503878 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:25.114291049 +0000 UTC m=+59.791897373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-qp2cl" (UID: "91c02549-ae8f-473f-a1ea-523e1b503878") : secret "samples-operator-tls" not found
Jul 17 04:50:24.614538 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.614459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npjwc\" (UniqueName: \"kubernetes.io/projected/217df4f8-8a0e-4805-8af7-6e122bfd7497-kube-api-access-npjwc\") pod \"kube-storage-version-migrator-operator-7658d9b749-4xxjk\" (UID: \"217df4f8-8a0e-4805-8af7-6e122bfd7497\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk"
Jul 17 04:50:24.614538 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.614496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ds2g\" (UniqueName: \"kubernetes.io/projected/aceeef42-5510-49c6-a843-be129763ac26-kube-api-access-6ds2g\") pod \"cluster-monitoring-operator-76cf8966f8-9tn2p\" (UID: \"aceeef42-5510-49c6-a843-be129763ac26\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:24.614538 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:24.614506    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 04:50:24.614717 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:24.614575    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls podName:aceeef42-5510-49c6-a843-be129763ac26 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:25.114556123 +0000 UTC m=+59.792162446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-9tn2p" (UID: "aceeef42-5510-49c6-a843-be129763ac26") : secret "cluster-monitoring-operator-tls" not found
Jul 17 04:50:24.614879 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.614856    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/217df4f8-8a0e-4805-8af7-6e122bfd7497-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-4xxjk\" (UID: \"217df4f8-8a0e-4805-8af7-6e122bfd7497\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk"
Jul 17 04:50:24.615078 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.615061    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aceeef42-5510-49c6-a843-be129763ac26-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-9tn2p\" (UID: \"aceeef42-5510-49c6-a843-be129763ac26\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:24.618836 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.618813    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/217df4f8-8a0e-4805-8af7-6e122bfd7497-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-4xxjk\" (UID: \"217df4f8-8a0e-4805-8af7-6e122bfd7497\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk"
Jul 17 04:50:24.623337 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.623311    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 04:50:24.623514 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.623416    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 04:50:24.623582 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.623498    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4mzml\""
Jul 17 04:50:24.624874 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.624849    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 17 04:50:24.624987 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.624973    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 17 04:50:24.627429 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.627391    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-6g55g"]
Jul 17 04:50:24.629341 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.629318    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 17 04:50:24.629501 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.629486    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:24.630330 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.630312    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-679d5646-wtsmz"]
Jul 17 04:50:24.632208 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.632189    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:24.633255 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.633231    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 17 04:50:24.633358 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.633245    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 17 04:50:24.633608 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.633591    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 17 04:50:24.633936 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.633797    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 17 04:50:24.634468 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.634444    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-sxv9c\""
Jul 17 04:50:24.634960 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.634928    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-8hmbn"]
Jul 17 04:50:24.635675 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.635654    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 17 04:50:24.635777 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.635718    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 17 04:50:24.635918 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.635868    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 04:50:24.636040 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.635972    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 04:50:24.636188 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.636168    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 17 04:50:24.636270 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.636251    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ckw86\""
Jul 17 04:50:24.636336 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.636286    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 17 04:50:24.637563 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.637523    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-665g2"]
Jul 17 04:50:24.637695 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.637653    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-8hmbn"
Jul 17 04:50:24.639274 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.638940    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npjwc\" (UniqueName: \"kubernetes.io/projected/217df4f8-8a0e-4805-8af7-6e122bfd7497-kube-api-access-npjwc\") pod \"kube-storage-version-migrator-operator-7658d9b749-4xxjk\" (UID: \"217df4f8-8a0e-4805-8af7-6e122bfd7497\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk"
Jul 17 04:50:24.639274 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.639074    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ds2g\" (UniqueName: \"kubernetes.io/projected/aceeef42-5510-49c6-a843-be129763ac26-kube-api-access-6ds2g\") pod \"cluster-monitoring-operator-76cf8966f8-9tn2p\" (UID: \"aceeef42-5510-49c6-a843-be129763ac26\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:24.640649 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.640609    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vmvtg\""
Jul 17 04:50:24.640910 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.640889    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 17 04:50:24.641209 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.641194    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 17 04:50:24.641532 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.641512    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 17 04:50:24.646126 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.646088    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-6g55g"]
Jul 17 04:50:24.648732 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.648550    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqxx9\" (UniqueName: \"kubernetes.io/projected/e62a827f-4187-4896-a666-36ac4234d400-kube-api-access-pqxx9\") pod \"network-check-source-7bc5b6bf85-8dssn\" (UID: \"e62a827f-4187-4896-a666-36ac4234d400\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8dssn"
Jul 17 04:50:24.650348 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.650318    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8989z\" (UniqueName: \"kubernetes.io/projected/91c02549-ae8f-473f-a1ea-523e1b503878-kube-api-access-8989z\") pod \"cluster-samples-operator-79b7c55f87-qp2cl\" (UID: \"91c02549-ae8f-473f-a1ea-523e1b503878\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"
Jul 17 04:50:24.654077 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.653958    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-8hmbn"]
Jul 17 04:50:24.655989 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.655956    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-679d5646-wtsmz"]
Jul 17 04:50:24.681340 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.681299    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt"]
Jul 17 04:50:24.683428 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.683409    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"]
Jul 17 04:50:24.683543 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.683526    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt"
Jul 17 04:50:24.685079 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.685059    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"
Jul 17 04:50:24.686411 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.686383    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 17 04:50:24.686545 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.686458    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 17 04:50:24.686545 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.686477    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 17 04:50:24.686545 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.686537    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-88xpg\""
Jul 17 04:50:24.686764 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.686479    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 17 04:50:24.687212 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.687198    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 17 04:50:24.687295 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.687264    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nzwzs\""
Jul 17 04:50:24.687420 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.687409    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 17 04:50:24.692802 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.692779    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"]
Jul 17 04:50:24.696077 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.696048    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt"]
Jul 17 04:50:24.714903 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.714861    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-stats-auth\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:24.715079 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.714931    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8ccedfa-df6a-411e-94a2-08dfea8e7bf8-serving-cert\") pod \"service-ca-operator-5bcbc94c78-svwgt\" (UID: \"c8ccedfa-df6a-411e-94a2-08dfea8e7bf8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt"
Jul 17 04:50:24.715079 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.714978    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbp9x\" (UniqueName: \"kubernetes.io/projected/c8ccedfa-df6a-411e-94a2-08dfea8e7bf8-kube-api-access-hbp9x\") pod \"service-ca-operator-5bcbc94c78-svwgt\" (UID: \"c8ccedfa-df6a-411e-94a2-08dfea8e7bf8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt"
Jul 17 04:50:24.715079 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715006    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/529078b2-2d39-4be8-a551-d6497714270f-trusted-ca\") pod \"console-operator-565b7b569d-6g55g\" (UID: \"529078b2-2d39-4be8-a551-d6497714270f\") " pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:24.715079 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323c73c7-3605-42f0-9ff2-57de004ce286-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.715079 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715071    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:24.715242 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715111    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323c73c7-3605-42f0-9ff2-57de004ce286-service-ca-bundle\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.715242 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715157    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/323c73c7-3605-42f0-9ff2-57de004ce286-serving-cert\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.715242 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715181    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f79tp\" (UniqueName: \"kubernetes.io/projected/ea2b2703-55cb-4be9-84eb-262ca6513eb7-kube-api-access-f79tp\") pod \"volume-data-source-validator-78cf4c6f6-8hmbn\" (UID: \"ea2b2703-55cb-4be9-84eb-262ca6513eb7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-8hmbn"
Jul 17 04:50:24.715242 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715209    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/529078b2-2d39-4be8-a551-d6497714270f-serving-cert\") pod \"console-operator-565b7b569d-6g55g\" (UID: \"529078b2-2d39-4be8-a551-d6497714270f\") " pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:24.715242 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715239    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8ccedfa-df6a-411e-94a2-08dfea8e7bf8-config\") pod \"service-ca-operator-5bcbc94c78-svwgt\" (UID: \"c8ccedfa-df6a-411e-94a2-08dfea8e7bf8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt"
Jul 17 04:50:24.715388 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715257    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/323c73c7-3605-42f0-9ff2-57de004ce286-snapshots\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.715388 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715281    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dqwqx\" (UID: \"1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"
Jul 17 04:50:24.715388 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715298    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzvlt\" (UniqueName: \"kubernetes.io/projected/323c73c7-3605-42f0-9ff2-57de004ce286-kube-api-access-wzvlt\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.715388 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715315    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dqwqx\" (UID: \"1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"
Jul 17 04:50:24.715388 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715332    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz86l\" (UniqueName: \"kubernetes.io/projected/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-kube-api-access-sz86l\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:24.715388 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715347    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/323c73c7-3605-42f0-9ff2-57de004ce286-tmp\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.715388 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/529078b2-2d39-4be8-a551-d6497714270f-config\") pod \"console-operator-565b7b569d-6g55g\" (UID: \"529078b2-2d39-4be8-a551-d6497714270f\") " pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:24.715388 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715383    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsbmr\" (UniqueName: \"kubernetes.io/projected/529078b2-2d39-4be8-a551-d6497714270f-kube-api-access-zsbmr\") pod \"console-operator-565b7b569d-6g55g\" (UID: \"529078b2-2d39-4be8-a551-d6497714270f\") " pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:24.715683 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-default-certificate\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:24.715683 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.715461    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:24.785452 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.785361    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8dssn"
Jul 17 04:50:24.792567 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.792530    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk"
Jul 17 04:50:24.809285 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.809213    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:24.816005 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.815975    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dqwqx\" (UID: \"1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"
Jul 17 04:50:24.816005 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816006    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzvlt\" (UniqueName: \"kubernetes.io/projected/323c73c7-3605-42f0-9ff2-57de004ce286-kube-api-access-wzvlt\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.816213 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816037    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dqwqx\" (UID: \"1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"
Jul 17 04:50:24.816213 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816059    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz86l\" (UniqueName: \"kubernetes.io/projected/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-kube-api-access-sz86l\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:24.816213 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/323c73c7-3605-42f0-9ff2-57de004ce286-tmp\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.816213 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816095    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/529078b2-2d39-4be8-a551-d6497714270f-config\") pod \"console-operator-565b7b569d-6g55g\" (UID: \"529078b2-2d39-4be8-a551-d6497714270f\") " pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:24.816213 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816118    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsbmr\" (UniqueName: \"kubernetes.io/projected/529078b2-2d39-4be8-a551-d6497714270f-kube-api-access-zsbmr\") pod \"console-operator-565b7b569d-6g55g\" (UID: \"529078b2-2d39-4be8-a551-d6497714270f\") " pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:24.816213 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816135    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-default-certificate\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:24.816213 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816150    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:24.816213 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816165    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-stats-auth\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:24.816496 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8ccedfa-df6a-411e-94a2-08dfea8e7bf8-serving-cert\") pod \"service-ca-operator-5bcbc94c78-svwgt\" (UID: \"c8ccedfa-df6a-411e-94a2-08dfea8e7bf8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt"
Jul 17 04:50:24.816496 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbp9x\" (UniqueName: \"kubernetes.io/projected/c8ccedfa-df6a-411e-94a2-08dfea8e7bf8-kube-api-access-hbp9x\") pod \"service-ca-operator-5bcbc94c78-svwgt\" (UID: \"c8ccedfa-df6a-411e-94a2-08dfea8e7bf8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt"
Jul 17 04:50:24.816496 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816258    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/529078b2-2d39-4be8-a551-d6497714270f-trusted-ca\") pod \"console-operator-565b7b569d-6g55g\" (UID: \"529078b2-2d39-4be8-a551-d6497714270f\") " pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:24.816496 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816295    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323c73c7-3605-42f0-9ff2-57de004ce286-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.816496 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:24.816496 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323c73c7-3605-42f0-9ff2-57de004ce286-service-ca-bundle\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.816496 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/323c73c7-3605-42f0-9ff2-57de004ce286-serving-cert\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.816496 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f79tp\" (UniqueName: \"kubernetes.io/projected/ea2b2703-55cb-4be9-84eb-262ca6513eb7-kube-api-access-f79tp\") pod \"volume-data-source-validator-78cf4c6f6-8hmbn\" (UID: \"ea2b2703-55cb-4be9-84eb-262ca6513eb7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-8hmbn"
Jul 17 04:50:24.816496 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816413    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/529078b2-2d39-4be8-a551-d6497714270f-serving-cert\") pod \"console-operator-565b7b569d-6g55g\" (UID: \"529078b2-2d39-4be8-a551-d6497714270f\") " pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:24.816496 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8ccedfa-df6a-411e-94a2-08dfea8e7bf8-config\") pod \"service-ca-operator-5bcbc94c78-svwgt\" (UID: \"c8ccedfa-df6a-411e-94a2-08dfea8e7bf8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt"
Jul 17 04:50:24.816496 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/323c73c7-3605-42f0-9ff2-57de004ce286-snapshots\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.817012 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.816983    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/529078b2-2d39-4be8-a551-d6497714270f-config\") pod \"console-operator-565b7b569d-6g55g\" (UID: \"529078b2-2d39-4be8-a551-d6497714270f\") " pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:24.817012 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.817009    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/323c73c7-3605-42f0-9ff2-57de004ce286-snapshots\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.817730 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:24.816164    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 04:50:24.817730 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.817234    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/323c73c7-3605-42f0-9ff2-57de004ce286-tmp\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.817730 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:24.817287    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert podName:1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:25.31726407 +0000 UTC m=+59.994870397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dqwqx" (UID: "1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22") : secret "networking-console-plugin-cert" not found
Jul 17 04:50:24.817730 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:24.817312    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 04:50:24.817730 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:24.817372    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs podName:4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:25.317356295 +0000 UTC m=+59.994962619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs") pod "router-default-679d5646-wtsmz" (UID: "4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642") : secret "router-metrics-certs-default" not found
Jul 17 04:50:24.817730 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.817470    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dqwqx\" (UID: \"1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"
Jul 17 04:50:24.817730 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:24.817604    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle podName:4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:25.317588022 +0000 UTC m=+59.995194365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle") pod "router-default-679d5646-wtsmz" (UID: "4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642") : configmap references non-existent config key: service-ca.crt
Jul 17 04:50:24.818159 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.818116    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323c73c7-3605-42f0-9ff2-57de004ce286-service-ca-bundle\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.818390 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.818361    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/529078b2-2d39-4be8-a551-d6497714270f-trusted-ca\") pod \"console-operator-565b7b569d-6g55g\" (UID: \"529078b2-2d39-4be8-a551-d6497714270f\") " pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:24.818729 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.818704    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8ccedfa-df6a-411e-94a2-08dfea8e7bf8-config\") pod \"service-ca-operator-5bcbc94c78-svwgt\" (UID: \"c8ccedfa-df6a-411e-94a2-08dfea8e7bf8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt"
Jul 17 04:50:24.818943 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.818924    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/323c73c7-3605-42f0-9ff2-57de004ce286-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.820613 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.820549    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-default-certificate\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:24.820808 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.820704    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-stats-auth\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:24.821406 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.821383    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/323c73c7-3605-42f0-9ff2-57de004ce286-serving-cert\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.821491 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.821472    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8ccedfa-df6a-411e-94a2-08dfea8e7bf8-serving-cert\") pod \"service-ca-operator-5bcbc94c78-svwgt\" (UID: \"c8ccedfa-df6a-411e-94a2-08dfea8e7bf8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt"
Jul 17 04:50:24.821548 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.821540    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/529078b2-2d39-4be8-a551-d6497714270f-serving-cert\") pod \"console-operator-565b7b569d-6g55g\" (UID: \"529078b2-2d39-4be8-a551-d6497714270f\") " pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:24.831266 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.831194    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzvlt\" (UniqueName: \"kubernetes.io/projected/323c73c7-3605-42f0-9ff2-57de004ce286-kube-api-access-wzvlt\") pod \"insights-operator-555d9d7885-665g2\" (UID: \"323c73c7-3605-42f0-9ff2-57de004ce286\") " pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.831455 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.831335    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbp9x\" (UniqueName: \"kubernetes.io/projected/c8ccedfa-df6a-411e-94a2-08dfea8e7bf8-kube-api-access-hbp9x\") pod \"service-ca-operator-5bcbc94c78-svwgt\" (UID: \"c8ccedfa-df6a-411e-94a2-08dfea8e7bf8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt"
Jul 17 04:50:24.832107 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.832079    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsbmr\" (UniqueName: \"kubernetes.io/projected/529078b2-2d39-4be8-a551-d6497714270f-kube-api-access-zsbmr\") pod \"console-operator-565b7b569d-6g55g\" (UID: \"529078b2-2d39-4be8-a551-d6497714270f\") " pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:24.832425 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.832400    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz86l\" (UniqueName: \"kubernetes.io/projected/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-kube-api-access-sz86l\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:24.832866 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.832848    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f79tp\" (UniqueName: \"kubernetes.io/projected/ea2b2703-55cb-4be9-84eb-262ca6513eb7-kube-api-access-f79tp\") pod \"volume-data-source-validator-78cf4c6f6-8hmbn\" (UID: \"ea2b2703-55cb-4be9-84eb-262ca6513eb7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-8hmbn"
Jul 17 04:50:24.911174 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.910773    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:24.928275 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.928237    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-665g2"
Jul 17 04:50:24.946712 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.946684    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-8dssn"]
Jul 17 04:50:24.949026 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.949000    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:24.949303 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:50:24.949280    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode62a827f_4187_4896_a666_36ac4234d400.slice/crio-979e613fb45017c9fe1f506d8b44100e21d33c18099800da322c783d51eb889d WatchSource:0}: Error finding container 979e613fb45017c9fe1f506d8b44100e21d33c18099800da322c783d51eb889d: Status 404 returned error can't find the container with id 979e613fb45017c9fe1f506d8b44100e21d33c18099800da322c783d51eb889d
Jul 17 04:50:24.966085 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.966017    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk"]
Jul 17 04:50:24.968013 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.967987    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-8hmbn"
Jul 17 04:50:24.969407 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:50:24.969379    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod217df4f8_8a0e_4805_8af7_6e122bfd7497.slice/crio-58669e456b98ba88439f799b3ed9629ffd122935d1af34fc9b11e66e3e5dba3b WatchSource:0}: Error finding container 58669e456b98ba88439f799b3ed9629ffd122935d1af34fc9b11e66e3e5dba3b: Status 404 returned error can't find the container with id 58669e456b98ba88439f799b3ed9629ffd122935d1af34fc9b11e66e3e5dba3b
Jul 17 04:50:24.994756 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:24.994717    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt"
Jul 17 04:50:25.092080 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:25.090324    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-665g2"]
Jul 17 04:50:25.097283 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:50:25.093246    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323c73c7_3605_42f0_9ff2_57de004ce286.slice/crio-6593dfcba1d5d52e696998e310e75adc5a5f663fc8b7d49e10b950dc8fbb5421 WatchSource:0}: Error finding container 6593dfcba1d5d52e696998e310e75adc5a5f663fc8b7d49e10b950dc8fbb5421: Status 404 returned error can't find the container with id 6593dfcba1d5d52e696998e310e75adc5a5f663fc8b7d49e10b950dc8fbb5421
Jul 17 04:50:25.119863 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:25.119483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tn2p\" (UID: \"aceeef42-5510-49c6-a843-be129763ac26\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:25.119863 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:25.119548    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qp2cl\" (UID: \"91c02549-ae8f-473f-a1ea-523e1b503878\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"
Jul 17 04:50:25.119863 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:25.119727    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 04:50:25.119863 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:25.119787    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 04:50:25.119863 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:25.119798    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls podName:aceeef42-5510-49c6-a843-be129763ac26 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:26.119777644 +0000 UTC m=+60.797384019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-9tn2p" (UID: "aceeef42-5510-49c6-a843-be129763ac26") : secret "cluster-monitoring-operator-tls" not found
Jul 17 04:50:25.119863 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:25.119840    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls podName:91c02549-ae8f-473f-a1ea-523e1b503878 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:26.119825259 +0000 UTC m=+60.797431588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-qp2cl" (UID: "91c02549-ae8f-473f-a1ea-523e1b503878") : secret "samples-operator-tls" not found
Jul 17 04:50:25.121535 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:25.121511    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-6g55g"]
Jul 17 04:50:25.124804 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:50:25.124744    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529078b2_2d39_4be8_a551_d6497714270f.slice/crio-0a907caf3c14750ea53e647b67de6c170f749dca93565cee180acddf986c967d WatchSource:0}: Error finding container 0a907caf3c14750ea53e647b67de6c170f749dca93565cee180acddf986c967d: Status 404 returned error can't find the container with id 0a907caf3c14750ea53e647b67de6c170f749dca93565cee180acddf986c967d
Jul 17 04:50:25.141574 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:25.141536    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-8hmbn"]
Jul 17 04:50:25.144668 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:50:25.144608    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea2b2703_55cb_4be9_84eb_262ca6513eb7.slice/crio-758318cb4a6af246c283fd69bb6e30670770d73b46cbc6833ab2d752c44f228b WatchSource:0}: Error finding container 758318cb4a6af246c283fd69bb6e30670770d73b46cbc6833ab2d752c44f228b: Status 404 returned error can't find the container with id 758318cb4a6af246c283fd69bb6e30670770d73b46cbc6833ab2d752c44f228b
Jul 17 04:50:25.161824 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:25.161778    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt"]
Jul 17 04:50:25.166196 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:50:25.166166    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ccedfa_df6a_411e_94a2_08dfea8e7bf8.slice/crio-783646728aaacfba34b6f6bf97569896398a9f25baec1a18c5cfd52d4b82b8f8 WatchSource:0}: Error finding container 783646728aaacfba34b6f6bf97569896398a9f25baec1a18c5cfd52d4b82b8f8: Status 404 returned error can't find the container with id 783646728aaacfba34b6f6bf97569896398a9f25baec1a18c5cfd52d4b82b8f8
Jul 17 04:50:25.181466 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:25.181434    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-8hmbn" event={"ID":"ea2b2703-55cb-4be9-84eb-262ca6513eb7","Type":"ContainerStarted","Data":"758318cb4a6af246c283fd69bb6e30670770d73b46cbc6833ab2d752c44f228b"}
Jul 17 04:50:25.182572 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:25.182546    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt" event={"ID":"c8ccedfa-df6a-411e-94a2-08dfea8e7bf8","Type":"ContainerStarted","Data":"783646728aaacfba34b6f6bf97569896398a9f25baec1a18c5cfd52d4b82b8f8"}
Jul 17 04:50:25.183614 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:25.183592    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk" event={"ID":"217df4f8-8a0e-4805-8af7-6e122bfd7497","Type":"ContainerStarted","Data":"58669e456b98ba88439f799b3ed9629ffd122935d1af34fc9b11e66e3e5dba3b"}
Jul 17 04:50:25.184663 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:25.184619    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8dssn" event={"ID":"e62a827f-4187-4896-a666-36ac4234d400","Type":"ContainerStarted","Data":"979e613fb45017c9fe1f506d8b44100e21d33c18099800da322c783d51eb889d"}
Jul 17 04:50:25.185712 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:25.185692    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-665g2" event={"ID":"323c73c7-3605-42f0-9ff2-57de004ce286","Type":"ContainerStarted","Data":"6593dfcba1d5d52e696998e310e75adc5a5f663fc8b7d49e10b950dc8fbb5421"}
Jul 17 04:50:25.186604 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:25.186584    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6g55g" event={"ID":"529078b2-2d39-4be8-a551-d6497714270f","Type":"ContainerStarted","Data":"0a907caf3c14750ea53e647b67de6c170f749dca93565cee180acddf986c967d"}
Jul 17 04:50:25.320971 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:25.320938    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dqwqx\" (UID: \"1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"
Jul 17 04:50:25.321144 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:25.320985    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:25.321144 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:25.321068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:25.321144 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:25.321087    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 04:50:25.321144 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:25.321137    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 04:50:25.321269 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:25.321165    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert podName:1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:26.321143166 +0000 UTC m=+60.998749512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dqwqx" (UID: "1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22") : secret "networking-console-plugin-cert" not found
Jul 17 04:50:25.321269 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:25.321183    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle podName:4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:26.321172261 +0000 UTC m=+60.998778588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle") pod "router-default-679d5646-wtsmz" (UID: "4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642") : configmap references non-existent config key: service-ca.crt
Jul 17 04:50:25.321269 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:25.321198    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs podName:4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:26.32119084 +0000 UTC m=+60.998797164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs") pod "router-default-679d5646-wtsmz" (UID: "4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642") : secret "router-metrics-certs-default" not found
Jul 17 04:50:26.128912 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:26.128871    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tn2p\" (UID: \"aceeef42-5510-49c6-a843-be129763ac26\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:26.129385 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:26.128940    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qp2cl\" (UID: \"91c02549-ae8f-473f-a1ea-523e1b503878\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"
Jul 17 04:50:26.129385 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:26.129276    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 04:50:26.129385 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:26.129339    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls podName:91c02549-ae8f-473f-a1ea-523e1b503878 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:28.12932001 +0000 UTC m=+62.806926346 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-qp2cl" (UID: "91c02549-ae8f-473f-a1ea-523e1b503878") : secret "samples-operator-tls" not found
Jul 17 04:50:26.129555 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:26.129402    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 04:50:26.129555 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:26.129433    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls podName:aceeef42-5510-49c6-a843-be129763ac26 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:28.129422364 +0000 UTC m=+62.807028694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-9tn2p" (UID: "aceeef42-5510-49c6-a843-be129763ac26") : secret "cluster-monitoring-operator-tls" not found
Jul 17 04:50:26.331110 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:26.331068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:26.331280 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:26.331193    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:26.331351 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:26.331278    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dqwqx\" (UID: \"1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"
Jul 17 04:50:26.331442 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:26.331425    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 04:50:26.331507 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:26.331496    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert podName:1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:28.331476429 +0000 UTC m=+63.009082769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dqwqx" (UID: "1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22") : secret "networking-console-plugin-cert" not found
Jul 17 04:50:26.332065 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:26.332016    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 04:50:26.332183 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:26.332095    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs podName:4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:28.332077765 +0000 UTC m=+63.009684108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs") pod "router-default-679d5646-wtsmz" (UID: "4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642") : secret "router-metrics-certs-default" not found
Jul 17 04:50:26.332183 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:26.332169    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle podName:4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:28.332155058 +0000 UTC m=+63.009761384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle") pod "router-default-679d5646-wtsmz" (UID: "4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642") : configmap references non-existent config key: service-ca.crt
Jul 17 04:50:28.109431 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:28.109399    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vhvmc"
Jul 17 04:50:28.150428 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:28.150383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tn2p\" (UID: \"aceeef42-5510-49c6-a843-be129763ac26\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:28.150617 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:28.150447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qp2cl\" (UID: \"91c02549-ae8f-473f-a1ea-523e1b503878\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"
Jul 17 04:50:28.150617 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:28.150568    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 04:50:28.150776 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:28.150666    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls podName:91c02549-ae8f-473f-a1ea-523e1b503878 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:32.150643009 +0000 UTC m=+66.828249347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-qp2cl" (UID: "91c02549-ae8f-473f-a1ea-523e1b503878") : secret "samples-operator-tls" not found
Jul 17 04:50:28.150840 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:28.150575    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 04:50:28.150885 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:28.150855    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls podName:aceeef42-5510-49c6-a843-be129763ac26 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:32.150838597 +0000 UTC m=+66.828444922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-9tn2p" (UID: "aceeef42-5510-49c6-a843-be129763ac26") : secret "cluster-monitoring-operator-tls" not found
Jul 17 04:50:28.352133 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:28.352092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dqwqx\" (UID: \"1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"
Jul 17 04:50:28.352361 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:28.352146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:28.352361 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:28.352263    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 04:50:28.352361 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:28.352271    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 04:50:28.352361 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:28.352341    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert podName:1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:32.352321093 +0000 UTC m=+67.029927419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dqwqx" (UID: "1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22") : secret "networking-console-plugin-cert" not found
Jul 17 04:50:28.352536 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:28.352366    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs podName:4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:32.35235542 +0000 UTC m=+67.029961747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs") pod "router-default-679d5646-wtsmz" (UID: "4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642") : secret "router-metrics-certs-default" not found
Jul 17 04:50:28.352536 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:28.352433    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:28.352536 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:28.352520    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle podName:4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:32.352505843 +0000 UTC m=+67.030112170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle") pod "router-default-679d5646-wtsmz" (UID: "4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642") : configmap references non-existent config key: service-ca.crt
Jul 17 04:50:28.360334 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:28.360224    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:28.460971 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:28.460869    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:31.206880 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.206844    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-665g2" event={"ID":"323c73c7-3605-42f0-9ff2-57de004ce286","Type":"ContainerStarted","Data":"bc68a09e79f09e35b34c4a4b67772badf0549b5e6cce6f6d9262c13038ef9fd2"}
Jul 17 04:50:31.209055 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.209029    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/0.log"
Jul 17 04:50:31.209287 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.209266    2564 generic.go:356] "Generic (PLEG): container finished" podID="529078b2-2d39-4be8-a551-d6497714270f" containerID="b9b81e4dc84cbfc3847f1f018ecf7f33b8d605ebf8608011bad4346ae0fb16d2" exitCode=255
Jul 17 04:50:31.209495 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.209474    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6g55g" event={"ID":"529078b2-2d39-4be8-a551-d6497714270f","Type":"ContainerDied","Data":"b9b81e4dc84cbfc3847f1f018ecf7f33b8d605ebf8608011bad4346ae0fb16d2"}
Jul 17 04:50:31.209676 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.209653    2564 scope.go:117] "RemoveContainer" containerID="b9b81e4dc84cbfc3847f1f018ecf7f33b8d605ebf8608011bad4346ae0fb16d2"
Jul 17 04:50:31.216448 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.216371    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-8hmbn" event={"ID":"ea2b2703-55cb-4be9-84eb-262ca6513eb7","Type":"ContainerStarted","Data":"bca6dc193e2c29681d509dcfba0c464618b1f74661b88327b3d0805480bbf0e2"}
Jul 17 04:50:31.225036 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.224975    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-665g2" podStartSLOduration=2.025188358 podStartE2EDuration="7.224952421s" totalImagesPullingTime="5.199764063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:50:31.224107985 +0000 UTC m=+65.901714332" watchObservedRunningTime="2026-07-17 04:50:31.224952421 +0000 UTC m=+65.902558764"
Jul 17 04:50:31.226393 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.226360    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt" event={"ID":"c8ccedfa-df6a-411e-94a2-08dfea8e7bf8","Type":"ContainerStarted","Data":"58c0caf446129daa9682bb98cbbe5fe62e1a3cdbe9a7a9a0f955a340dc48a9b3"}
Jul 17 04:50:31.234893 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.234857    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk" event={"ID":"217df4f8-8a0e-4805-8af7-6e122bfd7497","Type":"ContainerStarted","Data":"2f554bc2d3df3d24209429f718b6c27789a6165dbfa723755f3c14efa63e53e4"}
Jul 17 04:50:31.239614 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.238858    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8dssn" event={"ID":"e62a827f-4187-4896-a666-36ac4234d400","Type":"ContainerStarted","Data":"9fbd5902763ac6f57bbef8db28e78ade4f19900f08a7c1cedea4d9bc289e4ef0"}
Jul 17 04:50:31.267769 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.267357    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-8hmbn" podStartSLOduration=2.123831629 podStartE2EDuration="7.267334684s" totalImagesPullingTime="5.143503055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:50:31.26621612 +0000 UTC m=+65.943822467" watchObservedRunningTime="2026-07-17 04:50:31.267334684 +0000 UTC m=+65.944941031"
Jul 17 04:50:31.287406 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.287338    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt" podStartSLOduration=2.156938382 podStartE2EDuration="7.287320291s" totalImagesPullingTime="5.130381909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:50:31.286106152 +0000 UTC m=+65.963712499" watchObservedRunningTime="2026-07-17 04:50:31.287320291 +0000 UTC m=+65.964926636"
Jul 17 04:50:31.305672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.305563    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8dssn" podStartSLOduration=1.9431819830000001 podStartE2EDuration="7.305545142s" totalImagesPullingTime="5.362363159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:50:31.304571722 +0000 UTC m=+65.982178068" watchObservedRunningTime="2026-07-17 04:50:31.305545142 +0000 UTC m=+65.983151488"
Jul 17 04:50:31.374579 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.374548    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:31.432476 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.432440    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:31.537825 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.536757    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk" podStartSLOduration=2.211043203 podStartE2EDuration="7.536732402s" totalImagesPullingTime="5.325689199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:50:31.325645882 +0000 UTC m=+66.003252223" watchObservedRunningTime="2026-07-17 04:50:31.536732402 +0000 UTC m=+66.214338749"
Jul 17 04:50:31.538068 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.537861    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t64kc"]
Jul 17 04:50:31.541526 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.540650    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:31.545703 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.545519    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kdz6x\""
Jul 17 04:50:31.545703 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.545519    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 04:50:31.546715 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.546696    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 04:50:31.567927 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.567897    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t64kc"]
Jul 17 04:50:31.583021 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.582993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:31.583215 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.583043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-data-volume\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:31.583215 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.583093    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-crio-socket\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:31.583215 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.583140    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs\") pod \"network-metrics-daemon-hfzzb\" (UID: \"17c170e0-f040-42d6-9047-9afaa449d88e\") " pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:50:31.583215 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.583173    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:31.583412 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.583268    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tch6\" (UniqueName: \"kubernetes.io/projected/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-api-access-8tch6\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:31.586105 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.586083    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 04:50:31.593640 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:31.593590    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 17 04:50:31.593779 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:31.593710    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs podName:17c170e0-f040-42d6-9047-9afaa449d88e nodeName:}" failed. No retries permitted until 2026-07-17 04:51:35.593690742 +0000 UTC m=+130.271297066 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs") pod "network-metrics-daemon-hfzzb" (UID: "17c170e0-f040-42d6-9047-9afaa449d88e") : secret "metrics-daemon-secret" not found
Jul 17 04:50:31.619310 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.619254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:31.683985 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.683950    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-crio-socket\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:31.684188 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.684015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:31.684188 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.684041    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tch6\" (UniqueName: \"kubernetes.io/projected/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-api-access-8tch6\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:31.684188 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.684085    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-crio-socket\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:31.684188 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.684091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pngxm\" (UniqueName: \"kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm\") pod \"network-check-target-l8nc2\" (UID: \"9514d6c6-a71f-4861-a495-84df181bdbfd\") " pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:50:31.684188 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.684146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:31.684188 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.684178    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret\") pod \"global-pull-secret-syncer-tr4jx\" (UID: \"cd3883fe-1e59-474f-aa19-3b3fae77ab85\") " pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:50:31.684482 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:31.684201    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 04:50:31.684482 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.684220    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-data-volume\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:31.684482 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:31.684232    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 04:50:31.684482 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:31.684269    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls podName:8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:32.184247286 +0000 UTC m=+66.861853625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t64kc" (UID: "8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06") : secret "insights-runtime-extractor-tls" not found
Jul 17 04:50:31.684482 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:31.684291    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm podName:8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:32.184280249 +0000 UTC m=+66.861886580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t64kc" (UID: "8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06") : configmap "kube-rbac-proxy" not found
Jul 17 04:50:31.684794 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.684767    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-data-volume\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:31.687171 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.687148    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pngxm\" (UniqueName: \"kubernetes.io/projected/9514d6c6-a71f-4861-a495-84df181bdbfd-kube-api-access-pngxm\") pod \"network-check-target-l8nc2\" (UID: \"9514d6c6-a71f-4861-a495-84df181bdbfd\") " pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:50:31.687719 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.687699    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 04:50:31.697038 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.697010    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd3883fe-1e59-474f-aa19-3b3fae77ab85-original-pull-secret\") pod \"global-pull-secret-syncer-tr4jx\" (UID: \"cd3883fe-1e59-474f-aa19-3b3fae77ab85\") " pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:50:31.697202 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.697143    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tch6\" (UniqueName: \"kubernetes.io/projected/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-api-access-8tch6\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:31.718925 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.718868    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:31.793103 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.793005    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:31.854025 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.853992    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:31.861948 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.861924    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tr4jx"
Jul 17 04:50:31.972701 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.972676    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mhn7j\""
Jul 17 04:50:31.980924 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.980895    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:50:31.996712 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:31.996676    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tr4jx"]
Jul 17 04:50:32.002099 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:50:32.002069    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3883fe_1e59_474f_aa19_3b3fae77ab85.slice/crio-7f9ce81b71e4227da183879f36d270ca0cfa4cd6089951ff63c219b68adb41dd WatchSource:0}: Error finding container 7f9ce81b71e4227da183879f36d270ca0cfa4cd6089951ff63c219b68adb41dd: Status 404 returned error can't find the container with id 7f9ce81b71e4227da183879f36d270ca0cfa4cd6089951ff63c219b68adb41dd
Jul 17 04:50:32.070277 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.070242    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:32.118113 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.118080    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l8nc2"]
Jul 17 04:50:32.121135 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:50:32.121108    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9514d6c6_a71f_4861_a495_84df181bdbfd.slice/crio-e84cda833f0708ff9d602eccc3cafa37b71088f819fd50c966d2b751ece2e8dc WatchSource:0}: Error finding container e84cda833f0708ff9d602eccc3cafa37b71088f819fd50c966d2b751ece2e8dc: Status 404 returned error can't find the container with id e84cda833f0708ff9d602eccc3cafa37b71088f819fd50c966d2b751ece2e8dc
Jul 17 04:50:32.170993 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.170963    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:32.190332 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.190306    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:32.190390 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.190348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tn2p\" (UID: \"aceeef42-5510-49c6-a843-be129763ac26\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:32.190442 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.190377    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qp2cl\" (UID: \"91c02549-ae8f-473f-a1ea-523e1b503878\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"
Jul 17 04:50:32.190482 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:32.190465    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 04:50:32.190482 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.190475    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:32.190555 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:32.190513    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 04:50:32.190555 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:32.190529    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm podName:8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:33.190509558 +0000 UTC m=+67.868115882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t64kc" (UID: "8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06") : configmap "kube-rbac-proxy" not found
Jul 17 04:50:32.190671 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:32.190562    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 04:50:32.190671 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:32.190571    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls podName:aceeef42-5510-49c6-a843-be129763ac26 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:40.190554771 +0000 UTC m=+74.868161098 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-9tn2p" (UID: "aceeef42-5510-49c6-a843-be129763ac26") : secret "cluster-monitoring-operator-tls" not found
Jul 17 04:50:32.190671 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:32.190580    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 04:50:32.190671 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:32.190596    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls podName:8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:33.190586062 +0000 UTC m=+67.868192404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t64kc" (UID: "8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06") : secret "insights-runtime-extractor-tls" not found
Jul 17 04:50:32.190671 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:32.190648    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls podName:91c02549-ae8f-473f-a1ea-523e1b503878 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:40.190616833 +0000 UTC m=+74.868223161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-qp2cl" (UID: "91c02549-ae8f-473f-a1ea-523e1b503878") : secret "samples-operator-tls" not found
Jul 17 04:50:32.246490 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.246461    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 04:50:32.246956 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.246936    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/0.log"
Jul 17 04:50:32.247016 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.246983    2564 generic.go:356] "Generic (PLEG): container finished" podID="529078b2-2d39-4be8-a551-d6497714270f" containerID="f287725651406252dc7b3f0f2e0db5936550910866aa25a86e1b1459160d2727" exitCode=255
Jul 17 04:50:32.247089 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.247067    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6g55g" event={"ID":"529078b2-2d39-4be8-a551-d6497714270f","Type":"ContainerDied","Data":"f287725651406252dc7b3f0f2e0db5936550910866aa25a86e1b1459160d2727"}
Jul 17 04:50:32.247133 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.247122    2564 scope.go:117] "RemoveContainer" containerID="b9b81e4dc84cbfc3847f1f018ecf7f33b8d605ebf8608011bad4346ae0fb16d2"
Jul 17 04:50:32.247349 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.247329    2564 scope.go:117] "RemoveContainer" containerID="f287725651406252dc7b3f0f2e0db5936550910866aa25a86e1b1459160d2727"
Jul 17 04:50:32.247511 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:32.247490    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-6g55g_openshift-console-operator(529078b2-2d39-4be8-a551-d6497714270f)\"" pod="openshift-console-operator/console-operator-565b7b569d-6g55g" podUID="529078b2-2d39-4be8-a551-d6497714270f"
Jul 17 04:50:32.248394 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.248366    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tr4jx" event={"ID":"cd3883fe-1e59-474f-aa19-3b3fae77ab85","Type":"ContainerStarted","Data":"7f9ce81b71e4227da183879f36d270ca0cfa4cd6089951ff63c219b68adb41dd"}
Jul 17 04:50:32.249990 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.249899    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l8nc2" event={"ID":"9514d6c6-a71f-4861-a495-84df181bdbfd","Type":"ContainerStarted","Data":"0fa770cc4e700d5b04cc5c1e2f6c66d4d2468466e65c17798e79ff2474b44556"}
Jul 17 04:50:32.249990 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.249957    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l8nc2" event={"ID":"9514d6c6-a71f-4861-a495-84df181bdbfd","Type":"ContainerStarted","Data":"e84cda833f0708ff9d602eccc3cafa37b71088f819fd50c966d2b751ece2e8dc"}
Jul 17 04:50:32.272514 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.272471    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:32.300702 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.300651    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l8nc2" podStartSLOduration=66.300614272 podStartE2EDuration="1m6.300614272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:49:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:50:32.299307233 +0000 UTC m=+66.976913581" watchObservedRunningTime="2026-07-17 04:50:32.300614272 +0000 UTC m=+66.978220618"
Jul 17 04:50:32.335495 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.335400    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:32.393469 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.393424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dqwqx\" (UID: \"1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"
Jul 17 04:50:32.393682 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.393476    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:32.393682 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.393545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:32.393682 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:32.393582    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 04:50:32.393682 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:32.393654    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 04:50:32.393818 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:32.393689    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert podName:1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:40.39367039 +0000 UTC m=+75.071276718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dqwqx" (UID: "1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22") : secret "networking-console-plugin-cert" not found
Jul 17 04:50:32.393818 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:32.393711    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs podName:4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:40.393697348 +0000 UTC m=+75.071303674 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs") pod "router-default-679d5646-wtsmz" (UID: "4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642") : secret "router-metrics-certs-default" not found
Jul 17 04:50:32.393818 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:32.393725    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle podName:4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:40.393718913 +0000 UTC m=+75.071325237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle") pod "router-default-679d5646-wtsmz" (UID: "4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642") : configmap references non-existent config key: service-ca.crt
Jul 17 04:50:32.435542 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.435509    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:32.535474 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:32.535447    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-28dgh_0a1a5036-08c3-4598-8271-0b3e5746e98f/dns-node-resolver/0.log"
Jul 17 04:50:33.200600 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:33.200559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:33.200777 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:33.200689    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:33.200777 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:33.200721    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 04:50:33.200860 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:33.200805    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm podName:8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:35.200784026 +0000 UTC m=+69.878390357 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t64kc" (UID: "8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06") : configmap "kube-rbac-proxy" not found
Jul 17 04:50:33.200860 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:33.200844    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 04:50:33.201035 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:33.200902    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls podName:8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:35.200886544 +0000 UTC m=+69.878492872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t64kc" (UID: "8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06") : secret "insights-runtime-extractor-tls" not found
Jul 17 04:50:33.255171 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:33.255145    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 04:50:33.255540 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:33.255342    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:50:33.255648 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:33.255617    2564 scope.go:117] "RemoveContainer" containerID="f287725651406252dc7b3f0f2e0db5936550910866aa25a86e1b1459160d2727"
Jul 17 04:50:33.255793 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:33.255774    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-6g55g_openshift-console-operator(529078b2-2d39-4be8-a551-d6497714270f)\"" pod="openshift-console-operator/console-operator-565b7b569d-6g55g" podUID="529078b2-2d39-4be8-a551-d6497714270f"
Jul 17 04:50:33.604410 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:33.604375    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:50:33.604611 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:33.604479    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:50:33.604611 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:33.604543    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 04:50:33.604757 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:33.604646    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls podName:702ad1b9-6061-4808-9fe6-721eee836531 nodeName:}" failed. No retries permitted until 2026-07-17 04:51:05.604612397 +0000 UTC m=+100.282218724 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls") pod "dns-default-p5n24" (UID: "702ad1b9-6061-4808-9fe6-721eee836531") : secret "dns-default-metrics-tls" not found
Jul 17 04:50:33.604757 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:33.604659    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 04:50:33.604757 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:33.604678    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ccbf75cf7-m72x7: secret "image-registry-tls" not found
Jul 17 04:50:33.604757 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:33.604729    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls podName:0d993fee-35d5-44ee-a130-69e06e36c348 nodeName:}" failed. No retries permitted until 2026-07-17 04:51:05.604711781 +0000 UTC m=+100.282318118 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls") pod "image-registry-6ccbf75cf7-m72x7" (UID: "0d993fee-35d5-44ee-a130-69e06e36c348") : secret "image-registry-tls" not found
Jul 17 04:50:33.707347 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:33.707237    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:33.735649 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:33.735603    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d4sqb_ba97ada7-a006-40a4-a0ef-513d06d8645a/node-ca/0.log"
Jul 17 04:50:33.762278 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:33.762241    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:34.077773 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:34.077723    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:34.137149 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:34.137109    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:34.335913 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:34.335834    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dl657_a9591e1b-18f6-4987-9642-e41e6641d6e6/serve-healthcheck-canary/0.log"
Jul 17 04:50:34.604121 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:34.604000    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:34.950144 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:34.950064    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:34.950144 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:34.950125    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:34.950459 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:34.950447    2564 scope.go:117] "RemoveContainer" containerID="f287725651406252dc7b3f0f2e0db5936550910866aa25a86e1b1459160d2727"
Jul 17 04:50:34.950674 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:34.950647    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-6g55g_openshift-console-operator(529078b2-2d39-4be8-a551-d6497714270f)\"" pod="openshift-console-operator/console-operator-565b7b569d-6g55g" podUID="529078b2-2d39-4be8-a551-d6497714270f"
Jul 17 04:50:35.219834 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:35.219740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:35.219834 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:35.219810    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:35.220016 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:35.219901    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 04:50:35.220016 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:35.219914    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 04:50:35.220016 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:35.219959    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm podName:8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:39.219944601 +0000 UTC m=+73.897550940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t64kc" (UID: "8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06") : configmap "kube-rbac-proxy" not found
Jul 17 04:50:35.220016 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:35.219972    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls podName:8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:39.219966509 +0000 UTC m=+73.897572833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t64kc" (UID: "8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06") : secret "insights-runtime-extractor-tls" not found
Jul 17 04:50:36.917355 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:36.917308    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:37.271886 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:37.271841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tr4jx" event={"ID":"cd3883fe-1e59-474f-aa19-3b3fae77ab85","Type":"ContainerStarted","Data":"0a1dd3ae07e99e98b7ac2da5017870ec24f71b7fac3b15d937ebaeff597ecf6b"}
Jul 17 04:50:37.288242 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:37.288175    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tr4jx" podStartSLOduration=65.199067458 podStartE2EDuration="1m10.288157571s" totalImagesPullingTime="5.089090113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 04:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:50:37.287065442 +0000 UTC m=+71.964671788" watchObservedRunningTime="2026-07-17 04:50:37.288157571 +0000 UTC m=+71.965763965"
Jul 17 04:50:37.467499 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:37.467404    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:38.890070 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:38.890034    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:38.990313 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:38.990280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:39.091243 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:39.091210    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:39.191970 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:39.191887    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:39.258446 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:39.258410    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:39.258611 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:39.258478    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:39.258611 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:39.258557    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 04:50:39.258611 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:39.258560    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 04:50:39.258743 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:39.258619    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm podName:8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:47.258603728 +0000 UTC m=+81.936210056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t64kc" (UID: "8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06") : configmap "kube-rbac-proxy" not found
Jul 17 04:50:39.258743 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:39.258646    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls podName:8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:47.258639437 +0000 UTC m=+81.936245763 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t64kc" (UID: "8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06") : secret "insights-runtime-extractor-tls" not found
Jul 17 04:50:39.300862 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:39.300829    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:39.585270 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:39.585234    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:40.266618 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:40.266578    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tn2p\" (UID: \"aceeef42-5510-49c6-a843-be129763ac26\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:40.267052 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:40.266655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qp2cl\" (UID: \"91c02549-ae8f-473f-a1ea-523e1b503878\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"
Jul 17 04:50:40.267052 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:40.266771    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 04:50:40.267052 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:40.266787    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 04:50:40.267052 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:40.266823    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls podName:91c02549-ae8f-473f-a1ea-523e1b503878 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:56.266809718 +0000 UTC m=+90.944416047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-qp2cl" (UID: "91c02549-ae8f-473f-a1ea-523e1b503878") : secret "samples-operator-tls" not found
Jul 17 04:50:40.267052 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:40.266842    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls podName:aceeef42-5510-49c6-a843-be129763ac26 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:56.266828814 +0000 UTC m=+90.944435138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-9tn2p" (UID: "aceeef42-5510-49c6-a843-be129763ac26") : secret "cluster-monitoring-operator-tls" not found
Jul 17 04:50:40.378108 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:40.378071    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:40.468332 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:40.468290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:40.468521 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:40.468389    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dqwqx\" (UID: \"1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"
Jul 17 04:50:40.468521 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:40.468416    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:40.468521 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:40.468494    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle podName:4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:56.468475141 +0000 UTC m=+91.146081468 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle") pod "router-default-679d5646-wtsmz" (UID: "4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642") : configmap references non-existent config key: service-ca.crt
Jul 17 04:50:40.468720 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:40.468529    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 17 04:50:40.468720 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:40.468563    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 04:50:40.468720 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:40.468583    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert podName:1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:56.468570457 +0000 UTC m=+91.146176781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dqwqx" (UID: "1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22") : secret "networking-console-plugin-cert" not found
Jul 17 04:50:40.468720 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:40.468617    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs podName:4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642 nodeName:}" failed. No retries permitted until 2026-07-17 04:50:56.468600889 +0000 UTC m=+91.146207215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs") pod "router-default-679d5646-wtsmz" (UID: "4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642") : secret "router-metrics-certs-default" not found
Jul 17 04:50:40.984259 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:40.984210    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:41.180240 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:41.180195    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:41.389164 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:41.389129    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:41.784111 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:41.784012    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:42.510270 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:42.510242    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:42.611339 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:42.611309    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:42.658257 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:42.658225    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:42.782818 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:42.782726    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:42.981130 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:42.981092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:43.181169 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:43.181135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:43.232603 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:43.232561    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:44.381494 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:44.381457    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:44.581239 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:44.581201    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:44.717579 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:44.717499    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:44.818393 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:44.818365    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:44.982521 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:44.982435    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:45.185899 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:45.185870    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:45.287855 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:45.287775    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:45.853026 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:45.852997    2564 scope.go:117] "RemoveContainer" containerID="f287725651406252dc7b3f0f2e0db5936550910866aa25a86e1b1459160d2727"
Jul 17 04:50:45.864233 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:45.862873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:46.194658 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:46.194536    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:46.303124 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:46.303095    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 04:50:46.303293 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:46.303168    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-6g55g" event={"ID":"529078b2-2d39-4be8-a551-d6497714270f","Type":"ContainerStarted","Data":"ba803a478c41365bf463e23cbd087dd27fe2bc926b3217f98187525f42f1e3a9"}
Jul 17 04:50:46.303480 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:46.303458    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:46.319544 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:46.319495    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-6g55g" podStartSLOduration=17.145302999 podStartE2EDuration="22.319479134s" totalImagesPullingTime="5.174176135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:50:46.318517014 +0000 UTC m=+80.996123371" watchObservedRunningTime="2026-07-17 04:50:46.319479134 +0000 UTC m=+80.997085479"
Jul 17 04:50:46.585394 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:46.585361    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:46.780887 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:46.780757    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:46.901320 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:46.901242    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-6g55g"
Jul 17 04:50:47.001538 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:47.001503    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:47.101595 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:47.101560    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:47.202740 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:47.202650    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:47.251173 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:47.251126    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:47.327737 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:47.327707    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:47.327900 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:47.327850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:47.328021 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:47.327988    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 04:50:47.328069 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:50:47.328057    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls podName:8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06 nodeName:}" failed. No retries permitted until 2026-07-17 04:51:03.328040836 +0000 UTC m=+98.005647159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t64kc" (UID: "8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06") : secret "insights-runtime-extractor-tls" not found
Jul 17 04:50:47.328278 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:47.328257    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:50:47.378429 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:47.378387    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:47.752414 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:47.752359    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:47.853260 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:47.853219    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:48.164907 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:48.164855    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:48.264940 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:48.264903    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:48.382010 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:48.381965    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:48.437161 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:48.437072    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:48.570315 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:48.570279    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:48.785539 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:48.785438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:48.983090 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:48.983052    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:49.038221 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:49.038106    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:49.182706 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:49.182673    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:49.852719 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:49.852687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:50.021307 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:50.021275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:50.200151 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:50.200059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:56.304149 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.304105    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tn2p\" (UID: \"aceeef42-5510-49c6-a843-be129763ac26\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:56.304149 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.304160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qp2cl\" (UID: \"91c02549-ae8f-473f-a1ea-523e1b503878\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"
Jul 17 04:50:56.306766 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.306739    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/91c02549-ae8f-473f-a1ea-523e1b503878-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qp2cl\" (UID: \"91c02549-ae8f-473f-a1ea-523e1b503878\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"
Jul 17 04:50:56.306890 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.306848    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aceeef42-5510-49c6-a843-be129763ac26-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-9tn2p\" (UID: \"aceeef42-5510-49c6-a843-be129763ac26\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:56.317457 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.317431    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jh4ts\""
Jul 17 04:50:56.321778 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.321760    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-phtx5\""
Jul 17 04:50:56.323691 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.323667    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"
Jul 17 04:50:56.330317 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.330295    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"
Jul 17 04:50:56.381599 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.381433    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh"]
Jul 17 04:50:56.385734 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.385705    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh"
Jul 17 04:50:56.395405 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.390202    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 17 04:50:56.395405 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.394018    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 04:50:56.395405 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.394199    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 17 04:50:56.395405 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.394358    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 17 04:50:56.401401 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.401296    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh"]
Jul 17 04:50:56.428566 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.428519    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:56.469164 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.469098    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-7fbkb"]
Jul 17 04:50:56.471801 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.471751    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-7fbkb"
Jul 17 04:50:56.475606 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.475390    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 17 04:50:56.475606 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.475438    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-prg87\""
Jul 17 04:50:56.475606 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.475539    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 17 04:50:56.487858 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.487830    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-7fbkb"]
Jul 17 04:50:56.506794 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.506760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:56.506961 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.506865    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brwwb\" (UniqueName: \"kubernetes.io/projected/74709c50-017a-4c1c-ae39-82324446a598-kube-api-access-brwwb\") pod \"klusterlet-addon-workmgr-67d586dbdd-kcwvh\" (UID: \"74709c50-017a-4c1c-ae39-82324446a598\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh"
Jul 17 04:50:56.506961 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.506930    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dqwqx\" (UID: \"1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"
Jul 17 04:50:56.507044 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.506963    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/74709c50-017a-4c1c-ae39-82324446a598-klusterlet-config\") pod \"klusterlet-addon-workmgr-67d586dbdd-kcwvh\" (UID: \"74709c50-017a-4c1c-ae39-82324446a598\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh"
Jul 17 04:50:56.507044 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.506988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74709c50-017a-4c1c-ae39-82324446a598-tmp\") pod \"klusterlet-addon-workmgr-67d586dbdd-kcwvh\" (UID: \"74709c50-017a-4c1c-ae39-82324446a598\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh"
Jul 17 04:50:56.507044 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.507027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:56.507742 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.507509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-service-ca-bundle\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:56.508369 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.508347    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p"]
Jul 17 04:50:56.510101 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.509979    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642-metrics-certs\") pod \"router-default-679d5646-wtsmz\" (UID: \"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642\") " pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:56.510233 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.510179    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dqwqx\" (UID: \"1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"
Jul 17 04:50:56.512100 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:50:56.512079    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaceeef42_5510_49c6_a843_be129763ac26.slice/crio-744ca9200988d6ab104dd1c70b85a3463224595de85f795b24941fc0ec7cf546 WatchSource:0}: Error finding container 744ca9200988d6ab104dd1c70b85a3463224595de85f795b24941fc0ec7cf546: Status 404 returned error can't find the container with id 744ca9200988d6ab104dd1c70b85a3463224595de85f795b24941fc0ec7cf546
Jul 17 04:50:56.530811 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.530781    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl"]
Jul 17 04:50:56.535733 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.535700    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:56.607894 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.607856    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qtbv\" (UniqueName: \"kubernetes.io/projected/4684caf4-6f80-400e-8c2e-c07bb84e46a8-kube-api-access-7qtbv\") pod \"downloads-5bc67dcd46-7fbkb\" (UID: \"4684caf4-6f80-400e-8c2e-c07bb84e46a8\") " pod="openshift-console/downloads-5bc67dcd46-7fbkb"
Jul 17 04:50:56.608110 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.607969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brwwb\" (UniqueName: \"kubernetes.io/projected/74709c50-017a-4c1c-ae39-82324446a598-kube-api-access-brwwb\") pod \"klusterlet-addon-workmgr-67d586dbdd-kcwvh\" (UID: \"74709c50-017a-4c1c-ae39-82324446a598\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh"
Jul 17 04:50:56.608110 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.608028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/74709c50-017a-4c1c-ae39-82324446a598-klusterlet-config\") pod \"klusterlet-addon-workmgr-67d586dbdd-kcwvh\" (UID: \"74709c50-017a-4c1c-ae39-82324446a598\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh"
Jul 17 04:50:56.608110 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.608052    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74709c50-017a-4c1c-ae39-82324446a598-tmp\") pod \"klusterlet-addon-workmgr-67d586dbdd-kcwvh\" (UID: \"74709c50-017a-4c1c-ae39-82324446a598\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh"
Jul 17 04:50:56.608439 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.608416    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74709c50-017a-4c1c-ae39-82324446a598-tmp\") pod \"klusterlet-addon-workmgr-67d586dbdd-kcwvh\" (UID: \"74709c50-017a-4c1c-ae39-82324446a598\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh"
Jul 17 04:50:56.610734 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.610703    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/74709c50-017a-4c1c-ae39-82324446a598-klusterlet-config\") pod \"klusterlet-addon-workmgr-67d586dbdd-kcwvh\" (UID: \"74709c50-017a-4c1c-ae39-82324446a598\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh"
Jul 17 04:50:56.621767 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.621737    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brwwb\" (UniqueName: \"kubernetes.io/projected/74709c50-017a-4c1c-ae39-82324446a598-kube-api-access-brwwb\") pod \"klusterlet-addon-workmgr-67d586dbdd-kcwvh\" (UID: \"74709c50-017a-4c1c-ae39-82324446a598\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh"
Jul 17 04:50:56.708978 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.708937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qtbv\" (UniqueName: \"kubernetes.io/projected/4684caf4-6f80-400e-8c2e-c07bb84e46a8-kube-api-access-7qtbv\") pod \"downloads-5bc67dcd46-7fbkb\" (UID: \"4684caf4-6f80-400e-8c2e-c07bb84e46a8\") " pod="openshift-console/downloads-5bc67dcd46-7fbkb"
Jul 17 04:50:56.709783 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.709763    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh"
Jul 17 04:50:56.721233 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.721207    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qtbv\" (UniqueName: \"kubernetes.io/projected/4684caf4-6f80-400e-8c2e-c07bb84e46a8-kube-api-access-7qtbv\") pod \"downloads-5bc67dcd46-7fbkb\" (UID: \"4684caf4-6f80-400e-8c2e-c07bb84e46a8\") " pod="openshift-console/downloads-5bc67dcd46-7fbkb"
Jul 17 04:50:56.733459 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.733421    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:56.766878 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.766852    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ckw86\""
Jul 17 04:50:56.775070 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.775042    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:56.786304 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.786281    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-7fbkb"
Jul 17 04:50:56.804065 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.804039    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nzwzs\""
Jul 17 04:50:56.812454 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.812375    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"
Jul 17 04:50:56.835344 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.834835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:56.858285 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.858212    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh"]
Jul 17 04:50:56.869701 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:50:56.868741    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74709c50_017a_4c1c_ae39_82324446a598.slice/crio-cc4ffabc3a7eac9be08046fa342cb531a22cd77f90778db8c0a6d4ca8032edfa WatchSource:0}: Error finding container cc4ffabc3a7eac9be08046fa342cb531a22cd77f90778db8c0a6d4ca8032edfa: Status 404 returned error can't find the container with id cc4ffabc3a7eac9be08046fa342cb531a22cd77f90778db8c0a6d4ca8032edfa
Jul 17 04:50:56.940044 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.940010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:56.974841 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.974809    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-679d5646-wtsmz"]
Jul 17 04:50:56.978597 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.978570    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-7fbkb"]
Jul 17 04:50:56.981955 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:50:56.981932    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4684caf4_6f80_400e_8c2e_c07bb84e46a8.slice/crio-4f8e73f829b4ae32070ba4f821e3a1dd4a4f16c0b91c48ce29b7ffb2cc238962 WatchSource:0}: Error finding container 4f8e73f829b4ae32070ba4f821e3a1dd4a4f16c0b91c48ce29b7ffb2cc238962: Status 404 returned error can't find the container with id 4f8e73f829b4ae32070ba4f821e3a1dd4a4f16c0b91c48ce29b7ffb2cc238962
Jul 17 04:50:56.996777 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:56.996746    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx"]
Jul 17 04:50:56.999984 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:50:56.999961    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d3b10ca_d653_46e0_9d9a_4e9ff21f2b22.slice/crio-fb4eb8cb667732ced84f99360e6ca8dbc3411cd93ef592bafe240d8255a649a4 WatchSource:0}: Error finding container fb4eb8cb667732ced84f99360e6ca8dbc3411cd93ef592bafe240d8255a649a4: Status 404 returned error can't find the container with id fb4eb8cb667732ced84f99360e6ca8dbc3411cd93ef592bafe240d8255a649a4
Jul 17 04:50:57.342583 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:57.342541    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-7fbkb" event={"ID":"4684caf4-6f80-400e-8c2e-c07bb84e46a8","Type":"ContainerStarted","Data":"4f8e73f829b4ae32070ba4f821e3a1dd4a4f16c0b91c48ce29b7ffb2cc238962"}
Jul 17 04:50:57.343995 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:57.343960    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx" event={"ID":"1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22","Type":"ContainerStarted","Data":"fb4eb8cb667732ced84f99360e6ca8dbc3411cd93ef592bafe240d8255a649a4"}
Jul 17 04:50:57.345379 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:57.345193    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh" event={"ID":"74709c50-017a-4c1c-ae39-82324446a598","Type":"ContainerStarted","Data":"cc4ffabc3a7eac9be08046fa342cb531a22cd77f90778db8c0a6d4ca8032edfa"}
Jul 17 04:50:57.346843 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:57.346816    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl" event={"ID":"91c02549-ae8f-473f-a1ea-523e1b503878","Type":"ContainerStarted","Data":"b94a1611be6f96c1be3a5e6579c1a77b4aa55b3e4dcceb6c23e63eca4bd76f8e"}
Jul 17 04:50:57.348896 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:57.348870    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-679d5646-wtsmz" event={"ID":"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642","Type":"ContainerStarted","Data":"d2432cfbac606e0d9e0d25bd4ec90460748c6cede07e27503992757ea3543300"}
Jul 17 04:50:57.349002 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:57.348913    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-679d5646-wtsmz" event={"ID":"4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642","Type":"ContainerStarted","Data":"3819a703edcaa2e30646390b571dd753ce124744e29e630b09b7dd07adb0c289"}
Jul 17 04:50:57.350404 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:57.350380    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p" event={"ID":"aceeef42-5510-49c6-a843-be129763ac26","Type":"ContainerStarted","Data":"744ca9200988d6ab104dd1c70b85a3463224595de85f795b24941fc0ec7cf546"}
Jul 17 04:50:57.371646 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:57.371566    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-679d5646-wtsmz" podStartSLOduration=33.37154338 podStartE2EDuration="33.37154338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:50:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:50:57.371079671 +0000 UTC m=+92.048686019" watchObservedRunningTime="2026-07-17 04:50:57.37154338 +0000 UTC m=+92.049149727"
Jul 17 04:50:57.427226 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:57.427157    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:57.526189 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:57.526097    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:57.582569 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:57.582478    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:57.775734 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:57.775570    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:57.778680 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:57.778650    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:57.801222 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:57.801166    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:57.936981 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:57.936942    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:58.002018 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.000664    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fdf5b455d-xbmlv"]
Jul 17 04:50:58.004480 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.003141    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.009118 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.008020    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hq762\""
Jul 17 04:50:58.009118 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.008281    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 17 04:50:58.009118 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.008583    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 17 04:50:58.009118 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.008788    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 17 04:50:58.009945 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.009518    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 17 04:50:58.012025 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.010235    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 17 04:50:58.016689 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.016513    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdf5b455d-xbmlv"]
Jul 17 04:50:58.122540 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.122195    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-oauth-serving-cert\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.122540 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.122289    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-console-config\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.122540 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.122363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjs5n\" (UniqueName: \"kubernetes.io/projected/d250d15d-45c0-4da7-a230-16cde0aa003b-kube-api-access-sjs5n\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.122540 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.122420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d250d15d-45c0-4da7-a230-16cde0aa003b-console-serving-cert\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.122540 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.122487    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d250d15d-45c0-4da7-a230-16cde0aa003b-console-oauth-config\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.122953 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.122580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-service-ca\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.194785 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.194610    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:58.224366 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.223513    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d250d15d-45c0-4da7-a230-16cde0aa003b-console-oauth-config\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.224366 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.223571    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-service-ca\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.224366 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.223617    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-oauth-serving-cert\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.224366 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.223677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-console-config\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.224366 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.223746    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjs5n\" (UniqueName: \"kubernetes.io/projected/d250d15d-45c0-4da7-a230-16cde0aa003b-kube-api-access-sjs5n\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.224366 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.223812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d250d15d-45c0-4da7-a230-16cde0aa003b-console-serving-cert\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.224824 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.224761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-oauth-serving-cert\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.225269 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.225191    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-console-config\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.225815 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.225792    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-service-ca\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.231283 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.231251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d250d15d-45c0-4da7-a230-16cde0aa003b-console-oauth-config\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.232701 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.232618    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d250d15d-45c0-4da7-a230-16cde0aa003b-console-serving-cert\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.240652 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.240567    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjs5n\" (UniqueName: \"kubernetes.io/projected/d250d15d-45c0-4da7-a230-16cde0aa003b-kube-api-access-sjs5n\") pod \"console-fdf5b455d-xbmlv\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") " pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.249124 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.249066    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:50:58.325666 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.325427    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:50:58.358940 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.358905    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:50:58.360227 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:50:58.360198    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-679d5646-wtsmz"
Jul 17 04:51:02.809267 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:02.809160    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:02.873375 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:02.873339    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:03.204404 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:03.204376    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdf5b455d-xbmlv"]
Jul 17 04:51:03.300695 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:51:03.300655    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd250d15d_45c0_4da7_a230_16cde0aa003b.slice/crio-db54f3106d37c0bcd1fd46d0c9e202125135329c379a5998a87f06c3b5dcc112 WatchSource:0}: Error finding container db54f3106d37c0bcd1fd46d0c9e202125135329c379a5998a87f06c3b5dcc112: Status 404 returned error can't find the container with id db54f3106d37c0bcd1fd46d0c9e202125135329c379a5998a87f06c3b5dcc112
Jul 17 04:51:03.377731 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:03.377703    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:51:03.381093 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:03.381009    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t64kc\" (UID: \"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06\") " pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:51:03.386768 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:03.386729    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx" event={"ID":"1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22","Type":"ContainerStarted","Data":"9858623b6d86d893fac1f0e5ef4690ed7fbb43c2196aa80210b413655e42101b"}
Jul 17 04:51:03.391667 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:03.391542    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl" event={"ID":"91c02549-ae8f-473f-a1ea-523e1b503878","Type":"ContainerStarted","Data":"d8d153cd22d8eab967633adc5d2712f359df9c3461250a3b811a18d47142128d"}
Jul 17 04:51:03.391667 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:03.391602    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl" event={"ID":"91c02549-ae8f-473f-a1ea-523e1b503878","Type":"ContainerStarted","Data":"b3568ba4670cd2b874ad1ebd263c9730c047c23246b933b2dcff9825921ab8d1"}
Jul 17 04:51:03.394082 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:03.393706    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdf5b455d-xbmlv" event={"ID":"d250d15d-45c0-4da7-a230-16cde0aa003b","Type":"ContainerStarted","Data":"db54f3106d37c0bcd1fd46d0c9e202125135329c379a5998a87f06c3b5dcc112"}
Jul 17 04:51:03.396200 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:03.396156    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p" event={"ID":"aceeef42-5510-49c6-a843-be129763ac26","Type":"ContainerStarted","Data":"757d0bf8fdbb7407a0cf4108656bc89b4a93387b1fd149eab99b809e8bd3c934"}
Jul 17 04:51:03.404262 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:03.402661    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dqwqx" podStartSLOduration=33.357994392 podStartE2EDuration="39.402643234s" totalImagesPullingTime="6.044648842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:51:03.402227598 +0000 UTC m=+98.079833945" watchObservedRunningTime="2026-07-17 04:51:03.402643234 +0000 UTC m=+98.080249575"
Jul 17 04:51:03.425677 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:03.425586    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qp2cl" podStartSLOduration=32.950371635 podStartE2EDuration="39.425562988s" totalImagesPullingTime="6.475191353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:51:03.425438944 +0000 UTC m=+98.103045290" watchObservedRunningTime="2026-07-17 04:51:03.425562988 +0000 UTC m=+98.103169336"
Jul 17 04:51:03.446584 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:03.446506    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-9tn2p" podStartSLOduration=32.913969335 podStartE2EDuration="39.446486761s" totalImagesPullingTime="6.532517426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:51:03.445699144 +0000 UTC m=+98.123305491" watchObservedRunningTime="2026-07-17 04:51:03.446486761 +0000 UTC m=+98.124093160"
Jul 17 04:51:03.544111 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:03.544074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:03.647893 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:03.647803    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:03.653586 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:03.653553    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t64kc"
Jul 17 04:51:03.702655 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:03.702603    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:03.815564 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:03.815533    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t64kc"]
Jul 17 04:51:03.819144 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:51:03.819103    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a2d4e61_bbf6_4d28_ab45_ffe96e0ada06.slice/crio-a1f6aa9682d1137a2dc61370849e5ccb34ea0095b57d4be475d4daa87cac2982 WatchSource:0}: Error finding container a1f6aa9682d1137a2dc61370849e5ccb34ea0095b57d4be475d4daa87cac2982: Status 404 returned error can't find the container with id a1f6aa9682d1137a2dc61370849e5ccb34ea0095b57d4be475d4daa87cac2982
Jul 17 04:51:04.056745 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:04.056701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:04.261202 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:04.261169    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l8nc2"
Jul 17 04:51:04.404832 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:04.404677    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t64kc" event={"ID":"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06","Type":"ContainerStarted","Data":"a1f6aa9682d1137a2dc61370849e5ccb34ea0095b57d4be475d4daa87cac2982"}
Jul 17 04:51:04.409821 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:04.408597    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh" event={"ID":"74709c50-017a-4c1c-ae39-82324446a598","Type":"ContainerStarted","Data":"2575d56bdee94ae62485c13e7c560b15108adfcade218b5cd46814e372129469"}
Jul 17 04:51:04.409821 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:04.409756    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh"
Jul 17 04:51:04.412552 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:04.411865    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh"
Jul 17 04:51:04.442487 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:04.442421    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67d586dbdd-kcwvh" podStartSLOduration=1.9978606380000001 podStartE2EDuration="8.442396759s" totalImagesPullingTime="6.444536121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:51:04.425763 +0000 UTC m=+99.103369347" watchObservedRunningTime="2026-07-17 04:51:04.442396759 +0000 UTC m=+99.120003105"
Jul 17 04:51:04.985909 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:04.985865    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:05.039993 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:05.039944    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:05.203999 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:05.203957    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:05.263228 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:05.263142    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:05.704378 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:05.703844    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:51:05.704378 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:05.703950    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:51:05.707399 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:05.707333    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls\") pod \"image-registry-6ccbf75cf7-m72x7\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") " pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:51:05.712557 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:05.712491    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/702ad1b9-6061-4808-9fe6-721eee836531-metrics-tls\") pod \"dns-default-p5n24\" (UID: \"702ad1b9-6061-4808-9fe6-721eee836531\") " pod="openshift-dns/dns-default-p5n24"
Jul 17 04:51:05.925048 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:05.925016    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bbzx9\""
Jul 17 04:51:05.933430 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:05.933396    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:51:05.936146 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:05.935923    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kswzc\""
Jul 17 04:51:05.944203 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:05.944169    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p5n24"
Jul 17 04:51:06.544044 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:06.543941    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:06.647879 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:06.647756    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:07.384346 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:07.384311    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:07.431836 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:07.431802    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:07.787093 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:07.787005    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:07.834472 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:07.834390    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:09.792934 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:09.792888    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:10.128663 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:10.128606    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:10.223359 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:10.223280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:10.681814 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:10.681773    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:10.748201 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:10.748169    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:10.830006 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:10.829968    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:12.600240 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:12.600190    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:12.702968 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:12.702925    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:13.257508 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:13.257472    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:13.356745 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:13.356701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:14.756197 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:14.756162    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:15.282447 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:15.282404    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fdf5b455d-xbmlv"]
Jul 17 04:51:15.385336 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:15.385302    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:15.486620 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:15.486584    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:15.543394 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:15.543301    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:15.670706 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:15.670667    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:15.719896 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:15.719864    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:16.318964 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:16.318911    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:16.413554 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:16.413518    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:16.833171 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:16.833127    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:17.053748 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.053696    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:17.115343 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.115249    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m456p"]
Jul 17 04:51:17.154738 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.154697    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:17.165847 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.165806    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.168615 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.168588    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 04:51:17.168797 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.168589    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 04:51:17.168865 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.168590    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 04:51:17.168865 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.168841    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 04:51:17.169669 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.169619    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2j6t8\""
Jul 17 04:51:17.217404 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.217371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-wtmp\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.217608 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.217412    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-sys\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.217608 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.217470    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-root\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.217608 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.217542    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-tls\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.217608 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.217580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-metrics-client-ca\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.217608 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.217605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.217907 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.217682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-textfile\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.217907 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.217708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rfqk\" (UniqueName: \"kubernetes.io/projected/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-kube-api-access-5rfqk\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.217907 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.217738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.318725 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.318690    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-tls\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.318961 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.318748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-metrics-client-ca\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.318961 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.318782    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.318961 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.318819    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-textfile\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.318961 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.318862    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rfqk\" (UniqueName: \"kubernetes.io/projected/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-kube-api-access-5rfqk\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.318961 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:51:17.318891    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 17 04:51:17.319587 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:51:17.319000    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-tls podName:cc280032-e0dc-48ed-b5a3-cfebbf0a02e7 nodeName:}" failed. No retries permitted until 2026-07-17 04:51:17.818977552 +0000 UTC m=+112.496583875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-tls") pod "node-exporter-m456p" (UID: "cc280032-e0dc-48ed-b5a3-cfebbf0a02e7") : secret "node-exporter-tls" not found
Jul 17 04:51:17.319587 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.318899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.319587 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.319115    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-wtmp\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.319587 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.319148    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-sys\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.319587 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.319203    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-root\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.319587 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.319297    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-root\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.319587 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.319334    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-textfile\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.319587 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.319344    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-sys\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.319587 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.319334    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-wtmp\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.319587 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.319463    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-metrics-client-ca\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.319587 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.319552    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.321960 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.321935    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.327278 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.327258    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rfqk\" (UniqueName: \"kubernetes.io/projected/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-kube-api-access-5rfqk\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.434836 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.434732    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:17.536316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.536272    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:17.823727 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.823687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-tls\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:17.824003 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:51:17.823839    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 17 04:51:17.824003 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:51:17.823909    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-tls podName:cc280032-e0dc-48ed-b5a3-cfebbf0a02e7 nodeName:}" failed. No retries permitted until 2026-07-17 04:51:18.823887484 +0000 UTC m=+113.501493811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-tls") pod "node-exporter-m456p" (UID: "cc280032-e0dc-48ed-b5a3-cfebbf0a02e7") : secret "node-exporter-tls" not found
Jul 17 04:51:17.871236 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.871192    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:17.971361 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:17.971324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:18.076432 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:18.076332    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:18.159840 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:18.159806    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:18.280088 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:18.280052    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:18.676708 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:18.675068    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ccbf75cf7-m72x7"]
Jul 17 04:51:18.685284 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:51:18.685158    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d993fee_35d5_44ee_a130_69e06e36c348.slice/crio-d702834b4de23a6e405ffccb4f61271c7ab6d713a05ac529475b1eeef0071d80 WatchSource:0}: Error finding container d702834b4de23a6e405ffccb4f61271c7ab6d713a05ac529475b1eeef0071d80: Status 404 returned error can't find the container with id d702834b4de23a6e405ffccb4f61271c7ab6d713a05ac529475b1eeef0071d80
Jul 17 04:51:18.707721 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:18.707687    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p5n24"]
Jul 17 04:51:18.712195 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:51:18.712115    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod702ad1b9_6061_4808_9fe6_721eee836531.slice/crio-04ba71d0905b0ba5c9e5158e0a45f209ea9ec60389aa1799c3a1f3fae2ce76b2 WatchSource:0}: Error finding container 04ba71d0905b0ba5c9e5158e0a45f209ea9ec60389aa1799c3a1f3fae2ce76b2: Status 404 returned error can't find the container with id 04ba71d0905b0ba5c9e5158e0a45f209ea9ec60389aa1799c3a1f3fae2ce76b2
Jul 17 04:51:18.834595 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:18.834565    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-tls\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:18.837014 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:18.836982    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc280032-e0dc-48ed-b5a3-cfebbf0a02e7-node-exporter-tls\") pod \"node-exporter-m456p\" (UID: \"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7\") " pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:18.978647 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:18.978591    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m456p"
Jul 17 04:51:19.085346 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.085307    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ccbf75cf7-m72x7"]
Jul 17 04:51:19.186376 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.186337    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:19.245194 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.245127    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:19.479829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.479730    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m456p" event={"ID":"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7","Type":"ContainerStarted","Data":"3fca7acefb8add5c8f16e1bde67587588b634fb38384a9a1b4944a31c3e0ce77"}
Jul 17 04:51:19.483869 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.483776    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p5n24" event={"ID":"702ad1b9-6061-4808-9fe6-721eee836531","Type":"ContainerStarted","Data":"04ba71d0905b0ba5c9e5158e0a45f209ea9ec60389aa1799c3a1f3fae2ce76b2"}
Jul 17 04:51:19.493928 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.493599    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-7fbkb" event={"ID":"4684caf4-6f80-400e-8c2e-c07bb84e46a8","Type":"ContainerStarted","Data":"cf5ebc8a2c2def6731a8ca23de159663e60b7b69e0448c98926db37b8792d62f"}
Jul 17 04:51:19.495125 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.494860    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-7fbkb"
Jul 17 04:51:19.503205 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.502710    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdf5b455d-xbmlv" event={"ID":"d250d15d-45c0-4da7-a230-16cde0aa003b","Type":"ContainerStarted","Data":"8a1c915ba818e952a5aa740d46751e7ee5e13206c54443bb72c60a4434f67905"}
Jul 17 04:51:19.505832 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.505806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7" event={"ID":"0d993fee-35d5-44ee-a130-69e06e36c348","Type":"ContainerStarted","Data":"ad6ee56ce93f425bd40c73c9b8b7cf480f92f3afa67bd5e62d5b6c579e4c6251"}
Jul 17 04:51:19.506023 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.506006    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7" event={"ID":"0d993fee-35d5-44ee-a130-69e06e36c348","Type":"ContainerStarted","Data":"d702834b4de23a6e405ffccb4f61271c7ab6d713a05ac529475b1eeef0071d80"}
Jul 17 04:51:19.507741 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.507020    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:51:19.509086 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.508721    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-7fbkb"
Jul 17 04:51:19.509086 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.509038    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t64kc" event={"ID":"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06","Type":"ContainerStarted","Data":"46abd9f2f6af49529517beefda05899ccf2af6b8beeb0a9068a3b35ef28fc3de"}
Jul 17 04:51:19.544752 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.544281    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-7fbkb" podStartSLOduration=1.939165414 podStartE2EDuration="23.544255957s" totalImagesPullingTime="21.605090543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:51:19.519359833 +0000 UTC m=+114.196966180" watchObservedRunningTime="2026-07-17 04:51:19.544255957 +0000 UTC m=+114.221862303"
Jul 17 04:51:19.567696 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.566659    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7" podStartSLOduration=112.566620467 podStartE2EDuration="1m52.566620467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:49:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:51:19.54458743 +0000 UTC m=+114.222193791" watchObservedRunningTime="2026-07-17 04:51:19.566620467 +0000 UTC m=+114.244226816"
Jul 17 04:51:19.588783 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.587501    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fdf5b455d-xbmlv" podStartSLOduration=7.735592553 podStartE2EDuration="22.587476426s" totalImagesPullingTime="14.851883873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:51:19.585389196 +0000 UTC m=+114.262995543" watchObservedRunningTime="2026-07-17 04:51:19.587476426 +0000 UTC m=+114.265082773"
Jul 17 04:51:19.774740 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.774649    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:19.831186 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:19.831025    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:20.058677 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:20.058620    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:20.160918 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:20.160709    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:20.259240 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:20.259173    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:20.398833 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:20.398681    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:21.480563 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:21.480518    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:21.535368 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:21.535277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:21.876791 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:21.876385    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:21.938883 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:21.938850    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:22.084848 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:22.084807    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:22.175127 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:22.175043    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:23.375800 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:23.375684    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:25.541827 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:25.541784    2564 generic.go:356] "Generic (PLEG): container finished" podID="cc280032-e0dc-48ed-b5a3-cfebbf0a02e7" containerID="00ca27ba270166471a7cedd20faf0e60f669b0111cc5da2204ccc9499b625cd7" exitCode=0
Jul 17 04:51:25.542373 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:25.541888    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m456p" event={"ID":"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7","Type":"ContainerDied","Data":"00ca27ba270166471a7cedd20faf0e60f669b0111cc5da2204ccc9499b625cd7"}
Jul 17 04:51:25.545249 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:25.544708    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p5n24" event={"ID":"702ad1b9-6061-4808-9fe6-721eee836531","Type":"ContainerStarted","Data":"018e28636bdc9753f7f183aaf49a85d92fe2efcb024cf28c62c2dfd646f97710"}
Jul 17 04:51:25.545249 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:25.544771    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p5n24" event={"ID":"702ad1b9-6061-4808-9fe6-721eee836531","Type":"ContainerStarted","Data":"c6d71f4a24f65cb71f74ac21e4a8bd616feddfa4efff93fb592bbb40644c8c69"}
Jul 17 04:51:25.545249 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:25.545102    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p5n24"
Jul 17 04:51:25.547038 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:25.547013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t64kc" event={"ID":"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06","Type":"ContainerStarted","Data":"797a4d7afdd07e67652ebcc809aa25590ada6416196a03fd60f6c99133a4ff17"}
Jul 17 04:51:25.576549 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:25.576470    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-p5n24" podStartSLOduration=78.469781784 podStartE2EDuration="1m24.576448212s" totalImagesPullingTime="6.106666428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:51:25.574155962 +0000 UTC m=+120.251762308" watchObservedRunningTime="2026-07-17 04:51:25.576448212 +0000 UTC m=+120.254054560"
Jul 17 04:51:26.334821 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:26.334771    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:26.556400 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:26.556353    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m456p" event={"ID":"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7","Type":"ContainerStarted","Data":"ce89c0812fa64d18157ab75808970973c6e33bb6b01af5a150fda8b396f39cca"}
Jul 17 04:51:26.557067 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:26.556540    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m456p" event={"ID":"cc280032-e0dc-48ed-b5a3-cfebbf0a02e7","Type":"ContainerStarted","Data":"7ec1394c44e3b7edd634c9bca26e665e07c254d8485cc80f19945cbdba14f860"}
Jul 17 04:51:26.578430 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:26.578370    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m456p" podStartSLOduration=3.64047425 podStartE2EDuration="9.578349613s" totalImagesPullingTime="5.828748133s" totalInitContainerRuntime="109.12723ms" isStatefulPod=true podCreationTimestamp="2026-07-17 04:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:51:26.575994297 +0000 UTC m=+121.253600655" watchObservedRunningTime="2026-07-17 04:51:26.578349613 +0000 UTC m=+121.255955961"
Jul 17 04:51:27.476834 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:27.476792    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:27.535349 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:27.535308    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:28.147611 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:28.147520    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:28.248354 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:28.248307    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:28.326851 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:28.326804    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:51:30.576223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:30.576186    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t64kc" event={"ID":"8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06","Type":"ContainerStarted","Data":"bd6bba34db26283b784eaeed8418c039ecf45e387bef6fb4f5f0685bad37c6c3"}
Jul 17 04:51:30.595920 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:30.595862    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t64kc" podStartSLOduration=33.695618025 podStartE2EDuration="59.595843353s" totalImagesPullingTime="25.900225328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 04:50:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:51:30.594566546 +0000 UTC m=+125.272172891" watchObservedRunningTime="2026-07-17 04:51:30.595843353 +0000 UTC m=+125.273449698"
Jul 17 04:51:32.539694 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:32.539657    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:32.641938 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:32.641897    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:32.743349 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:32.743309    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:35.596878 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:35.596847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs\") pod \"network-metrics-daemon-hfzzb\" (UID: \"17c170e0-f040-42d6-9047-9afaa449d88e\") " pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:51:35.599254 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:35.599232    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17c170e0-f040-42d6-9047-9afaa449d88e-metrics-certs\") pod \"network-metrics-daemon-hfzzb\" (UID: \"17c170e0-f040-42d6-9047-9afaa449d88e\") " pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:51:35.866574 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:35.866500    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zwbtr\""
Jul 17 04:51:35.874666 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:35.874644    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfzzb"
Jul 17 04:51:36.042038 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:36.041918    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hfzzb"]
Jul 17 04:51:36.044582 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:51:36.044550    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c170e0_f040_42d6_9047_9afaa449d88e.slice/crio-5dff10a316eba5186341d2822bc71944aab551fc76b5ae0e37384b205b5347f4 WatchSource:0}: Error finding container 5dff10a316eba5186341d2822bc71944aab551fc76b5ae0e37384b205b5347f4: Status 404 returned error can't find the container with id 5dff10a316eba5186341d2822bc71944aab551fc76b5ae0e37384b205b5347f4
Jul 17 04:51:36.563780 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:36.563748    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p5n24"
Jul 17 04:51:36.600911 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:36.600877    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hfzzb" event={"ID":"17c170e0-f040-42d6-9047-9afaa449d88e","Type":"ContainerStarted","Data":"5dff10a316eba5186341d2822bc71944aab551fc76b5ae0e37384b205b5347f4"}
Jul 17 04:51:38.609831 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:38.609792    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hfzzb" event={"ID":"17c170e0-f040-42d6-9047-9afaa449d88e","Type":"ContainerStarted","Data":"b16b5ebb50093a80be7fdcaac38abed6c2d20fafbc5337824946573b53db0eb2"}
Jul 17 04:51:38.610321 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:38.609846    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hfzzb" event={"ID":"17c170e0-f040-42d6-9047-9afaa449d88e","Type":"ContainerStarted","Data":"7e6aed38ea80f43e70bdaa2241d719ef02b0c26621841a329a4c948dc56667db"}
Jul 17 04:51:38.626297 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:38.626250    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hfzzb" podStartSLOduration=130.943790776 podStartE2EDuration="2m12.626234425s" totalImagesPullingTime="1.682443649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:51:38.62419252 +0000 UTC m=+133.301798879" watchObservedRunningTime="2026-07-17 04:51:38.626234425 +0000 UTC m=+133.303840770"
Jul 17 04:51:38.721668 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:38.721621    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:38.822120 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:38.822090    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:38.877104 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:38.877010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:40.524006 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:40.523973    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:51:42.475237 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:42.475202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:42.526448 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:42.526413    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:44.534216 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:44.534173    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fdf5b455d-xbmlv" podUID="d250d15d-45c0-4da7-a230-16cde0aa003b" containerName="console" containerID="cri-o://8a1c915ba818e952a5aa740d46751e7ee5e13206c54443bb72c60a4434f67905" gracePeriod=15
Jul 17 04:51:44.818417 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:44.818380    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:51:44.983883 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:44.983851    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-console-config\") pod \"d250d15d-45c0-4da7-a230-16cde0aa003b\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") "
Jul 17 04:51:44.984087 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:44.983899    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-service-ca\") pod \"d250d15d-45c0-4da7-a230-16cde0aa003b\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") "
Jul 17 04:51:44.984087 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:44.983925    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjs5n\" (UniqueName: \"kubernetes.io/projected/d250d15d-45c0-4da7-a230-16cde0aa003b-kube-api-access-sjs5n\") pod \"d250d15d-45c0-4da7-a230-16cde0aa003b\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") "
Jul 17 04:51:44.984087 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:44.983954    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d250d15d-45c0-4da7-a230-16cde0aa003b-console-oauth-config\") pod \"d250d15d-45c0-4da7-a230-16cde0aa003b\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") "
Jul 17 04:51:44.984087 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:44.984003    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d250d15d-45c0-4da7-a230-16cde0aa003b-console-serving-cert\") pod \"d250d15d-45c0-4da7-a230-16cde0aa003b\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") "
Jul 17 04:51:44.984087 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:44.984021    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-oauth-serving-cert\") pod \"d250d15d-45c0-4da7-a230-16cde0aa003b\" (UID: \"d250d15d-45c0-4da7-a230-16cde0aa003b\") "
Jul 17 04:51:44.984456 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:44.984414    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-service-ca" (OuterVolumeSpecName: "service-ca") pod "d250d15d-45c0-4da7-a230-16cde0aa003b" (UID: "d250d15d-45c0-4da7-a230-16cde0aa003b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 04:51:44.984554 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:44.984419    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-console-config" (OuterVolumeSpecName: "console-config") pod "d250d15d-45c0-4da7-a230-16cde0aa003b" (UID: "d250d15d-45c0-4da7-a230-16cde0aa003b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 04:51:44.984554 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:44.984499    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d250d15d-45c0-4da7-a230-16cde0aa003b" (UID: "d250d15d-45c0-4da7-a230-16cde0aa003b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 04:51:44.986453 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:44.986425    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d250d15d-45c0-4da7-a230-16cde0aa003b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d250d15d-45c0-4da7-a230-16cde0aa003b" (UID: "d250d15d-45c0-4da7-a230-16cde0aa003b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 04:51:44.986542 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:44.986476    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d250d15d-45c0-4da7-a230-16cde0aa003b-kube-api-access-sjs5n" (OuterVolumeSpecName: "kube-api-access-sjs5n") pod "d250d15d-45c0-4da7-a230-16cde0aa003b" (UID: "d250d15d-45c0-4da7-a230-16cde0aa003b"). InnerVolumeSpecName "kube-api-access-sjs5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:51:44.986542 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:44.986495    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d250d15d-45c0-4da7-a230-16cde0aa003b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d250d15d-45c0-4da7-a230-16cde0aa003b" (UID: "d250d15d-45c0-4da7-a230-16cde0aa003b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 04:51:45.084848 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.084805    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-service-ca\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:51:45.084848 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.084837    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjs5n\" (UniqueName: \"kubernetes.io/projected/d250d15d-45c0-4da7-a230-16cde0aa003b-kube-api-access-sjs5n\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:51:45.084848 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.084846    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d250d15d-45c0-4da7-a230-16cde0aa003b-console-oauth-config\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:51:45.084848 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.084855    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d250d15d-45c0-4da7-a230-16cde0aa003b-console-serving-cert\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:51:45.084848 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.084864    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-oauth-serving-cert\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:51:45.085173 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.084871    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d250d15d-45c0-4da7-a230-16cde0aa003b-console-config\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:51:45.551746 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.551653    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7" podUID="0d993fee-35d5-44ee-a130-69e06e36c348" containerName="registry" containerID="cri-o://ad6ee56ce93f425bd40c73c9b8b7cf480f92f3afa67bd5e62d5b6c579e4c6251" gracePeriod=30
Jul 17 04:51:45.636197 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.636157    2564 generic.go:356] "Generic (PLEG): container finished" podID="d250d15d-45c0-4da7-a230-16cde0aa003b" containerID="8a1c915ba818e952a5aa740d46751e7ee5e13206c54443bb72c60a4434f67905" exitCode=0
Jul 17 04:51:45.636354 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.636207    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdf5b455d-xbmlv"
Jul 17 04:51:45.636354 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.636245    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdf5b455d-xbmlv" event={"ID":"d250d15d-45c0-4da7-a230-16cde0aa003b","Type":"ContainerDied","Data":"8a1c915ba818e952a5aa740d46751e7ee5e13206c54443bb72c60a4434f67905"}
Jul 17 04:51:45.636354 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.636298    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdf5b455d-xbmlv" event={"ID":"d250d15d-45c0-4da7-a230-16cde0aa003b","Type":"ContainerDied","Data":"db54f3106d37c0bcd1fd46d0c9e202125135329c379a5998a87f06c3b5dcc112"}
Jul 17 04:51:45.636354 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.636321    2564 scope.go:117] "RemoveContainer" containerID="8a1c915ba818e952a5aa740d46751e7ee5e13206c54443bb72c60a4434f67905"
Jul 17 04:51:45.656149 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.656122    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fdf5b455d-xbmlv"]
Jul 17 04:51:45.661276 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.661245    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fdf5b455d-xbmlv"]
Jul 17 04:51:45.662722 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.662693    2564 scope.go:117] "RemoveContainer" containerID="8a1c915ba818e952a5aa740d46751e7ee5e13206c54443bb72c60a4434f67905"
Jul 17 04:51:45.663041 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:51:45.663015    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a1c915ba818e952a5aa740d46751e7ee5e13206c54443bb72c60a4434f67905\": container with ID starting with 8a1c915ba818e952a5aa740d46751e7ee5e13206c54443bb72c60a4434f67905 not found: ID does not exist" containerID="8a1c915ba818e952a5aa740d46751e7ee5e13206c54443bb72c60a4434f67905"
Jul 17 04:51:45.663099 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.663044    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a1c915ba818e952a5aa740d46751e7ee5e13206c54443bb72c60a4434f67905"} err="failed to get container status \"8a1c915ba818e952a5aa740d46751e7ee5e13206c54443bb72c60a4434f67905\": rpc error: code = NotFound desc = could not find container \"8a1c915ba818e952a5aa740d46751e7ee5e13206c54443bb72c60a4434f67905\": container with ID starting with 8a1c915ba818e952a5aa740d46751e7ee5e13206c54443bb72c60a4434f67905 not found: ID does not exist"
Jul 17 04:51:45.681658 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.681605    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:45.738644 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.738596    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:45.856114 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.856085    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:51:45.856306 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.856091    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d250d15d-45c0-4da7-a230-16cde0aa003b" path="/var/lib/kubelet/pods/d250d15d-45c0-4da7-a230-16cde0aa003b/volumes"
Jul 17 04:51:45.890470 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.890442    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls\") pod \"0d993fee-35d5-44ee-a130-69e06e36c348\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") "
Jul 17 04:51:45.890666 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.890477    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d993fee-35d5-44ee-a130-69e06e36c348-registry-certificates\") pod \"0d993fee-35d5-44ee-a130-69e06e36c348\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") "
Jul 17 04:51:45.890666 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.890498    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-bound-sa-token\") pod \"0d993fee-35d5-44ee-a130-69e06e36c348\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") "
Jul 17 04:51:45.890666 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.890521    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d993fee-35d5-44ee-a130-69e06e36c348-image-registry-private-configuration\") pod \"0d993fee-35d5-44ee-a130-69e06e36c348\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") "
Jul 17 04:51:45.890666 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.890551    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lpds\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-kube-api-access-8lpds\") pod \"0d993fee-35d5-44ee-a130-69e06e36c348\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") "
Jul 17 04:51:45.890666 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.890616    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d993fee-35d5-44ee-a130-69e06e36c348-ca-trust-extracted\") pod \"0d993fee-35d5-44ee-a130-69e06e36c348\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") "
Jul 17 04:51:45.890981 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.890676    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d993fee-35d5-44ee-a130-69e06e36c348-trusted-ca\") pod \"0d993fee-35d5-44ee-a130-69e06e36c348\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") "
Jul 17 04:51:45.890981 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.890709    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d993fee-35d5-44ee-a130-69e06e36c348-installation-pull-secrets\") pod \"0d993fee-35d5-44ee-a130-69e06e36c348\" (UID: \"0d993fee-35d5-44ee-a130-69e06e36c348\") "
Jul 17 04:51:45.890981 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.890839    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d993fee-35d5-44ee-a130-69e06e36c348-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0d993fee-35d5-44ee-a130-69e06e36c348" (UID: "0d993fee-35d5-44ee-a130-69e06e36c348"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 04:51:45.891137 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.891042    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d993fee-35d5-44ee-a130-69e06e36c348-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0d993fee-35d5-44ee-a130-69e06e36c348" (UID: "0d993fee-35d5-44ee-a130-69e06e36c348"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 04:51:45.893443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.893390    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0d993fee-35d5-44ee-a130-69e06e36c348" (UID: "0d993fee-35d5-44ee-a130-69e06e36c348"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:51:45.893842 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.893783    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d993fee-35d5-44ee-a130-69e06e36c348-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0d993fee-35d5-44ee-a130-69e06e36c348" (UID: "0d993fee-35d5-44ee-a130-69e06e36c348"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 04:51:45.893842 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.893822    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0d993fee-35d5-44ee-a130-69e06e36c348" (UID: "0d993fee-35d5-44ee-a130-69e06e36c348"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:51:45.893978 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.893877    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d993fee-35d5-44ee-a130-69e06e36c348-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0d993fee-35d5-44ee-a130-69e06e36c348" (UID: "0d993fee-35d5-44ee-a130-69e06e36c348"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 04:51:45.893978 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.893907    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-kube-api-access-8lpds" (OuterVolumeSpecName: "kube-api-access-8lpds") pod "0d993fee-35d5-44ee-a130-69e06e36c348" (UID: "0d993fee-35d5-44ee-a130-69e06e36c348"). InnerVolumeSpecName "kube-api-access-8lpds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:51:45.900051 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.900027    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d993fee-35d5-44ee-a130-69e06e36c348-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0d993fee-35d5-44ee-a130-69e06e36c348" (UID: "0d993fee-35d5-44ee-a130-69e06e36c348"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:51:45.992093 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.992058    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d993fee-35d5-44ee-a130-69e06e36c348-ca-trust-extracted\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:51:45.992093 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.992087    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d993fee-35d5-44ee-a130-69e06e36c348-trusted-ca\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:51:45.992093 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.992096    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d993fee-35d5-44ee-a130-69e06e36c348-installation-pull-secrets\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:51:45.992093 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.992106    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-registry-tls\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:51:45.992355 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.992117    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d993fee-35d5-44ee-a130-69e06e36c348-registry-certificates\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:51:45.992355 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.992125    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-bound-sa-token\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:51:45.992355 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.992135    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d993fee-35d5-44ee-a130-69e06e36c348-image-registry-private-configuration\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:51:45.992355 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:45.992143    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lpds\" (UniqueName: \"kubernetes.io/projected/0d993fee-35d5-44ee-a130-69e06e36c348-kube-api-access-8lpds\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:51:46.641558 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:46.641523    2564 generic.go:356] "Generic (PLEG): container finished" podID="0d993fee-35d5-44ee-a130-69e06e36c348" containerID="ad6ee56ce93f425bd40c73c9b8b7cf480f92f3afa67bd5e62d5b6c579e4c6251" exitCode=0
Jul 17 04:51:46.642086 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:46.641582    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7" event={"ID":"0d993fee-35d5-44ee-a130-69e06e36c348","Type":"ContainerDied","Data":"ad6ee56ce93f425bd40c73c9b8b7cf480f92f3afa67bd5e62d5b6c579e4c6251"}
Jul 17 04:51:46.642086 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:46.641600    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7"
Jul 17 04:51:46.642086 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:46.641667    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ccbf75cf7-m72x7" event={"ID":"0d993fee-35d5-44ee-a130-69e06e36c348","Type":"ContainerDied","Data":"d702834b4de23a6e405ffccb4f61271c7ab6d713a05ac529475b1eeef0071d80"}
Jul 17 04:51:46.642086 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:46.641688    2564 scope.go:117] "RemoveContainer" containerID="ad6ee56ce93f425bd40c73c9b8b7cf480f92f3afa67bd5e62d5b6c579e4c6251"
Jul 17 04:51:46.654401 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:46.654383    2564 scope.go:117] "RemoveContainer" containerID="ad6ee56ce93f425bd40c73c9b8b7cf480f92f3afa67bd5e62d5b6c579e4c6251"
Jul 17 04:51:46.654841 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:51:46.654819    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad6ee56ce93f425bd40c73c9b8b7cf480f92f3afa67bd5e62d5b6c579e4c6251\": container with ID starting with ad6ee56ce93f425bd40c73c9b8b7cf480f92f3afa67bd5e62d5b6c579e4c6251 not found: ID does not exist" containerID="ad6ee56ce93f425bd40c73c9b8b7cf480f92f3afa67bd5e62d5b6c579e4c6251"
Jul 17 04:51:46.654911 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:46.654849    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad6ee56ce93f425bd40c73c9b8b7cf480f92f3afa67bd5e62d5b6c579e4c6251"} err="failed to get container status \"ad6ee56ce93f425bd40c73c9b8b7cf480f92f3afa67bd5e62d5b6c579e4c6251\": rpc error: code = NotFound desc = could not find container \"ad6ee56ce93f425bd40c73c9b8b7cf480f92f3afa67bd5e62d5b6c579e4c6251\": container with ID starting with ad6ee56ce93f425bd40c73c9b8b7cf480f92f3afa67bd5e62d5b6c579e4c6251 not found: ID does not exist"
Jul 17 04:51:46.662055 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:46.662030    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ccbf75cf7-m72x7"]
Jul 17 04:51:46.667647 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:46.667608    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6ccbf75cf7-m72x7"]
Jul 17 04:51:47.856272 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:47.856239    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d993fee-35d5-44ee-a130-69e06e36c348" path="/var/lib/kubelet/pods/0d993fee-35d5-44ee-a130-69e06e36c348/volumes"
Jul 17 04:51:49.917455 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:49.917415    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:50.018511 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:50.018471    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:50.072477 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:50.072439    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:51:51.662380 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:51.662343    2564 generic.go:356] "Generic (PLEG): container finished" podID="c8ccedfa-df6a-411e-94a2-08dfea8e7bf8" containerID="58c0caf446129daa9682bb98cbbe5fe62e1a3cdbe9a7a9a0f955a340dc48a9b3" exitCode=0
Jul 17 04:51:51.662788 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:51.662407    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt" event={"ID":"c8ccedfa-df6a-411e-94a2-08dfea8e7bf8","Type":"ContainerDied","Data":"58c0caf446129daa9682bb98cbbe5fe62e1a3cdbe9a7a9a0f955a340dc48a9b3"}
Jul 17 04:51:51.662788 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:51.662754    2564 scope.go:117] "RemoveContainer" containerID="58c0caf446129daa9682bb98cbbe5fe62e1a3cdbe9a7a9a0f955a340dc48a9b3"
Jul 17 04:51:52.668151 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:52.668117    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-svwgt" event={"ID":"c8ccedfa-df6a-411e-94a2-08dfea8e7bf8","Type":"ContainerStarted","Data":"479a25b3dbe82bc9dfb1ef0d4498df01750a69d97172319644a7c5a560295008"}
Jul 17 04:51:56.683238 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:56.683154    2564 generic.go:356] "Generic (PLEG): container finished" podID="217df4f8-8a0e-4805-8af7-6e122bfd7497" containerID="2f554bc2d3df3d24209429f718b6c27789a6165dbfa723755f3c14efa63e53e4" exitCode=0
Jul 17 04:51:56.683606 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:56.683232    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk" event={"ID":"217df4f8-8a0e-4805-8af7-6e122bfd7497","Type":"ContainerDied","Data":"2f554bc2d3df3d24209429f718b6c27789a6165dbfa723755f3c14efa63e53e4"}
Jul 17 04:51:56.683606 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:56.683544    2564 scope.go:117] "RemoveContainer" containerID="2f554bc2d3df3d24209429f718b6c27789a6165dbfa723755f3c14efa63e53e4"
Jul 17 04:51:57.689379 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:51:57.689338    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4xxjk" event={"ID":"217df4f8-8a0e-4805-8af7-6e122bfd7497","Type":"ContainerStarted","Data":"816e2d71b3214a042b2c83ce938a9524ff5e6e03cb51f616250dfed0ec8dfff9"}
Jul 17 04:52:01.705457 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:01.705423    2564 generic.go:356] "Generic (PLEG): container finished" podID="323c73c7-3605-42f0-9ff2-57de004ce286" containerID="bc68a09e79f09e35b34c4a4b67772badf0549b5e6cce6f6d9262c13038ef9fd2" exitCode=0
Jul 17 04:52:01.705909 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:01.705475    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-665g2" event={"ID":"323c73c7-3605-42f0-9ff2-57de004ce286","Type":"ContainerDied","Data":"bc68a09e79f09e35b34c4a4b67772badf0549b5e6cce6f6d9262c13038ef9fd2"}
Jul 17 04:52:01.705909 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:01.705843    2564 scope.go:117] "RemoveContainer" containerID="bc68a09e79f09e35b34c4a4b67772badf0549b5e6cce6f6d9262c13038ef9fd2"
Jul 17 04:52:02.711831 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:02.711799    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-665g2" event={"ID":"323c73c7-3605-42f0-9ff2-57de004ce286","Type":"ContainerStarted","Data":"2844bdd44cea94f8bf18a1dde2cf86bc80ce294d869f3353c4f5d25b87a0f681"}
Jul 17 04:52:36.330754 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:36.330701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:52:36.432058 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:36.432020    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:52:36.485007 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:36.484966    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:52:41.416751 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.416706    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-844877ccdd-qj7dw"]
Jul 17 04:52:41.417174 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.417002    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d993fee-35d5-44ee-a130-69e06e36c348" containerName="registry"
Jul 17 04:52:41.417174 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.417013    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d993fee-35d5-44ee-a130-69e06e36c348" containerName="registry"
Jul 17 04:52:41.417174 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.417023    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d250d15d-45c0-4da7-a230-16cde0aa003b" containerName="console"
Jul 17 04:52:41.417174 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.417029    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d250d15d-45c0-4da7-a230-16cde0aa003b" containerName="console"
Jul 17 04:52:41.417174 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.417076    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d993fee-35d5-44ee-a130-69e06e36c348" containerName="registry"
Jul 17 04:52:41.417174 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.417084    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d250d15d-45c0-4da7-a230-16cde0aa003b" containerName="console"
Jul 17 04:52:41.420597 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.420571    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.423069 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.423038    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 17 04:52:41.423069 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.423052    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 17 04:52:41.423291 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.423171    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 17 04:52:41.423291 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.423213    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-tz5vx\""
Jul 17 04:52:41.423396 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.423306    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 17 04:52:41.423604 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.423587    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 17 04:52:41.428018 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.427816    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 17 04:52:41.429840 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.429815    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-844877ccdd-qj7dw"]
Jul 17 04:52:41.541123 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.541084    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22b6f2f5-4e52-491b-8340-78ab30c1e791-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.541123 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.541125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22b6f2f5-4e52-491b-8340-78ab30c1e791-telemeter-trusted-ca-bundle\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.541430 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.541162    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpdw4\" (UniqueName: \"kubernetes.io/projected/22b6f2f5-4e52-491b-8340-78ab30c1e791-kube-api-access-fpdw4\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.541430 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.541233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/22b6f2f5-4e52-491b-8340-78ab30c1e791-secret-telemeter-client\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.541430 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.541269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22b6f2f5-4e52-491b-8340-78ab30c1e791-serving-certs-ca-bundle\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.541430 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.541298    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/22b6f2f5-4e52-491b-8340-78ab30c1e791-federate-client-tls\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.541430 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.541315    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22b6f2f5-4e52-491b-8340-78ab30c1e791-metrics-client-ca\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.541430 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.541338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/22b6f2f5-4e52-491b-8340-78ab30c1e791-telemeter-client-tls\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.642383 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.642343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpdw4\" (UniqueName: \"kubernetes.io/projected/22b6f2f5-4e52-491b-8340-78ab30c1e791-kube-api-access-fpdw4\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.642383 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.642389    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/22b6f2f5-4e52-491b-8340-78ab30c1e791-secret-telemeter-client\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.642611 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.642406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22b6f2f5-4e52-491b-8340-78ab30c1e791-serving-certs-ca-bundle\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.642611 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.642434    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/22b6f2f5-4e52-491b-8340-78ab30c1e791-federate-client-tls\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.642611 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.642453    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22b6f2f5-4e52-491b-8340-78ab30c1e791-metrics-client-ca\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.642611 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.642568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/22b6f2f5-4e52-491b-8340-78ab30c1e791-telemeter-client-tls\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.642842 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.642660    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22b6f2f5-4e52-491b-8340-78ab30c1e791-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.642842 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.642701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22b6f2f5-4e52-491b-8340-78ab30c1e791-telemeter-trusted-ca-bundle\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.643326 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.643296    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22b6f2f5-4e52-491b-8340-78ab30c1e791-metrics-client-ca\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.643531 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.643497    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22b6f2f5-4e52-491b-8340-78ab30c1e791-serving-certs-ca-bundle\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.643788 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.643764    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22b6f2f5-4e52-491b-8340-78ab30c1e791-telemeter-trusted-ca-bundle\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.645154 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.645131    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/22b6f2f5-4e52-491b-8340-78ab30c1e791-federate-client-tls\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.645259 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.645178    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22b6f2f5-4e52-491b-8340-78ab30c1e791-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.645618 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.645594    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/22b6f2f5-4e52-491b-8340-78ab30c1e791-secret-telemeter-client\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.645700 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.645614    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/22b6f2f5-4e52-491b-8340-78ab30c1e791-telemeter-client-tls\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.650424 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.650400    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpdw4\" (UniqueName: \"kubernetes.io/projected/22b6f2f5-4e52-491b-8340-78ab30c1e791-kube-api-access-fpdw4\") pod \"telemeter-client-844877ccdd-qj7dw\" (UID: \"22b6f2f5-4e52-491b-8340-78ab30c1e791\") " pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.732265 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.732172    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw"
Jul 17 04:52:41.873578 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:41.873552    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-844877ccdd-qj7dw"]
Jul 17 04:52:41.876202 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:52:41.876167    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22b6f2f5_4e52_491b_8340_78ab30c1e791.slice/crio-bc0915a85ea93b37a345eb6e01f2be253ff002dbee7ee44a37b3dcb882c2b2a1 WatchSource:0}: Error finding container bc0915a85ea93b37a345eb6e01f2be253ff002dbee7ee44a37b3dcb882c2b2a1: Status 404 returned error can't find the container with id bc0915a85ea93b37a345eb6e01f2be253ff002dbee7ee44a37b3dcb882c2b2a1
Jul 17 04:52:42.864207 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:42.864157    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw" event={"ID":"22b6f2f5-4e52-491b-8340-78ab30c1e791","Type":"ContainerStarted","Data":"bc0915a85ea93b37a345eb6e01f2be253ff002dbee7ee44a37b3dcb882c2b2a1"}
Jul 17 04:52:44.872819 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:44.872774    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw" event={"ID":"22b6f2f5-4e52-491b-8340-78ab30c1e791","Type":"ContainerStarted","Data":"06792105429d1a59c6c95cdb58c2360506266cac8e5e2f11a8152af63fbbcff8"}
Jul 17 04:52:45.878322 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:45.878288    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw" event={"ID":"22b6f2f5-4e52-491b-8340-78ab30c1e791","Type":"ContainerStarted","Data":"d1f0a3f951594b49bf8c0d8a8f60542e1c60caae4e5b215d21b0ba0ddfdef560"}
Jul 17 04:52:45.878723 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:45.878343    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw" event={"ID":"22b6f2f5-4e52-491b-8340-78ab30c1e791","Type":"ContainerStarted","Data":"b6962304ba0ea034a771bc923c44f95f3244a2e09bf0a00d37dd4c4b71c8c4b9"}
Jul 17 04:52:45.903992 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:45.903854    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-844877ccdd-qj7dw" podStartSLOduration=1.969826812 podStartE2EDuration="4.903832317s" totalImagesPullingTime="2.934005505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:52:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:52:45.902744691 +0000 UTC m=+200.580351043" watchObservedRunningTime="2026-07-17 04:52:45.903832317 +0000 UTC m=+200.581438662"
Jul 17 04:52:46.610722 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.610677    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bcc9cf55-xmwx7"]
Jul 17 04:52:46.613144 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.613122    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.616186 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.616153    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 17 04:52:46.616705 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.616596    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 17 04:52:46.618819 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.617704    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 17 04:52:46.618819 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.618114    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 17 04:52:46.618819 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.618510    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hq762\""
Jul 17 04:52:46.618819 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.618562    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 17 04:52:46.627242 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.627211    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 17 04:52:46.627867 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.627769    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcc9cf55-xmwx7"]
Jul 17 04:52:46.677313 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.677280    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-console-config\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.677313 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.677314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-oauth-serving-cert\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.677524 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.677337    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be8db403-0407-43ea-bdad-bafc57492951-console-oauth-config\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.677524 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.677354    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-service-ca\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.677524 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.677428    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be8db403-0407-43ea-bdad-bafc57492951-console-serving-cert\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.677524 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.677490    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwxj4\" (UniqueName: \"kubernetes.io/projected/be8db403-0407-43ea-bdad-bafc57492951-kube-api-access-kwxj4\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.677524 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.677511    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-trusted-ca-bundle\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.682939 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.682909    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:52:46.735638 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.735588    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:52:46.778060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.778030    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-console-config\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.778060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.778062    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-oauth-serving-cert\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.778295 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.778081    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be8db403-0407-43ea-bdad-bafc57492951-console-oauth-config\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.778295 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.778215    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-service-ca\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.778295 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.778280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be8db403-0407-43ea-bdad-bafc57492951-console-serving-cert\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.778444 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.778380    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwxj4\" (UniqueName: \"kubernetes.io/projected/be8db403-0407-43ea-bdad-bafc57492951-kube-api-access-kwxj4\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.778444 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.778427    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-trusted-ca-bundle\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.778880 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.778858    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-console-config\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.779171 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.779150    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-oauth-serving-cert\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.779296 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.779273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-service-ca\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.779622 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.779602    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-trusted-ca-bundle\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.780693 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.780672    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be8db403-0407-43ea-bdad-bafc57492951-console-oauth-config\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.781016 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.781001    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be8db403-0407-43ea-bdad-bafc57492951-console-serving-cert\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.785727 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.785710    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwxj4\" (UniqueName: \"kubernetes.io/projected/be8db403-0407-43ea-bdad-bafc57492951-kube-api-access-kwxj4\") pod \"console-7bcc9cf55-xmwx7\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") " pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:46.815534 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.815495    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:52:46.893995 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.893897    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:52:46.927931 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:46.927892    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:47.071006 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:47.070919    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcc9cf55-xmwx7"]
Jul 17 04:52:47.074648 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:52:47.074603    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe8db403_0407_43ea_bdad_bafc57492951.slice/crio-9bb0528a8035838b7880b59a1db487aeee3c26a3415a0554725fdac03521e6c5 WatchSource:0}: Error finding container 9bb0528a8035838b7880b59a1db487aeee3c26a3415a0554725fdac03521e6c5: Status 404 returned error can't find the container with id 9bb0528a8035838b7880b59a1db487aeee3c26a3415a0554725fdac03521e6c5
Jul 17 04:52:47.407179 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:47.407143    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:52:47.476085 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:47.476049    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:52:47.887184 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:47.887149    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcc9cf55-xmwx7" event={"ID":"be8db403-0407-43ea-bdad-bafc57492951","Type":"ContainerStarted","Data":"737f3e9e97f0aa26f158fcf75a1342fb0bb145624918c686b1289ed2b7574b3c"}
Jul 17 04:52:47.887360 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:47.887196    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcc9cf55-xmwx7" event={"ID":"be8db403-0407-43ea-bdad-bafc57492951","Type":"ContainerStarted","Data":"9bb0528a8035838b7880b59a1db487aeee3c26a3415a0554725fdac03521e6c5"}
Jul 17 04:52:47.904582 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:47.904531    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bcc9cf55-xmwx7" podStartSLOduration=1.904513992 podStartE2EDuration="1.904513992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:52:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:52:47.903659366 +0000 UTC m=+202.581265713" watchObservedRunningTime="2026-07-17 04:52:47.904513992 +0000 UTC m=+202.582120337"
Jul 17 04:52:51.553326 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:51.553284    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:52:51.607158 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:51.607124    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:52:56.929002 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:56.928957    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:56.929657 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:56.929057    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:56.934010 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:56.933979    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:57.933331 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:57.933287    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:52:58.048715 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.048674    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b9cb6c7c7-wgq8l"]
Jul 17 04:52:58.051049 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.051023    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.060540 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.060509    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-trusted-ca-bundle\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.060732 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.060555    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-console-serving-cert\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.060732 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.060589    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-service-ca\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.060732 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.060719    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-oauth-serving-cert\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.060892 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.060751    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv5lz\" (UniqueName: \"kubernetes.io/projected/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-kube-api-access-wv5lz\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.060892 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.060811    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-console-config\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.060892 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.060848    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-console-oauth-config\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.061459 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.061438    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b9cb6c7c7-wgq8l"]
Jul 17 04:52:58.161402 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.161354    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-console-config\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.161402 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.161405    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-console-oauth-config\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.161708 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.161492    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-trusted-ca-bundle\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.161708 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.161521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-console-serving-cert\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.161708 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.161551    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-service-ca\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.161708 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.161577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-oauth-serving-cert\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.161708 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.161600    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv5lz\" (UniqueName: \"kubernetes.io/projected/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-kube-api-access-wv5lz\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.162278 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.162225    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-console-config\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.162531 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.162337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-service-ca\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.162531 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.162337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-oauth-serving-cert\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.162531 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.162376    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-trusted-ca-bundle\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.164277 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.164252    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-console-oauth-config\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.164359 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.164293    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-console-serving-cert\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.171759 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.171729    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv5lz\" (UniqueName: \"kubernetes.io/projected/94fc73fa-b0ee-4010-a3ae-fd6c8e30e647-kube-api-access-wv5lz\") pod \"console-5b9cb6c7c7-wgq8l\" (UID: \"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647\") " pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.363080 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.363045    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:52:58.427594 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.427506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:52:58.508685 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.508659    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b9cb6c7c7-wgq8l"]
Jul 17 04:52:58.511163 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:52:58.511126    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94fc73fa_b0ee_4010_a3ae_fd6c8e30e647.slice/crio-8dabd1603ea9d0169cc6ee0eefae97d830838c094ab9afa34d2bd6354a622b40 WatchSource:0}: Error finding container 8dabd1603ea9d0169cc6ee0eefae97d830838c094ab9afa34d2bd6354a622b40: Status 404 returned error can't find the container with id 8dabd1603ea9d0169cc6ee0eefae97d830838c094ab9afa34d2bd6354a622b40
Jul 17 04:52:58.935332 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.935289    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9cb6c7c7-wgq8l" event={"ID":"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647","Type":"ContainerStarted","Data":"4c21b0f00726b660f637b0926b7cd8a591ee9d94f5db7f6812899346676cc7c0"}
Jul 17 04:52:58.935752 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.935345    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9cb6c7c7-wgq8l" event={"ID":"94fc73fa-b0ee-4010-a3ae-fd6c8e30e647","Type":"ContainerStarted","Data":"8dabd1603ea9d0169cc6ee0eefae97d830838c094ab9afa34d2bd6354a622b40"}
Jul 17 04:52:58.953116 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:58.953054    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b9cb6c7c7-wgq8l" podStartSLOduration=0.953034437 podStartE2EDuration="953.034437ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:52:58.952452346 +0000 UTC m=+213.630058695" watchObservedRunningTime="2026-07-17 04:52:58.953034437 +0000 UTC m=+213.630640783"
Jul 17 04:52:59.027223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:59.027185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:52:59.080687 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:52:59.080620    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:53:03.452441 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:03.452396    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:53:03.502454 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:03.502416    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:53:08.363673 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:08.363617    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:53:08.364073 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:08.363701    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:53:08.368704 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:08.368676    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:53:08.974774 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:08.974745    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b9cb6c7c7-wgq8l"
Jul 17 04:53:09.018338 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:09.018299    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bcc9cf55-xmwx7"]
Jul 17 04:53:09.125003 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:09.124966    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:53:09.175955 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:09.175913    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:53:09.229729 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:09.229609    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:53:12.473607 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:12.473556    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:53:12.571258 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:12.571227    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:53:32.633024 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:32.632980    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:53:34.048191 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.048146    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bcc9cf55-xmwx7" podUID="be8db403-0407-43ea-bdad-bafc57492951" containerName="console" containerID="cri-o://737f3e9e97f0aa26f158fcf75a1342fb0bb145624918c686b1289ed2b7574b3c" gracePeriod=15
Jul 17 04:53:34.301035 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.300969    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:53:34.371104 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.371062    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-trusted-ca-bundle\") pod \"be8db403-0407-43ea-bdad-bafc57492951\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") "
Jul 17 04:53:34.371104 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.371111    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwxj4\" (UniqueName: \"kubernetes.io/projected/be8db403-0407-43ea-bdad-bafc57492951-kube-api-access-kwxj4\") pod \"be8db403-0407-43ea-bdad-bafc57492951\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") "
Jul 17 04:53:34.371358 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.371170    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be8db403-0407-43ea-bdad-bafc57492951-console-oauth-config\") pod \"be8db403-0407-43ea-bdad-bafc57492951\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") "
Jul 17 04:53:34.371358 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.371203    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-oauth-serving-cert\") pod \"be8db403-0407-43ea-bdad-bafc57492951\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") "
Jul 17 04:53:34.371358 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.371323    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-service-ca\") pod \"be8db403-0407-43ea-bdad-bafc57492951\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") "
Jul 17 04:53:34.371495 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.371370    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-console-config\") pod \"be8db403-0407-43ea-bdad-bafc57492951\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") "
Jul 17 04:53:34.371495 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.371415    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be8db403-0407-43ea-bdad-bafc57492951-console-serving-cert\") pod \"be8db403-0407-43ea-bdad-bafc57492951\" (UID: \"be8db403-0407-43ea-bdad-bafc57492951\") "
Jul 17 04:53:34.371835 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.371537    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "be8db403-0407-43ea-bdad-bafc57492951" (UID: "be8db403-0407-43ea-bdad-bafc57492951"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 04:53:34.371835 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.371739    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-trusted-ca-bundle\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:53:34.371835 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.371737    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-service-ca" (OuterVolumeSpecName: "service-ca") pod "be8db403-0407-43ea-bdad-bafc57492951" (UID: "be8db403-0407-43ea-bdad-bafc57492951"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 04:53:34.371835 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.371745    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "be8db403-0407-43ea-bdad-bafc57492951" (UID: "be8db403-0407-43ea-bdad-bafc57492951"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 04:53:34.371835 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.371794    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-console-config" (OuterVolumeSpecName: "console-config") pod "be8db403-0407-43ea-bdad-bafc57492951" (UID: "be8db403-0407-43ea-bdad-bafc57492951"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 04:53:34.373604 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.373579    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be8db403-0407-43ea-bdad-bafc57492951-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "be8db403-0407-43ea-bdad-bafc57492951" (UID: "be8db403-0407-43ea-bdad-bafc57492951"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 04:53:34.373604 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.373591    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be8db403-0407-43ea-bdad-bafc57492951-kube-api-access-kwxj4" (OuterVolumeSpecName: "kube-api-access-kwxj4") pod "be8db403-0407-43ea-bdad-bafc57492951" (UID: "be8db403-0407-43ea-bdad-bafc57492951"). InnerVolumeSpecName "kube-api-access-kwxj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:53:34.373724 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.373675    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be8db403-0407-43ea-bdad-bafc57492951-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "be8db403-0407-43ea-bdad-bafc57492951" (UID: "be8db403-0407-43ea-bdad-bafc57492951"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 04:53:34.472646 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.472583    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-oauth-serving-cert\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:53:34.472646 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.472615    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-service-ca\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:53:34.472646 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.472644    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be8db403-0407-43ea-bdad-bafc57492951-console-config\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:53:34.472646 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.472653    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be8db403-0407-43ea-bdad-bafc57492951-console-serving-cert\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:53:34.472646 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.472660    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwxj4\" (UniqueName: \"kubernetes.io/projected/be8db403-0407-43ea-bdad-bafc57492951-kube-api-access-kwxj4\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:53:34.472940 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:34.472669    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be8db403-0407-43ea-bdad-bafc57492951-console-oauth-config\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:53:35.072855 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:35.072810    2564 generic.go:356] "Generic (PLEG): container finished" podID="be8db403-0407-43ea-bdad-bafc57492951" containerID="737f3e9e97f0aa26f158fcf75a1342fb0bb145624918c686b1289ed2b7574b3c" exitCode=0
Jul 17 04:53:35.072855 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:35.072858    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcc9cf55-xmwx7"
Jul 17 04:53:35.073316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:35.072876    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcc9cf55-xmwx7" event={"ID":"be8db403-0407-43ea-bdad-bafc57492951","Type":"ContainerDied","Data":"737f3e9e97f0aa26f158fcf75a1342fb0bb145624918c686b1289ed2b7574b3c"}
Jul 17 04:53:35.073316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:35.072915    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcc9cf55-xmwx7" event={"ID":"be8db403-0407-43ea-bdad-bafc57492951","Type":"ContainerDied","Data":"9bb0528a8035838b7880b59a1db487aeee3c26a3415a0554725fdac03521e6c5"}
Jul 17 04:53:35.073316 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:35.072940    2564 scope.go:117] "RemoveContainer" containerID="737f3e9e97f0aa26f158fcf75a1342fb0bb145624918c686b1289ed2b7574b3c"
Jul 17 04:53:35.088526 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:35.088499    2564 scope.go:117] "RemoveContainer" containerID="737f3e9e97f0aa26f158fcf75a1342fb0bb145624918c686b1289ed2b7574b3c"
Jul 17 04:53:35.088902 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:53:35.088878    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"737f3e9e97f0aa26f158fcf75a1342fb0bb145624918c686b1289ed2b7574b3c\": container with ID starting with 737f3e9e97f0aa26f158fcf75a1342fb0bb145624918c686b1289ed2b7574b3c not found: ID does not exist" containerID="737f3e9e97f0aa26f158fcf75a1342fb0bb145624918c686b1289ed2b7574b3c"
Jul 17 04:53:35.088989 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:35.088914    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737f3e9e97f0aa26f158fcf75a1342fb0bb145624918c686b1289ed2b7574b3c"} err="failed to get container status \"737f3e9e97f0aa26f158fcf75a1342fb0bb145624918c686b1289ed2b7574b3c\": rpc error: code = NotFound desc = could not find container \"737f3e9e97f0aa26f158fcf75a1342fb0bb145624918c686b1289ed2b7574b3c\": container with ID starting with 737f3e9e97f0aa26f158fcf75a1342fb0bb145624918c686b1289ed2b7574b3c not found: ID does not exist"
Jul 17 04:53:35.097972 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:35.097938    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bcc9cf55-xmwx7"]
Jul 17 04:53:35.103949 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:35.103921    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bcc9cf55-xmwx7"]
Jul 17 04:53:35.856798 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:35.856762    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be8db403-0407-43ea-bdad-bafc57492951" path="/var/lib/kubelet/pods/be8db403-0407-43ea-bdad-bafc57492951/volumes"
Jul 17 04:53:38.680580 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:38.680544    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:53:38.777390 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:38.777355    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:53:39.251246 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.251211    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm"]
Jul 17 04:53:39.251513 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.251501    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be8db403-0407-43ea-bdad-bafc57492951" containerName="console"
Jul 17 04:53:39.251561 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.251514    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="be8db403-0407-43ea-bdad-bafc57492951" containerName="console"
Jul 17 04:53:39.251594 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.251567    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="be8db403-0407-43ea-bdad-bafc57492951" containerName="console"
Jul 17 04:53:39.255772 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.255747    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm"
Jul 17 04:53:39.258273 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.258247    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 17 04:53:39.258273 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.258264    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 17 04:53:39.258456 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.258359    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w8gb6\""
Jul 17 04:53:39.264025 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.264002    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm"]
Jul 17 04:53:39.416649 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.416579    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e07b897a-0915-467c-a407-fa668e0186c7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm\" (UID: \"e07b897a-0915-467c-a407-fa668e0186c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm"
Jul 17 04:53:39.416838 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.416691    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmg6z\" (UniqueName: \"kubernetes.io/projected/e07b897a-0915-467c-a407-fa668e0186c7-kube-api-access-vmg6z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm\" (UID: \"e07b897a-0915-467c-a407-fa668e0186c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm"
Jul 17 04:53:39.416838 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.416763    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e07b897a-0915-467c-a407-fa668e0186c7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm\" (UID: \"e07b897a-0915-467c-a407-fa668e0186c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm"
Jul 17 04:53:39.518251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.518160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e07b897a-0915-467c-a407-fa668e0186c7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm\" (UID: \"e07b897a-0915-467c-a407-fa668e0186c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm"
Jul 17 04:53:39.518251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.518217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmg6z\" (UniqueName: \"kubernetes.io/projected/e07b897a-0915-467c-a407-fa668e0186c7-kube-api-access-vmg6z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm\" (UID: \"e07b897a-0915-467c-a407-fa668e0186c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm"
Jul 17 04:53:39.518251 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.518248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e07b897a-0915-467c-a407-fa668e0186c7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm\" (UID: \"e07b897a-0915-467c-a407-fa668e0186c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm"
Jul 17 04:53:39.518560 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.518540    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e07b897a-0915-467c-a407-fa668e0186c7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm\" (UID: \"e07b897a-0915-467c-a407-fa668e0186c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm"
Jul 17 04:53:39.518603 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.518565    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e07b897a-0915-467c-a407-fa668e0186c7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm\" (UID: \"e07b897a-0915-467c-a407-fa668e0186c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm"
Jul 17 04:53:39.526676 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.526647    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmg6z\" (UniqueName: \"kubernetes.io/projected/e07b897a-0915-467c-a407-fa668e0186c7-kube-api-access-vmg6z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm\" (UID: \"e07b897a-0915-467c-a407-fa668e0186c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm"
Jul 17 04:53:39.565468 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.565437    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm"
Jul 17 04:53:39.703525 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:39.703497    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm"]
Jul 17 04:53:39.706556 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:53:39.706532    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode07b897a_0915_467c_a407_fa668e0186c7.slice/crio-5843c720e6c658b19e5f23ac1636c684c098960fd73e14d8e6e991afa4b374ed WatchSource:0}: Error finding container 5843c720e6c658b19e5f23ac1636c684c098960fd73e14d8e6e991afa4b374ed: Status 404 returned error can't find the container with id 5843c720e6c658b19e5f23ac1636c684c098960fd73e14d8e6e991afa4b374ed
Jul 17 04:53:40.095750 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:40.095713    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm" event={"ID":"e07b897a-0915-467c-a407-fa668e0186c7","Type":"ContainerStarted","Data":"5843c720e6c658b19e5f23ac1636c684c098960fd73e14d8e6e991afa4b374ed"}
Jul 17 04:53:47.127800 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:47.127709    2564 generic.go:356] "Generic (PLEG): container finished" podID="e07b897a-0915-467c-a407-fa668e0186c7" containerID="167739c445a68e0060755e35531028b777696e1c881c2e0f7f5c06bbe59a9444" exitCode=0
Jul 17 04:53:47.128178 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:47.127795    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm" event={"ID":"e07b897a-0915-467c-a407-fa668e0186c7","Type":"ContainerDied","Data":"167739c445a68e0060755e35531028b777696e1c881c2e0f7f5c06bbe59a9444"}
Jul 17 04:53:50.142335 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:50.142298    2564 generic.go:356] "Generic (PLEG): container finished" podID="e07b897a-0915-467c-a407-fa668e0186c7" containerID="be3cda29f48cf8c81909439598678282dd547d23882bfc1accef5dfd7ac0e9a7" exitCode=0
Jul 17 04:53:50.142734 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:50.142357    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm" event={"ID":"e07b897a-0915-467c-a407-fa668e0186c7","Type":"ContainerDied","Data":"be3cda29f48cf8c81909439598678282dd547d23882bfc1accef5dfd7ac0e9a7"}
Jul 17 04:53:58.179688 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:58.179649    2564 generic.go:356] "Generic (PLEG): container finished" podID="e07b897a-0915-467c-a407-fa668e0186c7" containerID="803953e2ae6cd731b96ca8951f82a073abe6864c3afd260400b1053c52d11034" exitCode=0
Jul 17 04:53:58.180060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:58.179695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm" event={"ID":"e07b897a-0915-467c-a407-fa668e0186c7","Type":"ContainerDied","Data":"803953e2ae6cd731b96ca8951f82a073abe6864c3afd260400b1053c52d11034"}
Jul 17 04:53:59.312098 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:59.312068    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm"
Jul 17 04:53:59.383132 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:59.383096    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e07b897a-0915-467c-a407-fa668e0186c7-util\") pod \"e07b897a-0915-467c-a407-fa668e0186c7\" (UID: \"e07b897a-0915-467c-a407-fa668e0186c7\") "
Jul 17 04:53:59.383132 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:59.383136    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e07b897a-0915-467c-a407-fa668e0186c7-bundle\") pod \"e07b897a-0915-467c-a407-fa668e0186c7\" (UID: \"e07b897a-0915-467c-a407-fa668e0186c7\") "
Jul 17 04:53:59.383815 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:59.383786    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e07b897a-0915-467c-a407-fa668e0186c7-bundle" (OuterVolumeSpecName: "bundle") pod "e07b897a-0915-467c-a407-fa668e0186c7" (UID: "e07b897a-0915-467c-a407-fa668e0186c7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:53:59.388267 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:59.388238    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e07b897a-0915-467c-a407-fa668e0186c7-util" (OuterVolumeSpecName: "util") pod "e07b897a-0915-467c-a407-fa668e0186c7" (UID: "e07b897a-0915-467c-a407-fa668e0186c7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:53:59.483610 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:59.483523    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmg6z\" (UniqueName: \"kubernetes.io/projected/e07b897a-0915-467c-a407-fa668e0186c7-kube-api-access-vmg6z\") pod \"e07b897a-0915-467c-a407-fa668e0186c7\" (UID: \"e07b897a-0915-467c-a407-fa668e0186c7\") "
Jul 17 04:53:59.483795 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:59.483777    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e07b897a-0915-467c-a407-fa668e0186c7-util\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:53:59.483836 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:59.483801    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e07b897a-0915-467c-a407-fa668e0186c7-bundle\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:53:59.485856 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:59.485834    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e07b897a-0915-467c-a407-fa668e0186c7-kube-api-access-vmg6z" (OuterVolumeSpecName: "kube-api-access-vmg6z") pod "e07b897a-0915-467c-a407-fa668e0186c7" (UID: "e07b897a-0915-467c-a407-fa668e0186c7"). InnerVolumeSpecName "kube-api-access-vmg6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:53:59.584507 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:53:59.584456    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmg6z\" (UniqueName: \"kubernetes.io/projected/e07b897a-0915-467c-a407-fa668e0186c7-kube-api-access-vmg6z\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:54:00.190177 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:00.190102    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm"
Jul 17 04:54:00.190347 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:00.190101    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405n6rm" event={"ID":"e07b897a-0915-467c-a407-fa668e0186c7","Type":"ContainerDied","Data":"5843c720e6c658b19e5f23ac1636c684c098960fd73e14d8e6e991afa4b374ed"}
Jul 17 04:54:00.190347 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:00.190219    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5843c720e6c658b19e5f23ac1636c684c098960fd73e14d8e6e991afa4b374ed"
Jul 17 04:54:05.268084 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:05.268017    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:06.068339 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:06.068292    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:07.237843 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.237801    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kcp4"]
Jul 17 04:54:07.238343 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.238229    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e07b897a-0915-467c-a407-fa668e0186c7" containerName="util"
Jul 17 04:54:07.238343 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.238247    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e07b897a-0915-467c-a407-fa668e0186c7" containerName="util"
Jul 17 04:54:07.238343 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.238272    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e07b897a-0915-467c-a407-fa668e0186c7" containerName="extract"
Jul 17 04:54:07.238343 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.238280    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e07b897a-0915-467c-a407-fa668e0186c7" containerName="extract"
Jul 17 04:54:07.238343 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.238294    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e07b897a-0915-467c-a407-fa668e0186c7" containerName="pull"
Jul 17 04:54:07.238343 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.238302    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e07b897a-0915-467c-a407-fa668e0186c7" containerName="pull"
Jul 17 04:54:07.238646 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.238376    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e07b897a-0915-467c-a407-fa668e0186c7" containerName="extract"
Jul 17 04:54:07.241923 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.241898    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kcp4"
Jul 17 04:54:07.244613 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.244587    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 17 04:54:07.244771 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.244599    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 17 04:54:07.244771 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.244713    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fwrjs\""
Jul 17 04:54:07.261097 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.261061    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kcp4"]
Jul 17 04:54:07.339770 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.339727    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed3d196a-7bbd-49f5-b459-bac3769b7f67-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8kcp4\" (UID: \"ed3d196a-7bbd-49f5-b459-bac3769b7f67\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kcp4"
Jul 17 04:54:07.339952 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.339795    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq6hj\" (UniqueName: \"kubernetes.io/projected/ed3d196a-7bbd-49f5-b459-bac3769b7f67-kube-api-access-gq6hj\") pod \"cert-manager-operator-controller-manager-55c444bf86-8kcp4\" (UID: \"ed3d196a-7bbd-49f5-b459-bac3769b7f67\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kcp4"
Jul 17 04:54:07.440225 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.440186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq6hj\" (UniqueName: \"kubernetes.io/projected/ed3d196a-7bbd-49f5-b459-bac3769b7f67-kube-api-access-gq6hj\") pod \"cert-manager-operator-controller-manager-55c444bf86-8kcp4\" (UID: \"ed3d196a-7bbd-49f5-b459-bac3769b7f67\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kcp4"
Jul 17 04:54:07.440442 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.440242    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed3d196a-7bbd-49f5-b459-bac3769b7f67-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8kcp4\" (UID: \"ed3d196a-7bbd-49f5-b459-bac3769b7f67\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kcp4"
Jul 17 04:54:07.440584 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.440568    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed3d196a-7bbd-49f5-b459-bac3769b7f67-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8kcp4\" (UID: \"ed3d196a-7bbd-49f5-b459-bac3769b7f67\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kcp4"
Jul 17 04:54:07.448683 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.448621    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq6hj\" (UniqueName: \"kubernetes.io/projected/ed3d196a-7bbd-49f5-b459-bac3769b7f67-kube-api-access-gq6hj\") pod \"cert-manager-operator-controller-manager-55c444bf86-8kcp4\" (UID: \"ed3d196a-7bbd-49f5-b459-bac3769b7f67\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kcp4"
Jul 17 04:54:07.551540 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.551446    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kcp4"
Jul 17 04:54:07.699111 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:07.699073    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kcp4"]
Jul 17 04:54:07.702135 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:54:07.702102    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3d196a_7bbd_49f5_b459_bac3769b7f67.slice/crio-3cacba42ff9921f2951c3ea36afc2098e4c7551a1ae0fc5a20da2474cf5d947c WatchSource:0}: Error finding container 3cacba42ff9921f2951c3ea36afc2098e4c7551a1ae0fc5a20da2474cf5d947c: Status 404 returned error can't find the container with id 3cacba42ff9921f2951c3ea36afc2098e4c7551a1ae0fc5a20da2474cf5d947c
Jul 17 04:54:08.223298 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:08.223264    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kcp4" event={"ID":"ed3d196a-7bbd-49f5-b459-bac3769b7f67","Type":"ContainerStarted","Data":"3cacba42ff9921f2951c3ea36afc2098e4c7551a1ae0fc5a20da2474cf5d947c"}
Jul 17 04:54:08.880786 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:08.880748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:08.960150 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:08.960118    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:10.235392 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:10.235348    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kcp4" event={"ID":"ed3d196a-7bbd-49f5-b459-bac3769b7f67","Type":"ContainerStarted","Data":"43e8b99f8386540adbd5b233a2537dc670a6b920b978eb3aa2f7367f793f6e20"}
Jul 17 04:54:10.259386 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:10.259326    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8kcp4" podStartSLOduration=1.752909217 podStartE2EDuration="3.259308041s" totalImagesPullingTime="1.506398824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:54:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:54:10.256822184 +0000 UTC m=+284.934428530" watchObservedRunningTime="2026-07-17 04:54:10.259308041 +0000 UTC m=+284.936914386"
Jul 17 04:54:10.559699 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:10.559660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:10.665747 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:10.665702    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:10.863737 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:10.863604    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:10.956727 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:10.956694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:11.218273 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.218192    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m"]
Jul 17 04:54:11.220574 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.220558    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m"
Jul 17 04:54:11.223175 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.223154    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 17 04:54:11.224443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.224417    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 17 04:54:11.224443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.224435    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w8gb6\""
Jul 17 04:54:11.230249 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.230226    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m"]
Jul 17 04:54:11.366650 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.366592    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0533adae-e6d3-4e79-bf47-918ba808f449-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m\" (UID: \"0533adae-e6d3-4e79-bf47-918ba808f449\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m"
Jul 17 04:54:11.367057 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.366706    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl2mr\" (UniqueName: \"kubernetes.io/projected/0533adae-e6d3-4e79-bf47-918ba808f449-kube-api-access-xl2mr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m\" (UID: \"0533adae-e6d3-4e79-bf47-918ba808f449\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m"
Jul 17 04:54:11.367057 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.366754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0533adae-e6d3-4e79-bf47-918ba808f449-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m\" (UID: \"0533adae-e6d3-4e79-bf47-918ba808f449\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m"
Jul 17 04:54:11.467148 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.467103    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl2mr\" (UniqueName: \"kubernetes.io/projected/0533adae-e6d3-4e79-bf47-918ba808f449-kube-api-access-xl2mr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m\" (UID: \"0533adae-e6d3-4e79-bf47-918ba808f449\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m"
Jul 17 04:54:11.467328 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.467162    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0533adae-e6d3-4e79-bf47-918ba808f449-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m\" (UID: \"0533adae-e6d3-4e79-bf47-918ba808f449\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m"
Jul 17 04:54:11.467328 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.467188    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0533adae-e6d3-4e79-bf47-918ba808f449-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m\" (UID: \"0533adae-e6d3-4e79-bf47-918ba808f449\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m"
Jul 17 04:54:11.467537 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.467521    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0533adae-e6d3-4e79-bf47-918ba808f449-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m\" (UID: \"0533adae-e6d3-4e79-bf47-918ba808f449\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m"
Jul 17 04:54:11.467614 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.467595    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0533adae-e6d3-4e79-bf47-918ba808f449-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m\" (UID: \"0533adae-e6d3-4e79-bf47-918ba808f449\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m"
Jul 17 04:54:11.476621 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.476546    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl2mr\" (UniqueName: \"kubernetes.io/projected/0533adae-e6d3-4e79-bf47-918ba808f449-kube-api-access-xl2mr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m\" (UID: \"0533adae-e6d3-4e79-bf47-918ba808f449\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m"
Jul 17 04:54:11.530484 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.530440    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m"
Jul 17 04:54:11.667847 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:11.667822    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m"]
Jul 17 04:54:11.670595 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:54:11.670569    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0533adae_e6d3_4e79_bf47_918ba808f449.slice/crio-1cce134d32479dc8cfdcdfae89b810db0524b3cab1fdc5526b1f6e7b148eb009 WatchSource:0}: Error finding container 1cce134d32479dc8cfdcdfae89b810db0524b3cab1fdc5526b1f6e7b148eb009: Status 404 returned error can't find the container with id 1cce134d32479dc8cfdcdfae89b810db0524b3cab1fdc5526b1f6e7b148eb009
Jul 17 04:54:12.245572 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:12.245536    2564 generic.go:356] "Generic (PLEG): container finished" podID="0533adae-e6d3-4e79-bf47-918ba808f449" containerID="cf28222470d61eccd9bc8e2412d44463172ca2651aa5c822118d5c0d8bd46ba9" exitCode=0
Jul 17 04:54:12.245793 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:12.245660    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m" event={"ID":"0533adae-e6d3-4e79-bf47-918ba808f449","Type":"ContainerDied","Data":"cf28222470d61eccd9bc8e2412d44463172ca2651aa5c822118d5c0d8bd46ba9"}
Jul 17 04:54:12.245793 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:12.245747    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m" event={"ID":"0533adae-e6d3-4e79-bf47-918ba808f449","Type":"ContainerStarted","Data":"1cce134d32479dc8cfdcdfae89b810db0524b3cab1fdc5526b1f6e7b148eb009"}
Jul 17 04:54:13.030759 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:13.030712    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:13.444065 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:13.443993    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:13.515900 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:13.515865    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bms67"]
Jul 17 04:54:13.522014 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:13.521978    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bms67"
Jul 17 04:54:13.524685 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:13.524656    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 17 04:54:13.525640 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:13.525591    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 17 04:54:13.525781 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:13.525671    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-z9n6x\""
Jul 17 04:54:13.534831 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:13.534802    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bms67"]
Jul 17 04:54:13.582799 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:13.582761    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/540bdf09-e126-44f7-beec-9364f59be5a9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bms67\" (UID: \"540bdf09-e126-44f7-beec-9364f59be5a9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bms67"
Jul 17 04:54:13.582987 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:13.582836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kflt\" (UniqueName: \"kubernetes.io/projected/540bdf09-e126-44f7-beec-9364f59be5a9-kube-api-access-9kflt\") pod \"cert-manager-webhook-6486ffd997-bms67\" (UID: \"540bdf09-e126-44f7-beec-9364f59be5a9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bms67"
Jul 17 04:54:13.683241 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:13.683203    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kflt\" (UniqueName: \"kubernetes.io/projected/540bdf09-e126-44f7-beec-9364f59be5a9-kube-api-access-9kflt\") pod \"cert-manager-webhook-6486ffd997-bms67\" (UID: \"540bdf09-e126-44f7-beec-9364f59be5a9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bms67"
Jul 17 04:54:13.683430 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:13.683288    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/540bdf09-e126-44f7-beec-9364f59be5a9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bms67\" (UID: \"540bdf09-e126-44f7-beec-9364f59be5a9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bms67"
Jul 17 04:54:13.691930 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:13.691893    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/540bdf09-e126-44f7-beec-9364f59be5a9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bms67\" (UID: \"540bdf09-e126-44f7-beec-9364f59be5a9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bms67"
Jul 17 04:54:13.692115 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:13.692040    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kflt\" (UniqueName: \"kubernetes.io/projected/540bdf09-e126-44f7-beec-9364f59be5a9-kube-api-access-9kflt\") pod \"cert-manager-webhook-6486ffd997-bms67\" (UID: \"540bdf09-e126-44f7-beec-9364f59be5a9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bms67"
Jul 17 04:54:13.843354 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:13.843316    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bms67"
Jul 17 04:54:14.138705 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:14.138677    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bms67"]
Jul 17 04:54:14.140813 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:54:14.140781    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod540bdf09_e126_44f7_beec_9364f59be5a9.slice/crio-67c2c7bec00c653cfe66388b806b90ac6e15208d4f39e801b962f22d8dee672c WatchSource:0}: Error finding container 67c2c7bec00c653cfe66388b806b90ac6e15208d4f39e801b962f22d8dee672c: Status 404 returned error can't find the container with id 67c2c7bec00c653cfe66388b806b90ac6e15208d4f39e801b962f22d8dee672c
Jul 17 04:54:14.257349 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:14.257315    2564 generic.go:356] "Generic (PLEG): container finished" podID="0533adae-e6d3-4e79-bf47-918ba808f449" containerID="3ca9b954b5c331b9ba1bdfd22619023fd7fc75133a64a3475149de5de030547a" exitCode=0
Jul 17 04:54:14.257550 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:14.257407    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m" event={"ID":"0533adae-e6d3-4e79-bf47-918ba808f449","Type":"ContainerDied","Data":"3ca9b954b5c331b9ba1bdfd22619023fd7fc75133a64a3475149de5de030547a"}
Jul 17 04:54:14.258677 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:14.258651    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bms67" event={"ID":"540bdf09-e126-44f7-beec-9364f59be5a9","Type":"ContainerStarted","Data":"67c2c7bec00c653cfe66388b806b90ac6e15208d4f39e801b962f22d8dee672c"}
Jul 17 04:54:15.266994 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:15.266952    2564 generic.go:356] "Generic (PLEG): container finished" podID="0533adae-e6d3-4e79-bf47-918ba808f449" containerID="1b2b002a8cdd3d623594db0abbd11da9cd8625249e923df0ef9bdd70639055b9" exitCode=0
Jul 17 04:54:15.267417 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:15.267035    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m" event={"ID":"0533adae-e6d3-4e79-bf47-918ba808f449","Type":"ContainerDied","Data":"1b2b002a8cdd3d623594db0abbd11da9cd8625249e923df0ef9bdd70639055b9"}
Jul 17 04:54:15.665911 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:15.665785    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:15.769090 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:15.769050    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:16.809315 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:16.809281    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m"
Jul 17 04:54:16.910168 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:16.910136    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0533adae-e6d3-4e79-bf47-918ba808f449-util\") pod \"0533adae-e6d3-4e79-bf47-918ba808f449\" (UID: \"0533adae-e6d3-4e79-bf47-918ba808f449\") "
Jul 17 04:54:16.910333 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:16.910176    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl2mr\" (UniqueName: \"kubernetes.io/projected/0533adae-e6d3-4e79-bf47-918ba808f449-kube-api-access-xl2mr\") pod \"0533adae-e6d3-4e79-bf47-918ba808f449\" (UID: \"0533adae-e6d3-4e79-bf47-918ba808f449\") "
Jul 17 04:54:16.910333 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:16.910201    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0533adae-e6d3-4e79-bf47-918ba808f449-bundle\") pod \"0533adae-e6d3-4e79-bf47-918ba808f449\" (UID: \"0533adae-e6d3-4e79-bf47-918ba808f449\") "
Jul 17 04:54:16.910755 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:16.910721    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0533adae-e6d3-4e79-bf47-918ba808f449-bundle" (OuterVolumeSpecName: "bundle") pod "0533adae-e6d3-4e79-bf47-918ba808f449" (UID: "0533adae-e6d3-4e79-bf47-918ba808f449"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:54:16.912581 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:16.912555    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0533adae-e6d3-4e79-bf47-918ba808f449-kube-api-access-xl2mr" (OuterVolumeSpecName: "kube-api-access-xl2mr") pod "0533adae-e6d3-4e79-bf47-918ba808f449" (UID: "0533adae-e6d3-4e79-bf47-918ba808f449"). InnerVolumeSpecName "kube-api-access-xl2mr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:54:16.918069 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:16.918011    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0533adae-e6d3-4e79-bf47-918ba808f449-util" (OuterVolumeSpecName: "util") pod "0533adae-e6d3-4e79-bf47-918ba808f449" (UID: "0533adae-e6d3-4e79-bf47-918ba808f449"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:54:17.011078 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:17.011038    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0533adae-e6d3-4e79-bf47-918ba808f449-util\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:54:17.011078 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:17.011074    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl2mr\" (UniqueName: \"kubernetes.io/projected/0533adae-e6d3-4e79-bf47-918ba808f449-kube-api-access-xl2mr\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:54:17.011078 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:17.011084    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0533adae-e6d3-4e79-bf47-918ba808f449-bundle\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:54:17.281991 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:17.281960    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m" event={"ID":"0533adae-e6d3-4e79-bf47-918ba808f449","Type":"ContainerDied","Data":"1cce134d32479dc8cfdcdfae89b810db0524b3cab1fdc5526b1f6e7b148eb009"}
Jul 17 04:54:17.281991 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:17.281980    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpxv5m"
Jul 17 04:54:17.282211 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:17.282022    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1cce134d32479dc8cfdcdfae89b810db0524b3cab1fdc5526b1f6e7b148eb009"
Jul 17 04:54:17.283622 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:17.283596    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bms67" event={"ID":"540bdf09-e126-44f7-beec-9364f59be5a9","Type":"ContainerStarted","Data":"925e9ee00dba03062eac5ef068573d75660ec70f980ea2db855e2cf6460b2ef4"}
Jul 17 04:54:17.283786 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:17.283732    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bms67"
Jul 17 04:54:17.311890 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:17.311833    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-bms67" podStartSLOduration=1.627224631 podStartE2EDuration="4.311815056s" totalImagesPullingTime="2.684590425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:54:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:54:17.309154718 +0000 UTC m=+291.986761064" watchObservedRunningTime="2026-07-17 04:54:17.311815056 +0000 UTC m=+291.989421402"
Jul 17 04:54:21.044727 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:21.044684    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:21.770048 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:21.770008    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:21.891776 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:21.891737    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:21.985971 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:21.985923    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:23.100178 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:23.100136    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:23.290645 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:23.290596    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bms67"
Jul 17 04:54:25.767344 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:25.767314    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 04:54:25.776140 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:25.776109    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 04:54:25.779777 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:25.779750    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 04:54:27.516307 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:27.516268    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:27.618595 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:27.618561    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:29.145261 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.145223    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r"]
Jul 17 04:54:29.145670 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.145513    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0533adae-e6d3-4e79-bf47-918ba808f449" containerName="util"
Jul 17 04:54:29.145670 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.145524    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0533adae-e6d3-4e79-bf47-918ba808f449" containerName="util"
Jul 17 04:54:29.145670 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.145545    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0533adae-e6d3-4e79-bf47-918ba808f449" containerName="extract"
Jul 17 04:54:29.145670 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.145551    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0533adae-e6d3-4e79-bf47-918ba808f449" containerName="extract"
Jul 17 04:54:29.145670 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.145559    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0533adae-e6d3-4e79-bf47-918ba808f449" containerName="pull"
Jul 17 04:54:29.145670 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.145564    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0533adae-e6d3-4e79-bf47-918ba808f449" containerName="pull"
Jul 17 04:54:29.145670 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.145611    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0533adae-e6d3-4e79-bf47-918ba808f449" containerName="extract"
Jul 17 04:54:29.151490 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.150966    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r"
Jul 17 04:54:29.154219 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.154186    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 17 04:54:29.154353 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.154222    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w8gb6\""
Jul 17 04:54:29.155482 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.155453    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 17 04:54:29.157739 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.157712    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r"]
Jul 17 04:54:29.208836 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.208797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr2pk\" (UniqueName: \"kubernetes.io/projected/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-kube-api-access-rr2pk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r\" (UID: \"fda7fc7b-432a-4286-aef7-fcd4f0a30e40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r"
Jul 17 04:54:29.209027 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.208841    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r\" (UID: \"fda7fc7b-432a-4286-aef7-fcd4f0a30e40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r"
Jul 17 04:54:29.209027 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.208872    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r\" (UID: \"fda7fc7b-432a-4286-aef7-fcd4f0a30e40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r"
Jul 17 04:54:29.309307 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.309270    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr2pk\" (UniqueName: \"kubernetes.io/projected/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-kube-api-access-rr2pk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r\" (UID: \"fda7fc7b-432a-4286-aef7-fcd4f0a30e40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r"
Jul 17 04:54:29.309491 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.309316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r\" (UID: \"fda7fc7b-432a-4286-aef7-fcd4f0a30e40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r"
Jul 17 04:54:29.309491 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.309435    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r\" (UID: \"fda7fc7b-432a-4286-aef7-fcd4f0a30e40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r"
Jul 17 04:54:29.309720 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.309699    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r\" (UID: \"fda7fc7b-432a-4286-aef7-fcd4f0a30e40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r"
Jul 17 04:54:29.309800 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.309753    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r\" (UID: \"fda7fc7b-432a-4286-aef7-fcd4f0a30e40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r"
Jul 17 04:54:29.317668 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.317647    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr2pk\" (UniqueName: \"kubernetes.io/projected/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-kube-api-access-rr2pk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r\" (UID: \"fda7fc7b-432a-4286-aef7-fcd4f0a30e40\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r"
Jul 17 04:54:29.462818 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.462735    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r"
Jul 17 04:54:29.620115 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.620054    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r"]
Jul 17 04:54:29.622284 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:54:29.622255    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda7fc7b_432a_4286_aef7_fcd4f0a30e40.slice/crio-12298786ba5c34b9f99f20c2f56331e0f56bfd0643bfe2c082eaf323fbf59541 WatchSource:0}: Error finding container 12298786ba5c34b9f99f20c2f56331e0f56bfd0643bfe2c082eaf323fbf59541: Status 404 returned error can't find the container with id 12298786ba5c34b9f99f20c2f56331e0f56bfd0643bfe2c082eaf323fbf59541
Jul 17 04:54:29.711198 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:29.711154    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:30.340931 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:30.340894    2564 generic.go:356] "Generic (PLEG): container finished" podID="fda7fc7b-432a-4286-aef7-fcd4f0a30e40" containerID="d7dacdbd7cd5fc3010ad0bdcbba25e7e1adb8e553000385f7313c786c8e792a2" exitCode=0
Jul 17 04:54:30.341333 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:30.340978    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r" event={"ID":"fda7fc7b-432a-4286-aef7-fcd4f0a30e40","Type":"ContainerDied","Data":"d7dacdbd7cd5fc3010ad0bdcbba25e7e1adb8e553000385f7313c786c8e792a2"}
Jul 17 04:54:30.341333 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:30.341025    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r" event={"ID":"fda7fc7b-432a-4286-aef7-fcd4f0a30e40","Type":"ContainerStarted","Data":"12298786ba5c34b9f99f20c2f56331e0f56bfd0643bfe2c082eaf323fbf59541"}
Jul 17 04:54:30.341492 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:30.341476    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 04:54:32.353802 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:32.353769    2564 generic.go:356] "Generic (PLEG): container finished" podID="fda7fc7b-432a-4286-aef7-fcd4f0a30e40" containerID="7c409fc8d504935e06f194664bc09515ab023c4e056514ba848d78ea4615125b" exitCode=0
Jul 17 04:54:32.354229 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:32.353855    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r" event={"ID":"fda7fc7b-432a-4286-aef7-fcd4f0a30e40","Type":"ContainerDied","Data":"7c409fc8d504935e06f194664bc09515ab023c4e056514ba848d78ea4615125b"}
Jul 17 04:54:33.361059 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:33.361020    2564 generic.go:356] "Generic (PLEG): container finished" podID="fda7fc7b-432a-4286-aef7-fcd4f0a30e40" containerID="9714e012822df939c1fc4f048e8caeff818628bf8eaf142d0da9ad7cd52b0194" exitCode=0
Jul 17 04:54:33.361443 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:33.361083    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r" event={"ID":"fda7fc7b-432a-4286-aef7-fcd4f0a30e40","Type":"ContainerDied","Data":"9714e012822df939c1fc4f048e8caeff818628bf8eaf142d0da9ad7cd52b0194"}
Jul 17 04:54:34.500333 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:34.500307    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r"
Jul 17 04:54:34.556933 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:34.556898    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-util\") pod \"fda7fc7b-432a-4286-aef7-fcd4f0a30e40\" (UID: \"fda7fc7b-432a-4286-aef7-fcd4f0a30e40\") "
Jul 17 04:54:34.557108 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:34.556987    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-bundle\") pod \"fda7fc7b-432a-4286-aef7-fcd4f0a30e40\" (UID: \"fda7fc7b-432a-4286-aef7-fcd4f0a30e40\") "
Jul 17 04:54:34.557108 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:34.557031    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rr2pk\" (UniqueName: \"kubernetes.io/projected/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-kube-api-access-rr2pk\") pod \"fda7fc7b-432a-4286-aef7-fcd4f0a30e40\" (UID: \"fda7fc7b-432a-4286-aef7-fcd4f0a30e40\") "
Jul 17 04:54:34.557688 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:34.557661    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-bundle" (OuterVolumeSpecName: "bundle") pod "fda7fc7b-432a-4286-aef7-fcd4f0a30e40" (UID: "fda7fc7b-432a-4286-aef7-fcd4f0a30e40"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:54:34.559270 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:34.559250    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-kube-api-access-rr2pk" (OuterVolumeSpecName: "kube-api-access-rr2pk") pod "fda7fc7b-432a-4286-aef7-fcd4f0a30e40" (UID: "fda7fc7b-432a-4286-aef7-fcd4f0a30e40"). InnerVolumeSpecName "kube-api-access-rr2pk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:54:34.562354 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:34.562327    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-util" (OuterVolumeSpecName: "util") pod "fda7fc7b-432a-4286-aef7-fcd4f0a30e40" (UID: "fda7fc7b-432a-4286-aef7-fcd4f0a30e40"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:54:34.657975 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:34.657885    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-bundle\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:54:34.657975 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:34.657920    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rr2pk\" (UniqueName: \"kubernetes.io/projected/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-kube-api-access-rr2pk\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:54:34.657975 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:34.657929    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fda7fc7b-432a-4286-aef7-fcd4f0a30e40-util\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:54:35.371220 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:35.371148    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r" event={"ID":"fda7fc7b-432a-4286-aef7-fcd4f0a30e40","Type":"ContainerDied","Data":"12298786ba5c34b9f99f20c2f56331e0f56bfd0643bfe2c082eaf323fbf59541"}
Jul 17 04:54:35.371220 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:35.371192    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxkw4r"
Jul 17 04:54:35.371479 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:35.371237    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12298786ba5c34b9f99f20c2f56331e0f56bfd0643bfe2c082eaf323fbf59541"
Jul 17 04:54:44.266498 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:44.266459    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:46.078155 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:46.078096    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:46.176000 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:46.175969    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:46.685132 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:46.685095    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:46.872979 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:46.872942    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:46.974082 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:46.973998    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:47.004728 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.004686    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"]
Jul 17 04:54:47.005300 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.005272    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fda7fc7b-432a-4286-aef7-fcd4f0a30e40" containerName="util"
Jul 17 04:54:47.005300 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.005301    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fda7fc7b-432a-4286-aef7-fcd4f0a30e40" containerName="util"
Jul 17 04:54:47.005533 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.005316    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fda7fc7b-432a-4286-aef7-fcd4f0a30e40" containerName="pull"
Jul 17 04:54:47.005533 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.005324    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fda7fc7b-432a-4286-aef7-fcd4f0a30e40" containerName="pull"
Jul 17 04:54:47.005533 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.005331    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fda7fc7b-432a-4286-aef7-fcd4f0a30e40" containerName="extract"
Jul 17 04:54:47.005533 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.005341    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fda7fc7b-432a-4286-aef7-fcd4f0a30e40" containerName="extract"
Jul 17 04:54:47.005533 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.005427    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fda7fc7b-432a-4286-aef7-fcd4f0a30e40" containerName="extract"
Jul 17 04:54:47.008313 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.008294    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.010841 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.010817    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 04:54:47.011599 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.011578    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 04:54:47.011698 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.011680    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 04:54:47.011750 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.011680    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mx6ln\""
Jul 17 04:54:47.011960 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.011947    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 04:54:47.034114 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.034079    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"]
Jul 17 04:54:47.060535 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.060492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a936fef-cc34-438a-92ff-7e0a47752ab5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d857c78d5-9js2d\" (UID: \"8a936fef-cc34-438a-92ff-7e0a47752ab5\") " pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.060767 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.060547    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a936fef-cc34-438a-92ff-7e0a47752ab5-manifests\") pod \"opendatahub-operator-controller-manager-d857c78d5-9js2d\" (UID: \"8a936fef-cc34-438a-92ff-7e0a47752ab5\") " pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.060767 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.060607    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a936fef-cc34-438a-92ff-7e0a47752ab5-tmp\") pod \"opendatahub-operator-controller-manager-d857c78d5-9js2d\" (UID: \"8a936fef-cc34-438a-92ff-7e0a47752ab5\") " pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.060896 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.060775    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgggq\" (UniqueName: \"kubernetes.io/projected/8a936fef-cc34-438a-92ff-7e0a47752ab5-kube-api-access-cgggq\") pod \"opendatahub-operator-controller-manager-d857c78d5-9js2d\" (UID: \"8a936fef-cc34-438a-92ff-7e0a47752ab5\") " pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.060896 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.060837    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a936fef-cc34-438a-92ff-7e0a47752ab5-webhook-cert\") pod \"opendatahub-operator-controller-manager-d857c78d5-9js2d\" (UID: \"8a936fef-cc34-438a-92ff-7e0a47752ab5\") " pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.162225 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.162183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a936fef-cc34-438a-92ff-7e0a47752ab5-webhook-cert\") pod \"opendatahub-operator-controller-manager-d857c78d5-9js2d\" (UID: \"8a936fef-cc34-438a-92ff-7e0a47752ab5\") " pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.162225 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.162227    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a936fef-cc34-438a-92ff-7e0a47752ab5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d857c78d5-9js2d\" (UID: \"8a936fef-cc34-438a-92ff-7e0a47752ab5\") " pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.162799 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.162257    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a936fef-cc34-438a-92ff-7e0a47752ab5-manifests\") pod \"opendatahub-operator-controller-manager-d857c78d5-9js2d\" (UID: \"8a936fef-cc34-438a-92ff-7e0a47752ab5\") " pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.162799 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.162274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a936fef-cc34-438a-92ff-7e0a47752ab5-tmp\") pod \"opendatahub-operator-controller-manager-d857c78d5-9js2d\" (UID: \"8a936fef-cc34-438a-92ff-7e0a47752ab5\") " pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.162799 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.162440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgggq\" (UniqueName: \"kubernetes.io/projected/8a936fef-cc34-438a-92ff-7e0a47752ab5-kube-api-access-cgggq\") pod \"opendatahub-operator-controller-manager-d857c78d5-9js2d\" (UID: \"8a936fef-cc34-438a-92ff-7e0a47752ab5\") " pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.162799 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.162777    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a936fef-cc34-438a-92ff-7e0a47752ab5-manifests\") pod \"opendatahub-operator-controller-manager-d857c78d5-9js2d\" (UID: \"8a936fef-cc34-438a-92ff-7e0a47752ab5\") " pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.164996 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.164961    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a936fef-cc34-438a-92ff-7e0a47752ab5-tmp\") pod \"opendatahub-operator-controller-manager-d857c78d5-9js2d\" (UID: \"8a936fef-cc34-438a-92ff-7e0a47752ab5\") " pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.165126 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.165001    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a936fef-cc34-438a-92ff-7e0a47752ab5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d857c78d5-9js2d\" (UID: \"8a936fef-cc34-438a-92ff-7e0a47752ab5\") " pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.165213 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.165196    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a936fef-cc34-438a-92ff-7e0a47752ab5-webhook-cert\") pod \"opendatahub-operator-controller-manager-d857c78d5-9js2d\" (UID: \"8a936fef-cc34-438a-92ff-7e0a47752ab5\") " pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.176429 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.176394    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgggq\" (UniqueName: \"kubernetes.io/projected/8a936fef-cc34-438a-92ff-7e0a47752ab5-kube-api-access-cgggq\") pod \"opendatahub-operator-controller-manager-d857c78d5-9js2d\" (UID: \"8a936fef-cc34-438a-92ff-7e0a47752ab5\") " pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.196518 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.196477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:47.296259 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.296174    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:47.319296 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.319254    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:47.397509 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.397469    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:47.474288 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.474248    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:47.475553 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.475532    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"]
Jul 17 04:54:47.477845 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:54:47.477816    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a936fef_cc34_438a_92ff_7e0a47752ab5.slice/crio-e231c1ac40f8c477ae19df65d3488650218913c9e55c560c7019163a1652aaaa WatchSource:0}: Error finding container e231c1ac40f8c477ae19df65d3488650218913c9e55c560c7019163a1652aaaa: Status 404 returned error can't find the container with id e231c1ac40f8c477ae19df65d3488650218913c9e55c560c7019163a1652aaaa
Jul 17 04:54:47.532205 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.532163    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:47.641245 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:47.641211    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:48.433283 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:48.433240    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d" event={"ID":"8a936fef-cc34-438a-92ff-7e0a47752ab5","Type":"ContainerStarted","Data":"e231c1ac40f8c477ae19df65d3488650218913c9e55c560c7019163a1652aaaa"}
Jul 17 04:54:50.006759 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:50.006713    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:50.108549 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:50.108510    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:54:51.450707 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:51.450672    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d" event={"ID":"8a936fef-cc34-438a-92ff-7e0a47752ab5","Type":"ContainerStarted","Data":"15914e3c088d5a75b5ca7a50ac897bbab00728c511564675b44926a6d5d7febb"}
Jul 17 04:54:52.457213 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:52.457174    2564 generic.go:356] "Generic (PLEG): container finished" podID="8a936fef-cc34-438a-92ff-7e0a47752ab5" containerID="15914e3c088d5a75b5ca7a50ac897bbab00728c511564675b44926a6d5d7febb" exitCode=0
Jul 17 04:54:52.457684 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:52.457261    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d" event={"ID":"8a936fef-cc34-438a-92ff-7e0a47752ab5","Type":"ContainerDied","Data":"15914e3c088d5a75b5ca7a50ac897bbab00728c511564675b44926a6d5d7febb"}
Jul 17 04:54:53.464212 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:53.464173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d" event={"ID":"8a936fef-cc34-438a-92ff-7e0a47752ab5","Type":"ContainerStarted","Data":"1064f93b8c309b2216ebda5dee155b7fdc0d04f6b82634163744f36ddf7c3835"}
Jul 17 04:54:53.464586 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:53.464287    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:54:53.488579 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:53.488521    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d" podStartSLOduration=3.055022838 podStartE2EDuration="7.488503097s" totalImagesPullingTime="3.400656435s" totalInitContainerRuntime="1.032823824s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:54:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:54:53.488457543 +0000 UTC m=+328.166063901" watchObservedRunningTime="2026-07-17 04:54:53.488503097 +0000 UTC m=+328.166109442"
Jul 17 04:54:58.638246 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:54:58.638202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:00.208315 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:00.208277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:04.471616 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:04.471575    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d857c78d5-9js2d"
Jul 17 04:55:06.006195 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:06.006161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:06.170170 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:06.170136    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:06.758420 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:06.758318    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-khxfg"]
Jul 17 04:55:06.766883 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:06.766853    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-khxfg"
Jul 17 04:55:06.770440 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:06.770187    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 17 04:55:06.770440 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:06.770396    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-tg79v\""
Jul 17 04:55:06.773851 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:06.773810    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-khxfg"]
Jul 17 04:55:06.798337 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:06.798306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:06.913606 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:06.913571    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:06.938749 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:06.938716    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6fb8750-19d6-4a15-bb1f-9f913f2a2401-cert\") pod \"odh-model-controller-7998c67dc4-khxfg\" (UID: \"f6fb8750-19d6-4a15-bb1f-9f913f2a2401\") " pod="opendatahub/odh-model-controller-7998c67dc4-khxfg"
Jul 17 04:55:06.938907 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:06.938826    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzsdz\" (UniqueName: \"kubernetes.io/projected/f6fb8750-19d6-4a15-bb1f-9f913f2a2401-kube-api-access-qzsdz\") pod \"odh-model-controller-7998c67dc4-khxfg\" (UID: \"f6fb8750-19d6-4a15-bb1f-9f913f2a2401\") " pod="opendatahub/odh-model-controller-7998c67dc4-khxfg"
Jul 17 04:55:07.039881 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.039788    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6fb8750-19d6-4a15-bb1f-9f913f2a2401-cert\") pod \"odh-model-controller-7998c67dc4-khxfg\" (UID: \"f6fb8750-19d6-4a15-bb1f-9f913f2a2401\") " pod="opendatahub/odh-model-controller-7998c67dc4-khxfg"
Jul 17 04:55:07.040320 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.039911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzsdz\" (UniqueName: \"kubernetes.io/projected/f6fb8750-19d6-4a15-bb1f-9f913f2a2401-kube-api-access-qzsdz\") pod \"odh-model-controller-7998c67dc4-khxfg\" (UID: \"f6fb8750-19d6-4a15-bb1f-9f913f2a2401\") " pod="opendatahub/odh-model-controller-7998c67dc4-khxfg"
Jul 17 04:55:07.040320 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:55:07.039965    2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 17 04:55:07.040320 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:55:07.040065    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6fb8750-19d6-4a15-bb1f-9f913f2a2401-cert podName:f6fb8750-19d6-4a15-bb1f-9f913f2a2401 nodeName:}" failed. No retries permitted until 2026-07-17 04:55:07.540044068 +0000 UTC m=+342.217650414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f6fb8750-19d6-4a15-bb1f-9f913f2a2401-cert") pod "odh-model-controller-7998c67dc4-khxfg" (UID: "f6fb8750-19d6-4a15-bb1f-9f913f2a2401") : secret "odh-model-controller-webhook-cert" not found
Jul 17 04:55:07.051009 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.050974    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzsdz\" (UniqueName: \"kubernetes.io/projected/f6fb8750-19d6-4a15-bb1f-9f913f2a2401-kube-api-access-qzsdz\") pod \"odh-model-controller-7998c67dc4-khxfg\" (UID: \"f6fb8750-19d6-4a15-bb1f-9f913f2a2401\") " pod="opendatahub/odh-model-controller-7998c67dc4-khxfg"
Jul 17 04:55:07.193191 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.193160    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:07.238072 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.238033    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jwzth"]
Jul 17 04:55:07.241559 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.241539    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jwzth"
Jul 17 04:55:07.244038 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.244012    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 17 04:55:07.251546 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.251523    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jwzth"]
Jul 17 04:55:07.267171 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.267136    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:07.342340 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.342298    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/548a08cb-f2ee-4702-b2f6-b9950026d9a5-tls-certs\") pod \"model-serving-api-54d89bd5fc-jwzth\" (UID: \"548a08cb-f2ee-4702-b2f6-b9950026d9a5\") " pod="opendatahub/model-serving-api-54d89bd5fc-jwzth"
Jul 17 04:55:07.342340 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.342343    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hft68\" (UniqueName: \"kubernetes.io/projected/548a08cb-f2ee-4702-b2f6-b9950026d9a5-kube-api-access-hft68\") pod \"model-serving-api-54d89bd5fc-jwzth\" (UID: \"548a08cb-f2ee-4702-b2f6-b9950026d9a5\") " pod="opendatahub/model-serving-api-54d89bd5fc-jwzth"
Jul 17 04:55:07.443235 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.443189    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/548a08cb-f2ee-4702-b2f6-b9950026d9a5-tls-certs\") pod \"model-serving-api-54d89bd5fc-jwzth\" (UID: \"548a08cb-f2ee-4702-b2f6-b9950026d9a5\") " pod="opendatahub/model-serving-api-54d89bd5fc-jwzth"
Jul 17 04:55:07.443437 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.443249    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hft68\" (UniqueName: \"kubernetes.io/projected/548a08cb-f2ee-4702-b2f6-b9950026d9a5-kube-api-access-hft68\") pod \"model-serving-api-54d89bd5fc-jwzth\" (UID: \"548a08cb-f2ee-4702-b2f6-b9950026d9a5\") " pod="opendatahub/model-serving-api-54d89bd5fc-jwzth"
Jul 17 04:55:07.443437 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:55:07.443346    2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 17 04:55:07.443437 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:55:07.443422    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/548a08cb-f2ee-4702-b2f6-b9950026d9a5-tls-certs podName:548a08cb-f2ee-4702-b2f6-b9950026d9a5 nodeName:}" failed. No retries permitted until 2026-07-17 04:55:07.943405622 +0000 UTC m=+342.621011945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/548a08cb-f2ee-4702-b2f6-b9950026d9a5-tls-certs") pod "model-serving-api-54d89bd5fc-jwzth" (UID: "548a08cb-f2ee-4702-b2f6-b9950026d9a5") : secret "model-serving-api-tls" not found
Jul 17 04:55:07.451904 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.451877    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hft68\" (UniqueName: \"kubernetes.io/projected/548a08cb-f2ee-4702-b2f6-b9950026d9a5-kube-api-access-hft68\") pod \"model-serving-api-54d89bd5fc-jwzth\" (UID: \"548a08cb-f2ee-4702-b2f6-b9950026d9a5\") " pod="opendatahub/model-serving-api-54d89bd5fc-jwzth"
Jul 17 04:55:07.544794 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.544753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6fb8750-19d6-4a15-bb1f-9f913f2a2401-cert\") pod \"odh-model-controller-7998c67dc4-khxfg\" (UID: \"f6fb8750-19d6-4a15-bb1f-9f913f2a2401\") " pod="opendatahub/odh-model-controller-7998c67dc4-khxfg"
Jul 17 04:55:07.547464 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.547439    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6fb8750-19d6-4a15-bb1f-9f913f2a2401-cert\") pod \"odh-model-controller-7998c67dc4-khxfg\" (UID: \"f6fb8750-19d6-4a15-bb1f-9f913f2a2401\") " pod="opendatahub/odh-model-controller-7998c67dc4-khxfg"
Jul 17 04:55:07.588791 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.588756    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:07.685896 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.685809    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-khxfg"
Jul 17 04:55:07.820102 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.820077    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-khxfg"]
Jul 17 04:55:07.822884 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:55:07.822858    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6fb8750_19d6_4a15_bb1f_9f913f2a2401.slice/crio-d9ab51c4eaa511e50fb5d2908194f5e676bd126aa00d5b2c4a04f72c1ff9bd54 WatchSource:0}: Error finding container d9ab51c4eaa511e50fb5d2908194f5e676bd126aa00d5b2c4a04f72c1ff9bd54: Status 404 returned error can't find the container with id d9ab51c4eaa511e50fb5d2908194f5e676bd126aa00d5b2c4a04f72c1ff9bd54
Jul 17 04:55:07.948010 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.947915    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/548a08cb-f2ee-4702-b2f6-b9950026d9a5-tls-certs\") pod \"model-serving-api-54d89bd5fc-jwzth\" (UID: \"548a08cb-f2ee-4702-b2f6-b9950026d9a5\") " pod="opendatahub/model-serving-api-54d89bd5fc-jwzth"
Jul 17 04:55:07.950531 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:07.950501    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/548a08cb-f2ee-4702-b2f6-b9950026d9a5-tls-certs\") pod \"model-serving-api-54d89bd5fc-jwzth\" (UID: \"548a08cb-f2ee-4702-b2f6-b9950026d9a5\") " pod="opendatahub/model-serving-api-54d89bd5fc-jwzth"
Jul 17 04:55:08.151821 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:08.151789    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jwzth"
Jul 17 04:55:08.288606 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:08.288575    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jwzth"]
Jul 17 04:55:08.291072 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:55:08.291039    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod548a08cb_f2ee_4702_b2f6_b9950026d9a5.slice/crio-137b315e6ef31155d79a747bd9ff4216888d31548195ade2c1536f04d4adb2fc WatchSource:0}: Error finding container 137b315e6ef31155d79a747bd9ff4216888d31548195ade2c1536f04d4adb2fc: Status 404 returned error can't find the container with id 137b315e6ef31155d79a747bd9ff4216888d31548195ade2c1536f04d4adb2fc
Jul 17 04:55:08.536495 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:08.536403    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jwzth" event={"ID":"548a08cb-f2ee-4702-b2f6-b9950026d9a5","Type":"ContainerStarted","Data":"137b315e6ef31155d79a747bd9ff4216888d31548195ade2c1536f04d4adb2fc"}
Jul 17 04:55:08.537809 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:08.537776    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-khxfg" event={"ID":"f6fb8750-19d6-4a15-bb1f-9f913f2a2401","Type":"ContainerStarted","Data":"d9ab51c4eaa511e50fb5d2908194f5e676bd126aa00d5b2c4a04f72c1ff9bd54"}
Jul 17 04:55:09.349193 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.349083    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:09.489225 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.489185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:09.615686 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.615576    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt"]
Jul 17 04:55:09.620719 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.620693    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt"
Jul 17 04:55:09.626562 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.626337    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xp5n2\""
Jul 17 04:55:09.626562 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.626453    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 17 04:55:09.628069 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.627994    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 17 04:55:09.628727 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.628607    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt"]
Jul 17 04:55:09.664503 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.664467    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f802622-b57b-4356-8db1-f13d06156a56-tls-certs\") pod \"kube-auth-proxy-d686d4c64-7nnrt\" (UID: \"0f802622-b57b-4356-8db1-f13d06156a56\") " pod="openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt"
Jul 17 04:55:09.664503 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.664511    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf567\" (UniqueName: \"kubernetes.io/projected/0f802622-b57b-4356-8db1-f13d06156a56-kube-api-access-nf567\") pod \"kube-auth-proxy-d686d4c64-7nnrt\" (UID: \"0f802622-b57b-4356-8db1-f13d06156a56\") " pod="openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt"
Jul 17 04:55:09.664765 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.664598    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f802622-b57b-4356-8db1-f13d06156a56-tmp\") pod \"kube-auth-proxy-d686d4c64-7nnrt\" (UID: \"0f802622-b57b-4356-8db1-f13d06156a56\") " pod="openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt"
Jul 17 04:55:09.765880 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.765843    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f802622-b57b-4356-8db1-f13d06156a56-tls-certs\") pod \"kube-auth-proxy-d686d4c64-7nnrt\" (UID: \"0f802622-b57b-4356-8db1-f13d06156a56\") " pod="openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt"
Jul 17 04:55:09.765880 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.765881    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf567\" (UniqueName: \"kubernetes.io/projected/0f802622-b57b-4356-8db1-f13d06156a56-kube-api-access-nf567\") pod \"kube-auth-proxy-d686d4c64-7nnrt\" (UID: \"0f802622-b57b-4356-8db1-f13d06156a56\") " pod="openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt"
Jul 17 04:55:09.766130 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.765939    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f802622-b57b-4356-8db1-f13d06156a56-tmp\") pod \"kube-auth-proxy-d686d4c64-7nnrt\" (UID: \"0f802622-b57b-4356-8db1-f13d06156a56\") " pod="openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt"
Jul 17 04:55:09.768609 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.768578    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f802622-b57b-4356-8db1-f13d06156a56-tmp\") pod \"kube-auth-proxy-d686d4c64-7nnrt\" (UID: \"0f802622-b57b-4356-8db1-f13d06156a56\") " pod="openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt"
Jul 17 04:55:09.768909 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.768870    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f802622-b57b-4356-8db1-f13d06156a56-tls-certs\") pod \"kube-auth-proxy-d686d4c64-7nnrt\" (UID: \"0f802622-b57b-4356-8db1-f13d06156a56\") " pod="openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt"
Jul 17 04:55:09.775238 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.775210    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf567\" (UniqueName: \"kubernetes.io/projected/0f802622-b57b-4356-8db1-f13d06156a56-kube-api-access-nf567\") pod \"kube-auth-proxy-d686d4c64-7nnrt\" (UID: \"0f802622-b57b-4356-8db1-f13d06156a56\") " pod="openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt"
Jul 17 04:55:09.935148 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:09.935064    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt"
Jul 17 04:55:10.586477 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.586446    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"]
Jul 17 04:55:10.589949 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.589925    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.592571 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.592547    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 17 04:55:10.593018 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.592868    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 04:55:10.593018 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.592926    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 17 04:55:10.593494 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.593474    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 17 04:55:10.593819 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.593795    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bk6rk\""
Jul 17 04:55:10.602166 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.602139    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"]
Jul 17 04:55:10.638170 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.638128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:10.673374 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.673334    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm8t2\" (UniqueName: \"kubernetes.io/projected/e4169a3d-ae07-4eac-b274-85221be4282e-kube-api-access-gm8t2\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.673568 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.673383    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4169a3d-ae07-4eac-b274-85221be4282e-istio-token\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.673568 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.673409    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.673568 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.673476    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e4169a3d-ae07-4eac-b274-85221be4282e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.673568 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.673504    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-cacerts\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.673568 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.673530    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.673568 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.673558    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4169a3d-ae07-4eac-b274-85221be4282e-local-certs\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.697673 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.697614    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:10.774518 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.774089    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e4169a3d-ae07-4eac-b274-85221be4282e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.774518 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.774146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-cacerts\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.774518 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.774178    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.774518 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.774209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4169a3d-ae07-4eac-b274-85221be4282e-local-certs\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.774518 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.774303    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm8t2\" (UniqueName: \"kubernetes.io/projected/e4169a3d-ae07-4eac-b274-85221be4282e-kube-api-access-gm8t2\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.774518 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.774327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4169a3d-ae07-4eac-b274-85221be4282e-istio-token\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.774518 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.774351    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.775036 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.774846    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e4169a3d-ae07-4eac-b274-85221be4282e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.777877 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.777847    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-cacerts\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.778053 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.777881    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.778053 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.777912    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4169a3d-ae07-4eac-b274-85221be4282e-local-certs\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.778053 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.777974    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.783203 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.783170    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4169a3d-ae07-4eac-b274-85221be4282e-istio-token\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.783356 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.783272    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm8t2\" (UniqueName: \"kubernetes.io/projected/e4169a3d-ae07-4eac-b274-85221be4282e-kube-api-access-gm8t2\") pod \"istiod-openshift-gateway-7574459656-k7k4j\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:10.902602 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:10.902514    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:11.268778 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:11.268748    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"]
Jul 17 04:55:11.270157 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:55:11.270129    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4169a3d_ae07_4eac_b274_85221be4282e.slice/crio-05b28f8ea2c8b616f31105116e63ca02572fac41cbef72bc92d3546375c15ac2 WatchSource:0}: Error finding container 05b28f8ea2c8b616f31105116e63ca02572fac41cbef72bc92d3546375c15ac2: Status 404 returned error can't find the container with id 05b28f8ea2c8b616f31105116e63ca02572fac41cbef72bc92d3546375c15ac2
Jul 17 04:55:11.281744 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:11.281713    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt"]
Jul 17 04:55:11.283726 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:55:11.283690    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f802622_b57b_4356_8db1_f13d06156a56.slice/crio-f584361194e1826d4ac7cb977812846f9b28f22cbdff144a3aae30640fb260c9 WatchSource:0}: Error finding container f584361194e1826d4ac7cb977812846f9b28f22cbdff144a3aae30640fb260c9: Status 404 returned error can't find the container with id f584361194e1826d4ac7cb977812846f9b28f22cbdff144a3aae30640fb260c9
Jul 17 04:55:11.556444 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:11.556408    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:11.558088 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:11.558064    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jwzth" event={"ID":"548a08cb-f2ee-4702-b2f6-b9950026d9a5","Type":"ContainerStarted","Data":"194415c3785de750ec9a0087805c1993c623a1b748ce178ecf8ab48d3767d0d6"}
Jul 17 04:55:11.558261 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:11.558245    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-jwzth"
Jul 17 04:55:11.559297 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:11.559273    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt" event={"ID":"0f802622-b57b-4356-8db1-f13d06156a56","Type":"ContainerStarted","Data":"f584361194e1826d4ac7cb977812846f9b28f22cbdff144a3aae30640fb260c9"}
Jul 17 04:55:11.560373 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:11.560350    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j" event={"ID":"e4169a3d-ae07-4eac-b274-85221be4282e","Type":"ContainerStarted","Data":"05b28f8ea2c8b616f31105116e63ca02572fac41cbef72bc92d3546375c15ac2"}
Jul 17 04:55:11.561820 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:11.561793    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-khxfg" event={"ID":"f6fb8750-19d6-4a15-bb1f-9f913f2a2401","Type":"ContainerStarted","Data":"3485f15a0d01a65a345d0c1694541ee8d5de05a550a0c252d668ef233be6a2f6"}
Jul 17 04:55:11.561940 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:11.561843    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-khxfg"
Jul 17 04:55:11.573941 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:11.573878    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-jwzth" podStartSLOduration=1.779602153 podStartE2EDuration="4.573858931s" totalImagesPullingTime="2.794256778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:55:11.573033212 +0000 UTC m=+346.250639557" watchObservedRunningTime="2026-07-17 04:55:11.573858931 +0000 UTC m=+346.251465278"
Jul 17 04:55:11.594480 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:11.594405    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-khxfg" podStartSLOduration=2.322447879 podStartE2EDuration="5.594382103s" totalImagesPullingTime="3.271934224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:55:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:55:11.593814381 +0000 UTC m=+346.271420751" watchObservedRunningTime="2026-07-17 04:55:11.594382103 +0000 UTC m=+346.271988451"
Jul 17 04:55:14.580491 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:14.580444    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 17 04:55:14.580935 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:14.580542    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 17 04:55:14.587368 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:14.587340    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt" event={"ID":"0f802622-b57b-4356-8db1-f13d06156a56","Type":"ContainerStarted","Data":"604f2cd6c97a4661d0a50a6fa1b74e6a038ef18fa9ac247aaf660755d2ad7d62"}
Jul 17 04:55:14.623356 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:14.623304    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d686d4c64-7nnrt" podStartSLOduration=3.376444838 podStartE2EDuration="5.623289116s" totalImagesPullingTime="2.246844278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:55:14.621941561 +0000 UTC m=+349.299547907" watchObservedRunningTime="2026-07-17 04:55:14.623289116 +0000 UTC m=+349.300895462"
Jul 17 04:55:15.593760 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:15.593726    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j" event={"ID":"e4169a3d-ae07-4eac-b274-85221be4282e","Type":"ContainerStarted","Data":"5600ae8cf3b48eb203f5ce3d2a2105669323daf741a68060ea7c75bbf52344e7"}
Jul 17 04:55:15.594233 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:15.593937    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:15.595726 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:15.595700    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-k7k4j container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 04:55:15.595842 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:15.595749    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j" podUID="e4169a3d-ae07-4eac-b274-85221be4282e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 04:55:15.662039 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:15.661952    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j" podStartSLOduration=2.354038613 podStartE2EDuration="5.661928475s" totalImagesPullingTime="3.307889862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:55:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:55:15.660190829 +0000 UTC m=+350.337797175" watchObservedRunningTime="2026-07-17 04:55:15.661928475 +0000 UTC m=+350.339534821"
Jul 17 04:55:15.723765 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:15.723725    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:15.823094 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:15.823054    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:16.106370 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.106333    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"]
Jul 17 04:55:16.109890 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.109868    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.113370 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.113353    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kf9l4\""
Jul 17 04:55:16.144524 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.144488    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"]
Jul 17 04:55:16.170552 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.170520    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:16.226784 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.226738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c159e604-d698-4dbc-8a34-9dbb21687c4f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.226976 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.226799    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jbkh\" (UniqueName: \"kubernetes.io/projected/c159e604-d698-4dbc-8a34-9dbb21687c4f-kube-api-access-5jbkh\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.226976 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.226833    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c159e604-d698-4dbc-8a34-9dbb21687c4f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.226976 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.226854    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c159e604-d698-4dbc-8a34-9dbb21687c4f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.226976 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.226918    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c159e604-d698-4dbc-8a34-9dbb21687c4f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.226976 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.226949    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c159e604-d698-4dbc-8a34-9dbb21687c4f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.227196 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.226990    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c159e604-d698-4dbc-8a34-9dbb21687c4f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.227196 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.227012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c159e604-d698-4dbc-8a34-9dbb21687c4f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.227196 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.227031    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c159e604-d698-4dbc-8a34-9dbb21687c4f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.301649 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.301588    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:16.327949 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.327904    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c159e604-d698-4dbc-8a34-9dbb21687c4f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.327949 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.327958    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jbkh\" (UniqueName: \"kubernetes.io/projected/c159e604-d698-4dbc-8a34-9dbb21687c4f-kube-api-access-5jbkh\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.328226 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.328079    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c159e604-d698-4dbc-8a34-9dbb21687c4f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.328226 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.328112    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c159e604-d698-4dbc-8a34-9dbb21687c4f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.328226 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.328145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c159e604-d698-4dbc-8a34-9dbb21687c4f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.328226 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.328166    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c159e604-d698-4dbc-8a34-9dbb21687c4f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.328226 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.328208    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c159e604-d698-4dbc-8a34-9dbb21687c4f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.328514 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.328245    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c159e604-d698-4dbc-8a34-9dbb21687c4f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.328514 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.328270    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c159e604-d698-4dbc-8a34-9dbb21687c4f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.328514 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.328384    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c159e604-d698-4dbc-8a34-9dbb21687c4f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.328764 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.328741    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c159e604-d698-4dbc-8a34-9dbb21687c4f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.328861 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.328836    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c159e604-d698-4dbc-8a34-9dbb21687c4f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.329093 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.329063    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c159e604-d698-4dbc-8a34-9dbb21687c4f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.329378 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.329074    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c159e604-d698-4dbc-8a34-9dbb21687c4f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.330937 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.330910    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c159e604-d698-4dbc-8a34-9dbb21687c4f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.331131 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.331111    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c159e604-d698-4dbc-8a34-9dbb21687c4f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.339152 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.339123    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c159e604-d698-4dbc-8a34-9dbb21687c4f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.339441 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.339416    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jbkh\" (UniqueName: \"kubernetes.io/projected/c159e604-d698-4dbc-8a34-9dbb21687c4f-kube-api-access-5jbkh\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lnzm8\" (UID: \"c159e604-d698-4dbc-8a34-9dbb21687c4f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.407534 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.407446    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:16.420520 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.420487    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:16.566244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.566217    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"]
Jul 17 04:55:16.568191 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:55:16.568147    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc159e604_d698_4dbc_8a34_9dbb21687c4f.slice/crio-a9dd75c6c4701d16a2c8206aaf4d58b1a4ff5e5c5bb8358bfe5d4f0483fb19bb WatchSource:0}: Error finding container a9dd75c6c4701d16a2c8206aaf4d58b1a4ff5e5c5bb8358bfe5d4f0483fb19bb: Status 404 returned error can't find the container with id a9dd75c6c4701d16a2c8206aaf4d58b1a4ff5e5c5bb8358bfe5d4f0483fb19bb
Jul 17 04:55:16.599672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.599611    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8" event={"ID":"c159e604-d698-4dbc-8a34-9dbb21687c4f","Type":"ContainerStarted","Data":"a9dd75c6c4701d16a2c8206aaf4d58b1a4ff5e5c5bb8358bfe5d4f0483fb19bb"}
Jul 17 04:55:16.600496 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:16.600470    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:17.495135 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.495009    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:17.555226 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.555193    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm"]
Jul 17 04:55:17.558760 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.558733    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm"
Jul 17 04:55:17.561379 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.561325    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 17 04:55:17.561505 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.561489    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-ffcxh\""
Jul 17 04:55:17.567457 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.567416    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7jcdx"]
Jul 17 04:55:17.572542 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.572498    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm"]
Jul 17 04:55:17.572717 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.572670    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jcdx"
Jul 17 04:55:17.575352 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.575295    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 17 04:55:17.576341 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.575616    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qx2r7\""
Jul 17 04:55:17.580926 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.580839    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:17.583534 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.583507    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7jcdx"]
Jul 17 04:55:17.644380 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.644337    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znw75\" (UniqueName: \"kubernetes.io/projected/b40a61e0-5e08-4672-b57e-52450ab0129b-kube-api-access-znw75\") pod \"kserve-controller-manager-d6f4b65b8-sqpxm\" (UID: \"b40a61e0-5e08-4672-b57e-52450ab0129b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm"
Jul 17 04:55:17.644893 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.644405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b40a61e0-5e08-4672-b57e-52450ab0129b-cert\") pod \"kserve-controller-manager-d6f4b65b8-sqpxm\" (UID: \"b40a61e0-5e08-4672-b57e-52450ab0129b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm"
Jul 17 04:55:17.644893 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.644451    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tdmv\" (UniqueName: \"kubernetes.io/projected/8ee17883-7f0b-4375-94ae-2d23ced919e1-kube-api-access-4tdmv\") pod \"llmisvc-controller-manager-777c6bd7d5-7jcdx\" (UID: \"8ee17883-7f0b-4375-94ae-2d23ced919e1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jcdx"
Jul 17 04:55:17.644893 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.644750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ee17883-7f0b-4375-94ae-2d23ced919e1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7jcdx\" (UID: \"8ee17883-7f0b-4375-94ae-2d23ced919e1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jcdx"
Jul 17 04:55:17.745721 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.745622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ee17883-7f0b-4375-94ae-2d23ced919e1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7jcdx\" (UID: \"8ee17883-7f0b-4375-94ae-2d23ced919e1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jcdx"
Jul 17 04:55:17.745721 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.745684    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znw75\" (UniqueName: \"kubernetes.io/projected/b40a61e0-5e08-4672-b57e-52450ab0129b-kube-api-access-znw75\") pod \"kserve-controller-manager-d6f4b65b8-sqpxm\" (UID: \"b40a61e0-5e08-4672-b57e-52450ab0129b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm"
Jul 17 04:55:17.745721 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.745706    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b40a61e0-5e08-4672-b57e-52450ab0129b-cert\") pod \"kserve-controller-manager-d6f4b65b8-sqpxm\" (UID: \"b40a61e0-5e08-4672-b57e-52450ab0129b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm"
Jul 17 04:55:17.746116 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.745740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tdmv\" (UniqueName: \"kubernetes.io/projected/8ee17883-7f0b-4375-94ae-2d23ced919e1-kube-api-access-4tdmv\") pod \"llmisvc-controller-manager-777c6bd7d5-7jcdx\" (UID: \"8ee17883-7f0b-4375-94ae-2d23ced919e1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jcdx"
Jul 17 04:55:17.746116 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:55:17.745938    2564 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 17 04:55:17.746116 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:55:17.746027    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b40a61e0-5e08-4672-b57e-52450ab0129b-cert podName:b40a61e0-5e08-4672-b57e-52450ab0129b nodeName:}" failed. No retries permitted until 2026-07-17 04:55:18.246004619 +0000 UTC m=+352.923610946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b40a61e0-5e08-4672-b57e-52450ab0129b-cert") pod "kserve-controller-manager-d6f4b65b8-sqpxm" (UID: "b40a61e0-5e08-4672-b57e-52450ab0129b") : secret "kserve-webhook-server-cert" not found
Jul 17 04:55:17.748823 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.748799    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ee17883-7f0b-4375-94ae-2d23ced919e1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7jcdx\" (UID: \"8ee17883-7f0b-4375-94ae-2d23ced919e1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jcdx"
Jul 17 04:55:17.755451 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.755415    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tdmv\" (UniqueName: \"kubernetes.io/projected/8ee17883-7f0b-4375-94ae-2d23ced919e1-kube-api-access-4tdmv\") pod \"llmisvc-controller-manager-777c6bd7d5-7jcdx\" (UID: \"8ee17883-7f0b-4375-94ae-2d23ced919e1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jcdx"
Jul 17 04:55:17.755738 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.755717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znw75\" (UniqueName: \"kubernetes.io/projected/b40a61e0-5e08-4672-b57e-52450ab0129b-kube-api-access-znw75\") pod \"kserve-controller-manager-d6f4b65b8-sqpxm\" (UID: \"b40a61e0-5e08-4672-b57e-52450ab0129b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm"
Jul 17 04:55:17.775213 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.775176    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:17.887702 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.887661    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jcdx"
Jul 17 04:55:17.903508 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:17.903452    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:18.071402 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:18.071365    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7jcdx"]
Jul 17 04:55:18.074042 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:55:18.074008    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8ee17883_7f0b_4375_94ae_2d23ced919e1.slice/crio-014f932f8297fd425b159e2f0e27ea68e36bcbd21124106424fb8016779539f1 WatchSource:0}: Error finding container 014f932f8297fd425b159e2f0e27ea68e36bcbd21124106424fb8016779539f1: Status 404 returned error can't find the container with id 014f932f8297fd425b159e2f0e27ea68e36bcbd21124106424fb8016779539f1
Jul 17 04:55:18.252729 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:18.252690    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b40a61e0-5e08-4672-b57e-52450ab0129b-cert\") pod \"kserve-controller-manager-d6f4b65b8-sqpxm\" (UID: \"b40a61e0-5e08-4672-b57e-52450ab0129b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm"
Jul 17 04:55:18.255418 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:18.255392    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b40a61e0-5e08-4672-b57e-52450ab0129b-cert\") pod \"kserve-controller-manager-d6f4b65b8-sqpxm\" (UID: \"b40a61e0-5e08-4672-b57e-52450ab0129b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm"
Jul 17 04:55:18.474504 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:18.474400    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm"
Jul 17 04:55:18.613177 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:18.613139    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jcdx" event={"ID":"8ee17883-7f0b-4375-94ae-2d23ced919e1","Type":"ContainerStarted","Data":"014f932f8297fd425b159e2f0e27ea68e36bcbd21124106424fb8016779539f1"}
Jul 17 04:55:18.767243 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:18.767162    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:18.865224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:18.865161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:18.980688 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:18.980647    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:19.362672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:19.362618    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 17 04:55:19.362767 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:19.362722    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 17 04:55:19.362767 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:19.362755    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 17 04:55:19.433214 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:19.433178    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm"]
Jul 17 04:55:19.434683 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:55:19.434616    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb40a61e0_5e08_4672_b57e_52450ab0129b.slice/crio-e5e84f9c5282b84122984fe3959fdae5b03ac3eb6cf6ed553568f4193cf93d2e WatchSource:0}: Error finding container e5e84f9c5282b84122984fe3959fdae5b03ac3eb6cf6ed553568f4193cf93d2e: Status 404 returned error can't find the container with id e5e84f9c5282b84122984fe3959fdae5b03ac3eb6cf6ed553568f4193cf93d2e
Jul 17 04:55:19.620957 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:19.620918    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8" event={"ID":"c159e604-d698-4dbc-8a34-9dbb21687c4f","Type":"ContainerStarted","Data":"986e5aa1d04ccad7dbb9fcba19c01cabb696a9cd45e758fff909f542577d2f73"}
Jul 17 04:55:19.622325 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:19.622298    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm" event={"ID":"b40a61e0-5e08-4672-b57e-52450ab0129b","Type":"ContainerStarted","Data":"e5e84f9c5282b84122984fe3959fdae5b03ac3eb6cf6ed553568f4193cf93d2e"}
Jul 17 04:55:19.658457 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:19.658384    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8" podStartSLOduration=0.866294058 podStartE2EDuration="3.658359436s" totalImagesPullingTime="2.792065378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:55:19.654548721 +0000 UTC m=+354.332155069" watchObservedRunningTime="2026-07-17 04:55:19.658359436 +0000 UTC m=+354.335965783"
Jul 17 04:55:20.420879 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.420839    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:20.425577 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.425553    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:20.466385 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.466349    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"]
Jul 17 04:55:20.466612 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.466585    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j" podUID="e4169a3d-ae07-4eac-b274-85221be4282e" containerName="discovery" containerID="cri-o://5600ae8cf3b48eb203f5ce3d2a2105669323daf741a68060ea7c75bbf52344e7" gracePeriod=30
Jul 17 04:55:20.638126 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.638084    2564 generic.go:356] "Generic (PLEG): container finished" podID="e4169a3d-ae07-4eac-b274-85221be4282e" containerID="5600ae8cf3b48eb203f5ce3d2a2105669323daf741a68060ea7c75bbf52344e7" exitCode=0
Jul 17 04:55:20.638536 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.638461    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j" event={"ID":"e4169a3d-ae07-4eac-b274-85221be4282e","Type":"ContainerDied","Data":"5600ae8cf3b48eb203f5ce3d2a2105669323daf741a68060ea7c75bbf52344e7"}
Jul 17 04:55:20.639097 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.639074    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:20.640238 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.640201    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lnzm8"
Jul 17 04:55:20.760743 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.760706    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:20.882247 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.882211    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-istio-kubeconfig\") pod \"e4169a3d-ae07-4eac-b274-85221be4282e\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") "
Jul 17 04:55:20.882508 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.882381    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm8t2\" (UniqueName: \"kubernetes.io/projected/e4169a3d-ae07-4eac-b274-85221be4282e-kube-api-access-gm8t2\") pod \"e4169a3d-ae07-4eac-b274-85221be4282e\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") "
Jul 17 04:55:20.882508 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.882413    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-istio-csr-dns-cert\") pod \"e4169a3d-ae07-4eac-b274-85221be4282e\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") "
Jul 17 04:55:20.882508 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.882435    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e4169a3d-ae07-4eac-b274-85221be4282e-istio-csr-ca-configmap\") pod \"e4169a3d-ae07-4eac-b274-85221be4282e\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") "
Jul 17 04:55:20.882508 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.882475    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4169a3d-ae07-4eac-b274-85221be4282e-local-certs\") pod \"e4169a3d-ae07-4eac-b274-85221be4282e\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") "
Jul 17 04:55:20.882734 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.882532    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-cacerts\") pod \"e4169a3d-ae07-4eac-b274-85221be4282e\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") "
Jul 17 04:55:20.882734 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.882557    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4169a3d-ae07-4eac-b274-85221be4282e-istio-token\") pod \"e4169a3d-ae07-4eac-b274-85221be4282e\" (UID: \"e4169a3d-ae07-4eac-b274-85221be4282e\") "
Jul 17 04:55:20.882957 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.882898    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4169a3d-ae07-4eac-b274-85221be4282e-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e4169a3d-ae07-4eac-b274-85221be4282e" (UID: "e4169a3d-ae07-4eac-b274-85221be4282e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 04:55:20.884931 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.884900    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e4169a3d-ae07-4eac-b274-85221be4282e" (UID: "e4169a3d-ae07-4eac-b274-85221be4282e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 04:55:20.885040 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.884994    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-cacerts" (OuterVolumeSpecName: "cacerts") pod "e4169a3d-ae07-4eac-b274-85221be4282e" (UID: "e4169a3d-ae07-4eac-b274-85221be4282e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 04:55:20.885274 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.885243    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4169a3d-ae07-4eac-b274-85221be4282e-local-certs" (OuterVolumeSpecName: "local-certs") pod "e4169a3d-ae07-4eac-b274-85221be4282e" (UID: "e4169a3d-ae07-4eac-b274-85221be4282e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:55:20.885274 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.885271    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e4169a3d-ae07-4eac-b274-85221be4282e" (UID: "e4169a3d-ae07-4eac-b274-85221be4282e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 04:55:20.885535 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.885508    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4169a3d-ae07-4eac-b274-85221be4282e-istio-token" (OuterVolumeSpecName: "istio-token") pod "e4169a3d-ae07-4eac-b274-85221be4282e" (UID: "e4169a3d-ae07-4eac-b274-85221be4282e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:55:20.885603 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.885535    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4169a3d-ae07-4eac-b274-85221be4282e-kube-api-access-gm8t2" (OuterVolumeSpecName: "kube-api-access-gm8t2") pod "e4169a3d-ae07-4eac-b274-85221be4282e" (UID: "e4169a3d-ae07-4eac-b274-85221be4282e"). InnerVolumeSpecName "kube-api-access-gm8t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:55:20.983935 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.983829    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm8t2\" (UniqueName: \"kubernetes.io/projected/e4169a3d-ae07-4eac-b274-85221be4282e-kube-api-access-gm8t2\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:55:20.983935 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.983878    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-istio-csr-dns-cert\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:55:20.983935 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.983889    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e4169a3d-ae07-4eac-b274-85221be4282e-istio-csr-ca-configmap\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:55:20.983935 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.983899    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4169a3d-ae07-4eac-b274-85221be4282e-local-certs\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:55:20.983935 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.983908    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-cacerts\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:55:20.983935 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.983916    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4169a3d-ae07-4eac-b274-85221be4282e-istio-token\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:55:20.983935 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:20.983923    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4169a3d-ae07-4eac-b274-85221be4282e-istio-kubeconfig\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:55:21.646488 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:21.646439    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j" event={"ID":"e4169a3d-ae07-4eac-b274-85221be4282e","Type":"ContainerDied","Data":"05b28f8ea2c8b616f31105116e63ca02572fac41cbef72bc92d3546375c15ac2"}
Jul 17 04:55:21.646943 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:21.646525    2564 scope.go:117] "RemoveContainer" containerID="5600ae8cf3b48eb203f5ce3d2a2105669323daf741a68060ea7c75bbf52344e7"
Jul 17 04:55:21.646943 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:21.646467    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"
Jul 17 04:55:21.673967 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:21.673923    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"]
Jul 17 04:55:21.677749 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:21.677716    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k7k4j"]
Jul 17 04:55:21.859795 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:21.859403    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4169a3d-ae07-4eac-b274-85221be4282e" path="/var/lib/kubelet/pods/e4169a3d-ae07-4eac-b274-85221be4282e/volumes"
Jul 17 04:55:22.573238 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:22.573206    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-khxfg"
Jul 17 04:55:22.575371 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:22.575346    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-jwzth"
Jul 17 04:55:23.661096 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:23.661038    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jcdx" event={"ID":"8ee17883-7f0b-4375-94ae-2d23ced919e1","Type":"ContainerStarted","Data":"47480862e0086f8759d5991f2854a8ca9e26c86f28a5dfaa5456eb72bf3f6c35"}
Jul 17 04:55:23.661521 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:23.661115    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jcdx"
Jul 17 04:55:23.662619 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:23.662594    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm" event={"ID":"b40a61e0-5e08-4672-b57e-52450ab0129b","Type":"ContainerStarted","Data":"349abb7f62fa87469f0fbc496fee0e8d1f3f8270259d3a40917462fff2d6e498"}
Jul 17 04:55:23.662763 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:23.662681    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm"
Jul 17 04:55:23.683337 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:23.683282    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jcdx" podStartSLOduration=2.140096281 podStartE2EDuration="6.6832646s" totalImagesPullingTime="4.543168319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:55:23.681242023 +0000 UTC m=+358.358848369" watchObservedRunningTime="2026-07-17 04:55:23.6832646 +0000 UTC m=+358.360870945"
Jul 17 04:55:23.700040 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:23.699986    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm" podStartSLOduration=3.5218168690000002 podStartE2EDuration="6.699969114s" totalImagesPullingTime="3.178152245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:55:23.697970618 +0000 UTC m=+358.375576973" watchObservedRunningTime="2026-07-17 04:55:23.699969114 +0000 UTC m=+358.377575460"
Jul 17 04:55:48.568057 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:48.568020    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:48.668354 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:48.668314    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:55:54.670510 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:54.670479    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jcdx"
Jul 17 04:55:54.673657 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:55:54.673615    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sqpxm"
Jul 17 04:56:07.456258 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.456207    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:07.555191 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.555151    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:07.566880 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.566844    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vf2qk"]
Jul 17 04:56:07.567330 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.567310    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4169a3d-ae07-4eac-b274-85221be4282e" containerName="discovery"
Jul 17 04:56:07.567423 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.567332    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4169a3d-ae07-4eac-b274-85221be4282e" containerName="discovery"
Jul 17 04:56:07.567423 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.567411    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4169a3d-ae07-4eac-b274-85221be4282e" containerName="discovery"
Jul 17 04:56:07.574562 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.574532    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vf2qk"
Jul 17 04:56:07.577448 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.577375    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 04:56:07.577686 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.577665    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jhxbd\""
Jul 17 04:56:07.578484 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.578462    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 04:56:07.579890 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.579867    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vf2qk"]
Jul 17 04:56:07.601937 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.601906    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws7b5\" (UniqueName: \"kubernetes.io/projected/d115edbb-53b5-485c-82e5-32541af7355b-kube-api-access-ws7b5\") pod \"kuadrant-operator-catalog-vf2qk\" (UID: \"d115edbb-53b5-485c-82e5-32541af7355b\") " pod="kuadrant-system/kuadrant-operator-catalog-vf2qk"
Jul 17 04:56:07.654764 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.654725    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:07.702442 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.702405    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws7b5\" (UniqueName: \"kubernetes.io/projected/d115edbb-53b5-485c-82e5-32541af7355b-kube-api-access-ws7b5\") pod \"kuadrant-operator-catalog-vf2qk\" (UID: \"d115edbb-53b5-485c-82e5-32541af7355b\") " pod="kuadrant-system/kuadrant-operator-catalog-vf2qk"
Jul 17 04:56:07.711177 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.711118    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws7b5\" (UniqueName: \"kubernetes.io/projected/d115edbb-53b5-485c-82e5-32541af7355b-kube-api-access-ws7b5\") pod \"kuadrant-operator-catalog-vf2qk\" (UID: \"d115edbb-53b5-485c-82e5-32541af7355b\") " pod="kuadrant-system/kuadrant-operator-catalog-vf2qk"
Jul 17 04:56:07.888359 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.888310    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vf2qk"
Jul 17 04:56:07.937240 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:07.937202    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vf2qk"]
Jul 17 04:56:08.029720 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:08.029690    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vf2qk"]
Jul 17 04:56:08.032149 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:56:08.032119    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd115edbb_53b5_485c_82e5_32541af7355b.slice/crio-7fc2a381f43f8af4262f8649de31d73eb1422ed3136868c097b3db0a9ace226b WatchSource:0}: Error finding container 7fc2a381f43f8af4262f8649de31d73eb1422ed3136868c097b3db0a9ace226b: Status 404 returned error can't find the container with id 7fc2a381f43f8af4262f8649de31d73eb1422ed3136868c097b3db0a9ace226b
Jul 17 04:56:08.148918 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:08.148885    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dcb89"]
Jul 17 04:56:08.152195 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:08.152167    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dcb89"
Jul 17 04:56:08.161163 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:08.161137    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dcb89"]
Jul 17 04:56:08.207103 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:08.207058    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjvnk\" (UniqueName: \"kubernetes.io/projected/db5fdb6b-7eb4-4fd1-b6e1-c46e72497176-kube-api-access-gjvnk\") pod \"kuadrant-operator-catalog-dcb89\" (UID: \"db5fdb6b-7eb4-4fd1-b6e1-c46e72497176\") " pod="kuadrant-system/kuadrant-operator-catalog-dcb89"
Jul 17 04:56:08.308406 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:08.308370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjvnk\" (UniqueName: \"kubernetes.io/projected/db5fdb6b-7eb4-4fd1-b6e1-c46e72497176-kube-api-access-gjvnk\") pod \"kuadrant-operator-catalog-dcb89\" (UID: \"db5fdb6b-7eb4-4fd1-b6e1-c46e72497176\") " pod="kuadrant-system/kuadrant-operator-catalog-dcb89"
Jul 17 04:56:08.317146 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:08.317107    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjvnk\" (UniqueName: \"kubernetes.io/projected/db5fdb6b-7eb4-4fd1-b6e1-c46e72497176-kube-api-access-gjvnk\") pod \"kuadrant-operator-catalog-dcb89\" (UID: \"db5fdb6b-7eb4-4fd1-b6e1-c46e72497176\") " pod="kuadrant-system/kuadrant-operator-catalog-dcb89"
Jul 17 04:56:08.369988 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:08.369945    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:08.465075 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:08.465035    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dcb89"
Jul 17 04:56:08.578020 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:08.577879    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:08.616157 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:08.616131    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dcb89"]
Jul 17 04:56:08.618495 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:56:08.618449    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb5fdb6b_7eb4_4fd1_b6e1_c46e72497176.slice/crio-13c03e753c55d15f42f4f7d318816598c226d259498fa61f42fe17659e9e773c WatchSource:0}: Error finding container 13c03e753c55d15f42f4f7d318816598c226d259498fa61f42fe17659e9e773c: Status 404 returned error can't find the container with id 13c03e753c55d15f42f4f7d318816598c226d259498fa61f42fe17659e9e773c
Jul 17 04:56:08.881716 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:08.881617    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dcb89" event={"ID":"db5fdb6b-7eb4-4fd1-b6e1-c46e72497176","Type":"ContainerStarted","Data":"13c03e753c55d15f42f4f7d318816598c226d259498fa61f42fe17659e9e773c"}
Jul 17 04:56:08.882684 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:08.882662    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vf2qk" event={"ID":"d115edbb-53b5-485c-82e5-32541af7355b","Type":"ContainerStarted","Data":"7fc2a381f43f8af4262f8649de31d73eb1422ed3136868c097b3db0a9ace226b"}
Jul 17 04:56:10.897544 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:10.897501    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dcb89" event={"ID":"db5fdb6b-7eb4-4fd1-b6e1-c46e72497176","Type":"ContainerStarted","Data":"d04cccbcc20dac2c2a0e7aa89b4cfc7f9d9e1e387cc4ee36b37b6a58540bcd61"}
Jul 17 04:56:10.899144 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:10.899116    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vf2qk" event={"ID":"d115edbb-53b5-485c-82e5-32541af7355b","Type":"ContainerStarted","Data":"1edf21e7e0ce484193d5560f9f3db4df9265f220b2776a8f166f99bf51e809d3"}
Jul 17 04:56:10.899273 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:10.899154    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-vf2qk" podUID="d115edbb-53b5-485c-82e5-32541af7355b" containerName="registry-server" containerID="cri-o://1edf21e7e0ce484193d5560f9f3db4df9265f220b2776a8f166f99bf51e809d3" gracePeriod=2
Jul 17 04:56:10.913455 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:10.913407    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dcb89" podStartSLOduration=1.394797976 podStartE2EDuration="2.913390389s" totalImagesPullingTime="1.518592413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:56:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:56:10.912484563 +0000 UTC m=+405.590090910" watchObservedRunningTime="2026-07-17 04:56:10.913390389 +0000 UTC m=+405.590996734"
Jul 17 04:56:10.927675 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:10.927588    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vf2qk" podStartSLOduration=1.820910968 podStartE2EDuration="3.927571589s" totalImagesPullingTime="2.106660621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:56:10.925913559 +0000 UTC m=+405.603519904" watchObservedRunningTime="2026-07-17 04:56:10.927571589 +0000 UTC m=+405.605177970"
Jul 17 04:56:11.158991 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:11.158919    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vf2qk"
Jul 17 04:56:11.234985 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:11.234944    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws7b5\" (UniqueName: \"kubernetes.io/projected/d115edbb-53b5-485c-82e5-32541af7355b-kube-api-access-ws7b5\") pod \"d115edbb-53b5-485c-82e5-32541af7355b\" (UID: \"d115edbb-53b5-485c-82e5-32541af7355b\") "
Jul 17 04:56:11.237342 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:11.237309    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d115edbb-53b5-485c-82e5-32541af7355b-kube-api-access-ws7b5" (OuterVolumeSpecName: "kube-api-access-ws7b5") pod "d115edbb-53b5-485c-82e5-32541af7355b" (UID: "d115edbb-53b5-485c-82e5-32541af7355b"). InnerVolumeSpecName "kube-api-access-ws7b5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:56:11.336609 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:11.336573    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws7b5\" (UniqueName: \"kubernetes.io/projected/d115edbb-53b5-485c-82e5-32541af7355b-kube-api-access-ws7b5\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:56:11.905330 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:11.905298    2564 generic.go:356] "Generic (PLEG): container finished" podID="d115edbb-53b5-485c-82e5-32541af7355b" containerID="1edf21e7e0ce484193d5560f9f3db4df9265f220b2776a8f166f99bf51e809d3" exitCode=0
Jul 17 04:56:11.905802 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:11.905351    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vf2qk"
Jul 17 04:56:11.905802 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:11.905357    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vf2qk" event={"ID":"d115edbb-53b5-485c-82e5-32541af7355b","Type":"ContainerDied","Data":"1edf21e7e0ce484193d5560f9f3db4df9265f220b2776a8f166f99bf51e809d3"}
Jul 17 04:56:11.905802 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:11.905403    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vf2qk" event={"ID":"d115edbb-53b5-485c-82e5-32541af7355b","Type":"ContainerDied","Data":"7fc2a381f43f8af4262f8649de31d73eb1422ed3136868c097b3db0a9ace226b"}
Jul 17 04:56:11.905802 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:11.905424    2564 scope.go:117] "RemoveContainer" containerID="1edf21e7e0ce484193d5560f9f3db4df9265f220b2776a8f166f99bf51e809d3"
Jul 17 04:56:11.915293 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:11.915275    2564 scope.go:117] "RemoveContainer" containerID="1edf21e7e0ce484193d5560f9f3db4df9265f220b2776a8f166f99bf51e809d3"
Jul 17 04:56:11.915599 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:56:11.915577    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1edf21e7e0ce484193d5560f9f3db4df9265f220b2776a8f166f99bf51e809d3\": container with ID starting with 1edf21e7e0ce484193d5560f9f3db4df9265f220b2776a8f166f99bf51e809d3 not found: ID does not exist" containerID="1edf21e7e0ce484193d5560f9f3db4df9265f220b2776a8f166f99bf51e809d3"
Jul 17 04:56:11.915711 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:11.915609    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1edf21e7e0ce484193d5560f9f3db4df9265f220b2776a8f166f99bf51e809d3"} err="failed to get container status \"1edf21e7e0ce484193d5560f9f3db4df9265f220b2776a8f166f99bf51e809d3\": rpc error: code = NotFound desc = could not find container \"1edf21e7e0ce484193d5560f9f3db4df9265f220b2776a8f166f99bf51e809d3\": container with ID starting with 1edf21e7e0ce484193d5560f9f3db4df9265f220b2776a8f166f99bf51e809d3 not found: ID does not exist"
Jul 17 04:56:11.922869 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:11.922835    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vf2qk"]
Jul 17 04:56:11.928813 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:11.928782    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vf2qk"]
Jul 17 04:56:13.857770 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:13.857736    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d115edbb-53b5-485c-82e5-32541af7355b" path="/var/lib/kubelet/pods/d115edbb-53b5-485c-82e5-32541af7355b/volumes"
Jul 17 04:56:18.465821 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:18.465781    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-dcb89"
Jul 17 04:56:18.466278 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:18.465858    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-dcb89"
Jul 17 04:56:18.491659 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:18.491609    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-dcb89"
Jul 17 04:56:18.966905 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:18.966873    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-dcb89"
Jul 17 04:56:23.183335 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.183306    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl"]
Jul 17 04:56:23.183735 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.183698    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d115edbb-53b5-485c-82e5-32541af7355b" containerName="registry-server"
Jul 17 04:56:23.183735 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.183710    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d115edbb-53b5-485c-82e5-32541af7355b" containerName="registry-server"
Jul 17 04:56:23.183828 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.183774    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d115edbb-53b5-485c-82e5-32541af7355b" containerName="registry-server"
Jul 17 04:56:23.186847 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.186831    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl"
Jul 17 04:56:23.189151 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.189131    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-h9bvw\""
Jul 17 04:56:23.195309 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.195285    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl"]
Jul 17 04:56:23.238183 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.238145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/305d4762-12b2-4176-95a9-513fa9be21ea-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl\" (UID: \"305d4762-12b2-4176-95a9-513fa9be21ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl"
Jul 17 04:56:23.238183 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.238187    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/305d4762-12b2-4176-95a9-513fa9be21ea-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl\" (UID: \"305d4762-12b2-4176-95a9-513fa9be21ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl"
Jul 17 04:56:23.238396 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.238295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gzgk\" (UniqueName: \"kubernetes.io/projected/305d4762-12b2-4176-95a9-513fa9be21ea-kube-api-access-2gzgk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl\" (UID: \"305d4762-12b2-4176-95a9-513fa9be21ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl"
Jul 17 04:56:23.339179 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.339141    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gzgk\" (UniqueName: \"kubernetes.io/projected/305d4762-12b2-4176-95a9-513fa9be21ea-kube-api-access-2gzgk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl\" (UID: \"305d4762-12b2-4176-95a9-513fa9be21ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl"
Jul 17 04:56:23.339366 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.339214    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/305d4762-12b2-4176-95a9-513fa9be21ea-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl\" (UID: \"305d4762-12b2-4176-95a9-513fa9be21ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl"
Jul 17 04:56:23.339366 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.339247    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/305d4762-12b2-4176-95a9-513fa9be21ea-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl\" (UID: \"305d4762-12b2-4176-95a9-513fa9be21ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl"
Jul 17 04:56:23.339733 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.339712    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/305d4762-12b2-4176-95a9-513fa9be21ea-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl\" (UID: \"305d4762-12b2-4176-95a9-513fa9be21ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl"
Jul 17 04:56:23.339782 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.339729    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/305d4762-12b2-4176-95a9-513fa9be21ea-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl\" (UID: \"305d4762-12b2-4176-95a9-513fa9be21ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl"
Jul 17 04:56:23.347259 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.347237    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gzgk\" (UniqueName: \"kubernetes.io/projected/305d4762-12b2-4176-95a9-513fa9be21ea-kube-api-access-2gzgk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl\" (UID: \"305d4762-12b2-4176-95a9-513fa9be21ea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl"
Jul 17 04:56:23.496841 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.496748    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl"
Jul 17 04:56:23.581528 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.581493    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d"]
Jul 17 04:56:23.586882 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.586852    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d"
Jul 17 04:56:23.593375 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.593338    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d"]
Jul 17 04:56:23.642511 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.642474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/652576b9-bff6-4f07-ac33-549f81b60e6e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d\" (UID: \"652576b9-bff6-4f07-ac33-549f81b60e6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d"
Jul 17 04:56:23.642698 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.642515    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4hdx\" (UniqueName: \"kubernetes.io/projected/652576b9-bff6-4f07-ac33-549f81b60e6e-kube-api-access-l4hdx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d\" (UID: \"652576b9-bff6-4f07-ac33-549f81b60e6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d"
Jul 17 04:56:23.642698 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.642669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/652576b9-bff6-4f07-ac33-549f81b60e6e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d\" (UID: \"652576b9-bff6-4f07-ac33-549f81b60e6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d"
Jul 17 04:56:23.648440 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.648410    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl"]
Jul 17 04:56:23.650555 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:56:23.650528    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod305d4762_12b2_4176_95a9_513fa9be21ea.slice/crio-faff31b6df373995e39ff3c42572bd6bd9e85c573703178c2ca20c5520affcbb WatchSource:0}: Error finding container faff31b6df373995e39ff3c42572bd6bd9e85c573703178c2ca20c5520affcbb: Status 404 returned error can't find the container with id faff31b6df373995e39ff3c42572bd6bd9e85c573703178c2ca20c5520affcbb
Jul 17 04:56:23.743938 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.743889    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/652576b9-bff6-4f07-ac33-549f81b60e6e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d\" (UID: \"652576b9-bff6-4f07-ac33-549f81b60e6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d"
Jul 17 04:56:23.744098 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.743998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/652576b9-bff6-4f07-ac33-549f81b60e6e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d\" (UID: \"652576b9-bff6-4f07-ac33-549f81b60e6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d"
Jul 17 04:56:23.744098 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.744031    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4hdx\" (UniqueName: \"kubernetes.io/projected/652576b9-bff6-4f07-ac33-549f81b60e6e-kube-api-access-l4hdx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d\" (UID: \"652576b9-bff6-4f07-ac33-549f81b60e6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d"
Jul 17 04:56:23.744276 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.744257    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/652576b9-bff6-4f07-ac33-549f81b60e6e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d\" (UID: \"652576b9-bff6-4f07-ac33-549f81b60e6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d"
Jul 17 04:56:23.744323 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.744305    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/652576b9-bff6-4f07-ac33-549f81b60e6e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d\" (UID: \"652576b9-bff6-4f07-ac33-549f81b60e6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d"
Jul 17 04:56:23.752096 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.752042    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4hdx\" (UniqueName: \"kubernetes.io/projected/652576b9-bff6-4f07-ac33-549f81b60e6e-kube-api-access-l4hdx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d\" (UID: \"652576b9-bff6-4f07-ac33-549f81b60e6e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d"
Jul 17 04:56:23.899687 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.899617    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d"
Jul 17 04:56:23.971555 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.971522    2564 generic.go:356] "Generic (PLEG): container finished" podID="305d4762-12b2-4176-95a9-513fa9be21ea" containerID="af1e04b597989549198102a899cd0b47feea7986fd75815bf57250a92223c8f2" exitCode=0
Jul 17 04:56:23.971759 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.971603    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl" event={"ID":"305d4762-12b2-4176-95a9-513fa9be21ea","Type":"ContainerDied","Data":"af1e04b597989549198102a899cd0b47feea7986fd75815bf57250a92223c8f2"}
Jul 17 04:56:23.971759 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.971684    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl" event={"ID":"305d4762-12b2-4176-95a9-513fa9be21ea","Type":"ContainerStarted","Data":"faff31b6df373995e39ff3c42572bd6bd9e85c573703178c2ca20c5520affcbb"}
Jul 17 04:56:23.976696 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.976673    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz"]
Jul 17 04:56:23.985853 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.985827    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz"
Jul 17 04:56:23.992723 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:23.992695    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz"]
Jul 17 04:56:24.047111 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.047014    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz\" (UID: \"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz"
Jul 17 04:56:24.047111 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.047071    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxvn4\" (UniqueName: \"kubernetes.io/projected/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-kube-api-access-rxvn4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz\" (UID: \"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz"
Jul 17 04:56:24.047654 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.047238    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz\" (UID: \"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz"
Jul 17 04:56:24.049727 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.049708    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d"]
Jul 17 04:56:24.052091 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:56:24.052066    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod652576b9_bff6_4f07_ac33_549f81b60e6e.slice/crio-4579575297bf744e16bb4eee5e8ba641e6bb7cb5db25a9d03e492e13a0e73a66 WatchSource:0}: Error finding container 4579575297bf744e16bb4eee5e8ba641e6bb7cb5db25a9d03e492e13a0e73a66: Status 404 returned error can't find the container with id 4579575297bf744e16bb4eee5e8ba641e6bb7cb5db25a9d03e492e13a0e73a66
Jul 17 04:56:24.148218 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.148181    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz\" (UID: \"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz"
Jul 17 04:56:24.148378 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.148317    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz\" (UID: \"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz"
Jul 17 04:56:24.148378 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.148354    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxvn4\" (UniqueName: \"kubernetes.io/projected/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-kube-api-access-rxvn4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz\" (UID: \"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz"
Jul 17 04:56:24.148666 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.148612    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz\" (UID: \"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz"
Jul 17 04:56:24.148800 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.148710    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz\" (UID: \"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz"
Jul 17 04:56:24.157830 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.157805    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxvn4\" (UniqueName: \"kubernetes.io/projected/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-kube-api-access-rxvn4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz\" (UID: \"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz"
Jul 17 04:56:24.301502 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.301413    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz"
Jul 17 04:56:24.380897 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.380855    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg"]
Jul 17 04:56:24.385759 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.385730    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg"
Jul 17 04:56:24.392124 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.392092    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg"]
Jul 17 04:56:24.451539 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.451507    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg\" (UID: \"2206c2b2-4832-4a8a-94bf-1ba65f6ec917\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg"
Jul 17 04:56:24.451729 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.451611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgqw5\" (UniqueName: \"kubernetes.io/projected/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-kube-api-access-kgqw5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg\" (UID: \"2206c2b2-4832-4a8a-94bf-1ba65f6ec917\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg"
Jul 17 04:56:24.451729 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.451699    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg\" (UID: \"2206c2b2-4832-4a8a-94bf-1ba65f6ec917\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg"
Jul 17 04:56:24.553137 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.553040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgqw5\" (UniqueName: \"kubernetes.io/projected/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-kube-api-access-kgqw5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg\" (UID: \"2206c2b2-4832-4a8a-94bf-1ba65f6ec917\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg"
Jul 17 04:56:24.553137 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.553103    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg\" (UID: \"2206c2b2-4832-4a8a-94bf-1ba65f6ec917\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg"
Jul 17 04:56:24.553357 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.553149    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg\" (UID: \"2206c2b2-4832-4a8a-94bf-1ba65f6ec917\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg"
Jul 17 04:56:24.553565 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.553543    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg\" (UID: \"2206c2b2-4832-4a8a-94bf-1ba65f6ec917\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg"
Jul 17 04:56:24.553610 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.553552    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg\" (UID: \"2206c2b2-4832-4a8a-94bf-1ba65f6ec917\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg"
Jul 17 04:56:24.562080 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.562054    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgqw5\" (UniqueName: \"kubernetes.io/projected/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-kube-api-access-kgqw5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg\" (UID: \"2206c2b2-4832-4a8a-94bf-1ba65f6ec917\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg"
Jul 17 04:56:24.667755 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.667731    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz"]
Jul 17 04:56:24.670208 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:56:24.670178    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc2f1d2_2d7e_4684_9de6_da5bbb3bc6d3.slice/crio-ea6daedd0119230d3b8b4c1952712686bbea998956d5dc6eac08cc0af62b9a72 WatchSource:0}: Error finding container ea6daedd0119230d3b8b4c1952712686bbea998956d5dc6eac08cc0af62b9a72: Status 404 returned error can't find the container with id ea6daedd0119230d3b8b4c1952712686bbea998956d5dc6eac08cc0af62b9a72
Jul 17 04:56:24.698242 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.698205    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg"
Jul 17 04:56:24.851604 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.851577    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg"]
Jul 17 04:56:24.868481 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:56:24.868450    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2206c2b2_4832_4a8a_94bf_1ba65f6ec917.slice/crio-dd7b85f0dfe2c3bdaf86cd7f638fc70284b98b66ee1400af1f0a7f3f4fcca857 WatchSource:0}: Error finding container dd7b85f0dfe2c3bdaf86cd7f638fc70284b98b66ee1400af1f0a7f3f4fcca857: Status 404 returned error can't find the container with id dd7b85f0dfe2c3bdaf86cd7f638fc70284b98b66ee1400af1f0a7f3f4fcca857
Jul 17 04:56:24.978898 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.978862    2564 generic.go:356] "Generic (PLEG): container finished" podID="2206c2b2-4832-4a8a-94bf-1ba65f6ec917" containerID="173f18db1a6b320bcdb56676d810aca951ff91f511ed7ce55f77aa9f389be234" exitCode=0
Jul 17 04:56:24.979070 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.978950    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg" event={"ID":"2206c2b2-4832-4a8a-94bf-1ba65f6ec917","Type":"ContainerDied","Data":"173f18db1a6b320bcdb56676d810aca951ff91f511ed7ce55f77aa9f389be234"}
Jul 17 04:56:24.979070 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.979012    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg" event={"ID":"2206c2b2-4832-4a8a-94bf-1ba65f6ec917","Type":"ContainerStarted","Data":"dd7b85f0dfe2c3bdaf86cd7f638fc70284b98b66ee1400af1f0a7f3f4fcca857"}
Jul 17 04:56:24.981060 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.981030    2564 generic.go:356] "Generic (PLEG): container finished" podID="305d4762-12b2-4176-95a9-513fa9be21ea" containerID="1958620df65ddb582fd0997664cec40102577f7ae1bf6f5da5d1c866c1d4f574" exitCode=0
Jul 17 04:56:24.981176 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.981112    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl" event={"ID":"305d4762-12b2-4176-95a9-513fa9be21ea","Type":"ContainerDied","Data":"1958620df65ddb582fd0997664cec40102577f7ae1bf6f5da5d1c866c1d4f574"}
Jul 17 04:56:24.982892 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.982873    2564 generic.go:356] "Generic (PLEG): container finished" podID="1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3" containerID="9f6c72a81c4967f79e6b97d6cd2df3b5e6e928704780d7d5ebf56a22c0cc2c89" exitCode=0
Jul 17 04:56:24.983003 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.982949    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz" event={"ID":"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3","Type":"ContainerDied","Data":"9f6c72a81c4967f79e6b97d6cd2df3b5e6e928704780d7d5ebf56a22c0cc2c89"}
Jul 17 04:56:24.983003 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.982984    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz" event={"ID":"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3","Type":"ContainerStarted","Data":"ea6daedd0119230d3b8b4c1952712686bbea998956d5dc6eac08cc0af62b9a72"}
Jul 17 04:56:24.984557 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.984530    2564 generic.go:356] "Generic (PLEG): container finished" podID="652576b9-bff6-4f07-ac33-549f81b60e6e" containerID="5d28844befb9720a2915f895c1e7bd512a0bd9a1738253e420bb9381bfa116ae" exitCode=0
Jul 17 04:56:24.984664 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.984570    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d" event={"ID":"652576b9-bff6-4f07-ac33-549f81b60e6e","Type":"ContainerDied","Data":"5d28844befb9720a2915f895c1e7bd512a0bd9a1738253e420bb9381bfa116ae"}
Jul 17 04:56:24.984664 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:24.984602    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d" event={"ID":"652576b9-bff6-4f07-ac33-549f81b60e6e","Type":"ContainerStarted","Data":"4579575297bf744e16bb4eee5e8ba641e6bb7cb5db25a9d03e492e13a0e73a66"}
Jul 17 04:56:25.992466 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:25.992432    2564 generic.go:356] "Generic (PLEG): container finished" podID="305d4762-12b2-4176-95a9-513fa9be21ea" containerID="52f1efb447880f1074466fb53e69298f47b7d6908ecc6b0c0ab41d93238599e9" exitCode=0
Jul 17 04:56:25.992856 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:25.992502    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl" event={"ID":"305d4762-12b2-4176-95a9-513fa9be21ea","Type":"ContainerDied","Data":"52f1efb447880f1074466fb53e69298f47b7d6908ecc6b0c0ab41d93238599e9"}
Jul 17 04:56:26.999607 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:26.999570    2564 generic.go:356] "Generic (PLEG): container finished" podID="2206c2b2-4832-4a8a-94bf-1ba65f6ec917" containerID="2fbc2ac8c73ee8bab7181a43062cfd90c7dc9628e7c6168e0bd035dfd836157f" exitCode=0
Jul 17 04:56:27.000100 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:26.999662    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg" event={"ID":"2206c2b2-4832-4a8a-94bf-1ba65f6ec917","Type":"ContainerDied","Data":"2fbc2ac8c73ee8bab7181a43062cfd90c7dc9628e7c6168e0bd035dfd836157f"}
Jul 17 04:56:27.001690 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:27.001670    2564 generic.go:356] "Generic (PLEG): container finished" podID="1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3" containerID="7a3e5e47bde2dffe5319f5571fb256892f6418c015bcb55aba585ddd88ca44a1" exitCode=0
Jul 17 04:56:27.001791 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:27.001753    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz" event={"ID":"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3","Type":"ContainerDied","Data":"7a3e5e47bde2dffe5319f5571fb256892f6418c015bcb55aba585ddd88ca44a1"}
Jul 17 04:56:27.003684 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:27.003665    2564 generic.go:356] "Generic (PLEG): container finished" podID="652576b9-bff6-4f07-ac33-549f81b60e6e" containerID="ca2ef29a2fa6adfa84093a4988f3e163c6152453fc96be6abe06d5a49dee0832" exitCode=0
Jul 17 04:56:27.003775 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:27.003751    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d" event={"ID":"652576b9-bff6-4f07-ac33-549f81b60e6e","Type":"ContainerDied","Data":"ca2ef29a2fa6adfa84093a4988f3e163c6152453fc96be6abe06d5a49dee0832"}
Jul 17 04:56:27.171582 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:27.171496    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl"
Jul 17 04:56:27.277792 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:27.277757    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/305d4762-12b2-4176-95a9-513fa9be21ea-bundle\") pod \"305d4762-12b2-4176-95a9-513fa9be21ea\" (UID: \"305d4762-12b2-4176-95a9-513fa9be21ea\") "
Jul 17 04:56:27.277935 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:27.277824    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/305d4762-12b2-4176-95a9-513fa9be21ea-util\") pod \"305d4762-12b2-4176-95a9-513fa9be21ea\" (UID: \"305d4762-12b2-4176-95a9-513fa9be21ea\") "
Jul 17 04:56:27.277935 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:27.277912    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gzgk\" (UniqueName: \"kubernetes.io/projected/305d4762-12b2-4176-95a9-513fa9be21ea-kube-api-access-2gzgk\") pod \"305d4762-12b2-4176-95a9-513fa9be21ea\" (UID: \"305d4762-12b2-4176-95a9-513fa9be21ea\") "
Jul 17 04:56:27.278373 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:27.278338    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/305d4762-12b2-4176-95a9-513fa9be21ea-bundle" (OuterVolumeSpecName: "bundle") pod "305d4762-12b2-4176-95a9-513fa9be21ea" (UID: "305d4762-12b2-4176-95a9-513fa9be21ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:56:27.280122 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:27.280097    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/305d4762-12b2-4176-95a9-513fa9be21ea-kube-api-access-2gzgk" (OuterVolumeSpecName: "kube-api-access-2gzgk") pod "305d4762-12b2-4176-95a9-513fa9be21ea" (UID: "305d4762-12b2-4176-95a9-513fa9be21ea"). InnerVolumeSpecName "kube-api-access-2gzgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:56:27.282934 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:27.282914    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/305d4762-12b2-4176-95a9-513fa9be21ea-util" (OuterVolumeSpecName: "util") pod "305d4762-12b2-4176-95a9-513fa9be21ea" (UID: "305d4762-12b2-4176-95a9-513fa9be21ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:56:27.379006 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:27.378963    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/305d4762-12b2-4176-95a9-513fa9be21ea-util\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:56:27.379006 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:27.378999    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gzgk\" (UniqueName: \"kubernetes.io/projected/305d4762-12b2-4176-95a9-513fa9be21ea-kube-api-access-2gzgk\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:56:27.379006 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:27.379008    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/305d4762-12b2-4176-95a9-513fa9be21ea-bundle\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:56:28.017514 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:28.017480    2564 generic.go:356] "Generic (PLEG): container finished" podID="2206c2b2-4832-4a8a-94bf-1ba65f6ec917" containerID="d1b4074827bb0d98f2b6746a5100a84b72c3ffcd8186ae11060c9881b217c684" exitCode=0
Jul 17 04:56:28.017997 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:28.017567    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg" event={"ID":"2206c2b2-4832-4a8a-94bf-1ba65f6ec917","Type":"ContainerDied","Data":"d1b4074827bb0d98f2b6746a5100a84b72c3ffcd8186ae11060c9881b217c684"}
Jul 17 04:56:28.019561 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:28.019538    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl"
Jul 17 04:56:28.019700 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:28.019539    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl" event={"ID":"305d4762-12b2-4176-95a9-513fa9be21ea","Type":"ContainerDied","Data":"faff31b6df373995e39ff3c42572bd6bd9e85c573703178c2ca20c5520affcbb"}
Jul 17 04:56:28.019700 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:28.019676    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="faff31b6df373995e39ff3c42572bd6bd9e85c573703178c2ca20c5520affcbb"
Jul 17 04:56:28.021716 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:28.021694    2564 generic.go:356] "Generic (PLEG): container finished" podID="1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3" containerID="57393dba14314a14dad4112208290733b0738f229a83b63cadb00b9b90a44306" exitCode=0
Jul 17 04:56:28.021839 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:28.021807    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz" event={"ID":"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3","Type":"ContainerDied","Data":"57393dba14314a14dad4112208290733b0738f229a83b63cadb00b9b90a44306"}
Jul 17 04:56:28.023967 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:28.023947    2564 generic.go:356] "Generic (PLEG): container finished" podID="652576b9-bff6-4f07-ac33-549f81b60e6e" containerID="66d6ebae375377694dd79dd73102ff092c59004440540f6a72b78a7debb6f57f" exitCode=0
Jul 17 04:56:28.024044 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:28.023979    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d" event={"ID":"652576b9-bff6-4f07-ac33-549f81b60e6e","Type":"ContainerDied","Data":"66d6ebae375377694dd79dd73102ff092c59004440540f6a72b78a7debb6f57f"}
Jul 17 04:56:29.187465 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.187440    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg"
Jul 17 04:56:29.221980 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.221949    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz"
Jul 17 04:56:29.225093 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.225068    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d"
Jul 17 04:56:29.299167 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.299079    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/652576b9-bff6-4f07-ac33-549f81b60e6e-util\") pod \"652576b9-bff6-4f07-ac33-549f81b60e6e\" (UID: \"652576b9-bff6-4f07-ac33-549f81b60e6e\") "
Jul 17 04:56:29.299167 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.299119    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-util\") pod \"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3\" (UID: \"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3\") "
Jul 17 04:56:29.299167 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.299145    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxvn4\" (UniqueName: \"kubernetes.io/projected/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-kube-api-access-rxvn4\") pod \"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3\" (UID: \"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3\") "
Jul 17 04:56:29.299452 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.299200    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgqw5\" (UniqueName: \"kubernetes.io/projected/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-kube-api-access-kgqw5\") pod \"2206c2b2-4832-4a8a-94bf-1ba65f6ec917\" (UID: \"2206c2b2-4832-4a8a-94bf-1ba65f6ec917\") "
Jul 17 04:56:29.299452 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.299220    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-util\") pod \"2206c2b2-4832-4a8a-94bf-1ba65f6ec917\" (UID: \"2206c2b2-4832-4a8a-94bf-1ba65f6ec917\") "
Jul 17 04:56:29.299452 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.299279    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-bundle\") pod \"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3\" (UID: \"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3\") "
Jul 17 04:56:29.299452 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.299397    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-bundle\") pod \"2206c2b2-4832-4a8a-94bf-1ba65f6ec917\" (UID: \"2206c2b2-4832-4a8a-94bf-1ba65f6ec917\") "
Jul 17 04:56:29.299676 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.299454    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4hdx\" (UniqueName: \"kubernetes.io/projected/652576b9-bff6-4f07-ac33-549f81b60e6e-kube-api-access-l4hdx\") pod \"652576b9-bff6-4f07-ac33-549f81b60e6e\" (UID: \"652576b9-bff6-4f07-ac33-549f81b60e6e\") "
Jul 17 04:56:29.299676 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.299539    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/652576b9-bff6-4f07-ac33-549f81b60e6e-bundle\") pod \"652576b9-bff6-4f07-ac33-549f81b60e6e\" (UID: \"652576b9-bff6-4f07-ac33-549f81b60e6e\") "
Jul 17 04:56:29.300441 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.300007    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-bundle" (OuterVolumeSpecName: "bundle") pod "1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3" (UID: "1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:56:29.300441 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.300384    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-bundle" (OuterVolumeSpecName: "bundle") pod "2206c2b2-4832-4a8a-94bf-1ba65f6ec917" (UID: "2206c2b2-4832-4a8a-94bf-1ba65f6ec917"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:56:29.300441 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.300427    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/652576b9-bff6-4f07-ac33-549f81b60e6e-bundle" (OuterVolumeSpecName: "bundle") pod "652576b9-bff6-4f07-ac33-549f81b60e6e" (UID: "652576b9-bff6-4f07-ac33-549f81b60e6e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:56:29.301874 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.301849    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-kube-api-access-rxvn4" (OuterVolumeSpecName: "kube-api-access-rxvn4") pod "1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3" (UID: "1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3"). InnerVolumeSpecName "kube-api-access-rxvn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:56:29.301966 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.301885    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-kube-api-access-kgqw5" (OuterVolumeSpecName: "kube-api-access-kgqw5") pod "2206c2b2-4832-4a8a-94bf-1ba65f6ec917" (UID: "2206c2b2-4832-4a8a-94bf-1ba65f6ec917"). InnerVolumeSpecName "kube-api-access-kgqw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:56:29.302697 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.302667    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/652576b9-bff6-4f07-ac33-549f81b60e6e-kube-api-access-l4hdx" (OuterVolumeSpecName: "kube-api-access-l4hdx") pod "652576b9-bff6-4f07-ac33-549f81b60e6e" (UID: "652576b9-bff6-4f07-ac33-549f81b60e6e"). InnerVolumeSpecName "kube-api-access-l4hdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:56:29.305739 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.305703    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-util" (OuterVolumeSpecName: "util") pod "1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3" (UID: "1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:56:29.306164 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.306147    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/652576b9-bff6-4f07-ac33-549f81b60e6e-util" (OuterVolumeSpecName: "util") pod "652576b9-bff6-4f07-ac33-549f81b60e6e" (UID: "652576b9-bff6-4f07-ac33-549f81b60e6e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:56:29.306164 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.306153    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-util" (OuterVolumeSpecName: "util") pod "2206c2b2-4832-4a8a-94bf-1ba65f6ec917" (UID: "2206c2b2-4832-4a8a-94bf-1ba65f6ec917"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:56:29.401201 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.401162    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/652576b9-bff6-4f07-ac33-549f81b60e6e-bundle\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:56:29.401201 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.401195    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/652576b9-bff6-4f07-ac33-549f81b60e6e-util\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:56:29.401201 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.401203    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-util\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:56:29.401437 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.401212    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxvn4\" (UniqueName: \"kubernetes.io/projected/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-kube-api-access-rxvn4\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:56:29.401437 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.401222    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgqw5\" (UniqueName: \"kubernetes.io/projected/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-kube-api-access-kgqw5\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:56:29.401437 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.401230    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-util\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:56:29.401437 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.401238    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3-bundle\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:56:29.401437 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.401245    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2206c2b2-4832-4a8a-94bf-1ba65f6ec917-bundle\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:56:29.401437 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:29.401253    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4hdx\" (UniqueName: \"kubernetes.io/projected/652576b9-bff6-4f07-ac33-549f81b60e6e-kube-api-access-l4hdx\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:56:30.036339 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:30.036305    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz"
Jul 17 04:56:30.036535 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:30.036310    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz" event={"ID":"1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3","Type":"ContainerDied","Data":"ea6daedd0119230d3b8b4c1952712686bbea998956d5dc6eac08cc0af62b9a72"}
Jul 17 04:56:30.036535 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:30.036435    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea6daedd0119230d3b8b4c1952712686bbea998956d5dc6eac08cc0af62b9a72"
Jul 17 04:56:30.038264 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:30.038242    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d"
Jul 17 04:56:30.038398 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:30.038257    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d" event={"ID":"652576b9-bff6-4f07-ac33-549f81b60e6e","Type":"ContainerDied","Data":"4579575297bf744e16bb4eee5e8ba641e6bb7cb5db25a9d03e492e13a0e73a66"}
Jul 17 04:56:30.038398 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:30.038304    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4579575297bf744e16bb4eee5e8ba641e6bb7cb5db25a9d03e492e13a0e73a66"
Jul 17 04:56:30.041028 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:30.041007    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg" event={"ID":"2206c2b2-4832-4a8a-94bf-1ba65f6ec917","Type":"ContainerDied","Data":"dd7b85f0dfe2c3bdaf86cd7f638fc70284b98b66ee1400af1f0a7f3f4fcca857"}
Jul 17 04:56:30.041129 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:30.041043    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd7b85f0dfe2c3bdaf86cd7f638fc70284b98b66ee1400af1f0a7f3f4fcca857"
Jul 17 04:56:30.041129 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:30.041049    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg"
Jul 17 04:56:35.649234 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:35.649189    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:36.259218 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:36.259174    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:39.725542 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725505    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v7nvc"]
Jul 17 04:56:39.725927 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725868    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3" containerName="util"
Jul 17 04:56:39.725927 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725879    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3" containerName="util"
Jul 17 04:56:39.725927 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725887    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="652576b9-bff6-4f07-ac33-549f81b60e6e" containerName="pull"
Jul 17 04:56:39.725927 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725892    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="652576b9-bff6-4f07-ac33-549f81b60e6e" containerName="pull"
Jul 17 04:56:39.725927 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725904    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="652576b9-bff6-4f07-ac33-549f81b60e6e" containerName="util"
Jul 17 04:56:39.725927 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725911    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="652576b9-bff6-4f07-ac33-549f81b60e6e" containerName="util"
Jul 17 04:56:39.725927 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725917    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="305d4762-12b2-4176-95a9-513fa9be21ea" containerName="extract"
Jul 17 04:56:39.725927 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725922    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="305d4762-12b2-4176-95a9-513fa9be21ea" containerName="extract"
Jul 17 04:56:39.725927 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725932    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="305d4762-12b2-4176-95a9-513fa9be21ea" containerName="pull"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725938    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="305d4762-12b2-4176-95a9-513fa9be21ea" containerName="pull"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725946    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="652576b9-bff6-4f07-ac33-549f81b60e6e" containerName="extract"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725951    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="652576b9-bff6-4f07-ac33-549f81b60e6e" containerName="extract"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725957    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2206c2b2-4832-4a8a-94bf-1ba65f6ec917" containerName="util"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725963    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2206c2b2-4832-4a8a-94bf-1ba65f6ec917" containerName="util"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725969    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2206c2b2-4832-4a8a-94bf-1ba65f6ec917" containerName="pull"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725973    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2206c2b2-4832-4a8a-94bf-1ba65f6ec917" containerName="pull"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725988    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3" containerName="pull"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.725993    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3" containerName="pull"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.726000    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="305d4762-12b2-4176-95a9-513fa9be21ea" containerName="util"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.726005    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="305d4762-12b2-4176-95a9-513fa9be21ea" containerName="util"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.726010    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2206c2b2-4832-4a8a-94bf-1ba65f6ec917" containerName="extract"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.726015    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2206c2b2-4832-4a8a-94bf-1ba65f6ec917" containerName="extract"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.726023    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3" containerName="extract"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.726027    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3" containerName="extract"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.726079    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="305d4762-12b2-4176-95a9-513fa9be21ea" containerName="extract"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.726087    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="652576b9-bff6-4f07-ac33-549f81b60e6e" containerName="extract"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.726095    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2206c2b2-4832-4a8a-94bf-1ba65f6ec917" containerName="extract"
Jul 17 04:56:39.726224 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.726100    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3" containerName="extract"
Jul 17 04:56:39.729664 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.729617    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v7nvc"
Jul 17 04:56:39.732288 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.732265    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-k58wp\""
Jul 17 04:56:39.738475 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.738451    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v7nvc"]
Jul 17 04:56:39.893481 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.893446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvb96\" (UniqueName: \"kubernetes.io/projected/b23af8c8-0ba5-4957-b45d-4cd4420c3c86-kube-api-access-xvb96\") pod \"authorino-operator-75cc8d5cb7-v7nvc\" (UID: \"b23af8c8-0ba5-4957-b45d-4cd4420c3c86\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v7nvc"
Jul 17 04:56:39.994466 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:39.994370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvb96\" (UniqueName: \"kubernetes.io/projected/b23af8c8-0ba5-4957-b45d-4cd4420c3c86-kube-api-access-xvb96\") pod \"authorino-operator-75cc8d5cb7-v7nvc\" (UID: \"b23af8c8-0ba5-4957-b45d-4cd4420c3c86\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v7nvc"
Jul 17 04:56:40.008118 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:40.008081    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvb96\" (UniqueName: \"kubernetes.io/projected/b23af8c8-0ba5-4957-b45d-4cd4420c3c86-kube-api-access-xvb96\") pod \"authorino-operator-75cc8d5cb7-v7nvc\" (UID: \"b23af8c8-0ba5-4957-b45d-4cd4420c3c86\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v7nvc"
Jul 17 04:56:40.041058 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:40.041022    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v7nvc"
Jul 17 04:56:40.189057 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:40.188995    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v7nvc"]
Jul 17 04:56:40.191458 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:56:40.191430    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb23af8c8_0ba5_4957_b45d_4cd4420c3c86.slice/crio-f2d86c6a9639ed5575b7205b2d64827e54c1227c1490d2b43dc9fb25907f29c8 WatchSource:0}: Error finding container f2d86c6a9639ed5575b7205b2d64827e54c1227c1490d2b43dc9fb25907f29c8: Status 404 returned error can't find the container with id f2d86c6a9639ed5575b7205b2d64827e54c1227c1490d2b43dc9fb25907f29c8
Jul 17 04:56:41.064621 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:41.064583    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:41.101004 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:41.100951    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v7nvc" event={"ID":"b23af8c8-0ba5-4957-b45d-4cd4420c3c86","Type":"ContainerStarted","Data":"f2d86c6a9639ed5575b7205b2d64827e54c1227c1490d2b43dc9fb25907f29c8"}
Jul 17 04:56:42.899539 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:42.899504    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-m2xcg"]
Jul 17 04:56:42.903231 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:42.903209    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m2xcg"
Jul 17 04:56:42.905966 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:42.905942    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 17 04:56:42.905966 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:42.905951    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-nkpb9\""
Jul 17 04:56:42.913950 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:42.913928    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-m2xcg"]
Jul 17 04:56:43.020547 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:43.020509    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgvqs\" (UniqueName: \"kubernetes.io/projected/9d212d3b-5988-49a0-ae25-f3a86336ba3f-kube-api-access-kgvqs\") pod \"dns-operator-controller-manager-864dd78c4c-m2xcg\" (UID: \"9d212d3b-5988-49a0-ae25-f3a86336ba3f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m2xcg"
Jul 17 04:56:43.106315 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:43.106271    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:43.113942 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:43.113909    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v7nvc" event={"ID":"b23af8c8-0ba5-4957-b45d-4cd4420c3c86","Type":"ContainerStarted","Data":"2c93b7e8761f213d734a1bba11ea2b0575155c1290ae3762ca58614801904764"}
Jul 17 04:56:43.114134 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:43.114001    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v7nvc"
Jul 17 04:56:43.121044 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:43.121023    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgvqs\" (UniqueName: \"kubernetes.io/projected/9d212d3b-5988-49a0-ae25-f3a86336ba3f-kube-api-access-kgvqs\") pod \"dns-operator-controller-manager-864dd78c4c-m2xcg\" (UID: \"9d212d3b-5988-49a0-ae25-f3a86336ba3f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m2xcg"
Jul 17 04:56:43.132020 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:43.131986    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgvqs\" (UniqueName: \"kubernetes.io/projected/9d212d3b-5988-49a0-ae25-f3a86336ba3f-kube-api-access-kgvqs\") pod \"dns-operator-controller-manager-864dd78c4c-m2xcg\" (UID: \"9d212d3b-5988-49a0-ae25-f3a86336ba3f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m2xcg"
Jul 17 04:56:43.133759 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:43.133711    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v7nvc" podStartSLOduration=1.795845342 podStartE2EDuration="4.133697136s" totalImagesPullingTime="2.337851794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:56:43.131670914 +0000 UTC m=+437.809277261" watchObservedRunningTime="2026-07-17 04:56:43.133697136 +0000 UTC m=+437.811303482"
Jul 17 04:56:43.214132 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:43.214032    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m2xcg"
Jul 17 04:56:43.368685 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:43.368653    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-m2xcg"]
Jul 17 04:56:43.370339 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:56:43.370309    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d212d3b_5988_49a0_ae25_f3a86336ba3f.slice/crio-0753544a94fa7de3e046f154a10d0e9d57ad7d996a70e5f6d2fbd2637d3d41cf WatchSource:0}: Error finding container 0753544a94fa7de3e046f154a10d0e9d57ad7d996a70e5f6d2fbd2637d3d41cf: Status 404 returned error can't find the container with id 0753544a94fa7de3e046f154a10d0e9d57ad7d996a70e5f6d2fbd2637d3d41cf
Jul 17 04:56:44.058767 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:44.058732    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:44.122888 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:44.122838    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m2xcg" event={"ID":"9d212d3b-5988-49a0-ae25-f3a86336ba3f","Type":"ContainerStarted","Data":"0753544a94fa7de3e046f154a10d0e9d57ad7d996a70e5f6d2fbd2637d3d41cf"}
Jul 17 04:56:44.895963 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:44.895900    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:46.136075 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:46.136033    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m2xcg" event={"ID":"9d212d3b-5988-49a0-ae25-f3a86336ba3f","Type":"ContainerStarted","Data":"e3208624cc0b60557b9a58d1b4dce21d06c8bb6cfbf9c0926d870893e6ba9fa6"}
Jul 17 04:56:46.136558 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:46.136142    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m2xcg"
Jul 17 04:56:46.155454 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:46.155395    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m2xcg" podStartSLOduration=2.440667375 podStartE2EDuration="4.155377843s" totalImagesPullingTime="1.714710468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:56:46.154574121 +0000 UTC m=+440.832180468" watchObservedRunningTime="2026-07-17 04:56:46.155377843 +0000 UTC m=+440.832984189"
Jul 17 04:56:46.398007 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:46.397905    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"]
Jul 17 04:56:46.401503 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:46.401481    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:56:46.404538 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:46.404511    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zl6j8\""
Jul 17 04:56:46.413794 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:46.413761    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"]
Jul 17 04:56:46.550337 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:46.550299    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9mqb\" (UniqueName: \"kubernetes.io/projected/3836ec50-05bf-4d1f-9a23-13f2d6424908-kube-api-access-t9mqb\") pod \"limitador-operator-controller-manager-859d7b78bd-zwnjd\" (UID: \"3836ec50-05bf-4d1f-9a23-13f2d6424908\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:56:46.651457 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:46.651370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9mqb\" (UniqueName: \"kubernetes.io/projected/3836ec50-05bf-4d1f-9a23-13f2d6424908-kube-api-access-t9mqb\") pod \"limitador-operator-controller-manager-859d7b78bd-zwnjd\" (UID: \"3836ec50-05bf-4d1f-9a23-13f2d6424908\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:56:46.663444 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:46.663406    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9mqb\" (UniqueName: \"kubernetes.io/projected/3836ec50-05bf-4d1f-9a23-13f2d6424908-kube-api-access-t9mqb\") pod \"limitador-operator-controller-manager-859d7b78bd-zwnjd\" (UID: \"3836ec50-05bf-4d1f-9a23-13f2d6424908\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:56:46.714389 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:46.714295    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:56:46.868716 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:46.868690    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"]
Jul 17 04:56:46.870930 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:56:46.870898    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3836ec50_05bf_4d1f_9a23_13f2d6424908.slice/crio-6eca161a08d73fc256d9fa8b3e852b5f80ea6c06b2de79ecce404bb2534eb56d WatchSource:0}: Error finding container 6eca161a08d73fc256d9fa8b3e852b5f80ea6c06b2de79ecce404bb2534eb56d: Status 404 returned error can't find the container with id 6eca161a08d73fc256d9fa8b3e852b5f80ea6c06b2de79ecce404bb2534eb56d
Jul 17 04:56:47.057703 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:47.057667    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:47.142423 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:47.142382    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd" event={"ID":"3836ec50-05bf-4d1f-9a23-13f2d6424908","Type":"ContainerStarted","Data":"6eca161a08d73fc256d9fa8b3e852b5f80ea6c06b2de79ecce404bb2534eb56d"}
Jul 17 04:56:47.513467 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:47.513363    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:49.155721 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:49.155683    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd" event={"ID":"3836ec50-05bf-4d1f-9a23-13f2d6424908","Type":"ContainerStarted","Data":"983085d486e32b37b8caeb652fa5a49a616e22aaf681c6cf2ce4e59c465b2b3c"}
Jul 17 04:56:49.156143 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:49.155785    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:56:49.177500 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:49.177441    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd" podStartSLOduration=1.780826732 podStartE2EDuration="3.177423976s" totalImagesPullingTime="1.396597244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:56:49.175649072 +0000 UTC m=+443.853255417" watchObservedRunningTime="2026-07-17 04:56:49.177423976 +0000 UTC m=+443.855030321"
Jul 17 04:56:50.774066 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:50.774024    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:51.327292 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:51.327254    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"]
Jul 17 04:56:51.331083 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:51.331063    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:56:51.333728 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:51.333703    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dznhn\""
Jul 17 04:56:51.342780 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:51.342745    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"]
Jul 17 04:56:51.396958 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:51.396919    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fe11016-19ff-4f5c-9403-c2b503ce8bd4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" (UID: \"7fe11016-19ff-4f5c-9403-c2b503ce8bd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:56:51.396958 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:51.396961    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkhwk\" (UniqueName: \"kubernetes.io/projected/7fe11016-19ff-4f5c-9403-c2b503ce8bd4-kube-api-access-dkhwk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" (UID: \"7fe11016-19ff-4f5c-9403-c2b503ce8bd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:56:51.498223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:51.498178    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fe11016-19ff-4f5c-9403-c2b503ce8bd4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" (UID: \"7fe11016-19ff-4f5c-9403-c2b503ce8bd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:56:51.498223 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:51.498222    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkhwk\" (UniqueName: \"kubernetes.io/projected/7fe11016-19ff-4f5c-9403-c2b503ce8bd4-kube-api-access-dkhwk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" (UID: \"7fe11016-19ff-4f5c-9403-c2b503ce8bd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:56:51.498559 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:51.498540    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fe11016-19ff-4f5c-9403-c2b503ce8bd4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" (UID: \"7fe11016-19ff-4f5c-9403-c2b503ce8bd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:56:51.513484 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:51.513457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkhwk\" (UniqueName: \"kubernetes.io/projected/7fe11016-19ff-4f5c-9403-c2b503ce8bd4-kube-api-access-dkhwk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" (UID: \"7fe11016-19ff-4f5c-9403-c2b503ce8bd4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:56:51.612749 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:51.612650    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:51.642108 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:51.642075    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:56:51.789403 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:51.789345    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"]
Jul 17 04:56:51.792057 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:56:51.792018    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fe11016_19ff_4f5c_9403_c2b503ce8bd4.slice/crio-b38eb331b5798ef852d1748e70986393a0d7b0f089ccafac05aa278faddbf90e WatchSource:0}: Error finding container b38eb331b5798ef852d1748e70986393a0d7b0f089ccafac05aa278faddbf90e: Status 404 returned error can't find the container with id b38eb331b5798ef852d1748e70986393a0d7b0f089ccafac05aa278faddbf90e
Jul 17 04:56:52.172236 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:52.172202    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556" event={"ID":"7fe11016-19ff-4f5c-9403-c2b503ce8bd4","Type":"ContainerStarted","Data":"b38eb331b5798ef852d1748e70986393a0d7b0f089ccafac05aa278faddbf90e"}
Jul 17 04:56:52.657978 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:52.657937    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:52.767894 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:52.767857    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:53.055498 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:53.055397    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:53.158121 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:53.158086    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:53.562089 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:53.562053    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:53.662114 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:53.662082    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:54.125708 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:54.125675    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v7nvc"
Jul 17 04:56:56.457451 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:56.457414    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:56.522705 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:56.522669    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:56:57.145730 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:57.145697    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m2xcg"
Jul 17 04:56:58.211672 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:58.211607    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556" event={"ID":"7fe11016-19ff-4f5c-9403-c2b503ce8bd4","Type":"ContainerStarted","Data":"180e9a100bafab13281353c09280e1baa5e66bba087ed26a6548caff28c5d6c4"}
Jul 17 04:56:58.213357 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:58.213329    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:56:58.234488 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:56:58.234422    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556" podStartSLOduration=1.769114191 podStartE2EDuration="7.234403975s" totalImagesPullingTime="5.465289784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:56:58.230926041 +0000 UTC m=+452.908532387" watchObservedRunningTime="2026-07-17 04:56:58.234403975 +0000 UTC m=+452.912010321"
Jul 17 04:57:00.159723 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.159684    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq"]
Jul 17 04:57:00.165227 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.165199    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:57:00.165381 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.165282    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq"
Jul 17 04:57:00.168100 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.168073    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 17 04:57:00.168255 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.168119    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 17 04:57:00.168255 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.168176    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-h9bvw\""
Jul 17 04:57:00.168716 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.168694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:00.173788 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.173168    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq"]
Jul 17 04:57:00.276667 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.276594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42bcb6e8-91ca-47d1-818e-f664423bba51-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zm7gq\" (UID: \"42bcb6e8-91ca-47d1-818e-f664423bba51\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq"
Jul 17 04:57:00.276891 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.276826    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42bcb6e8-91ca-47d1-818e-f664423bba51-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zm7gq\" (UID: \"42bcb6e8-91ca-47d1-818e-f664423bba51\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq"
Jul 17 04:57:00.276891 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.276873    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sss7h\" (UniqueName: \"kubernetes.io/projected/42bcb6e8-91ca-47d1-818e-f664423bba51-kube-api-access-sss7h\") pod \"kuadrant-console-plugin-66b5774985-zm7gq\" (UID: \"42bcb6e8-91ca-47d1-818e-f664423bba51\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq"
Jul 17 04:57:00.283221 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.283164    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:00.378063 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.378019    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sss7h\" (UniqueName: \"kubernetes.io/projected/42bcb6e8-91ca-47d1-818e-f664423bba51-kube-api-access-sss7h\") pod \"kuadrant-console-plugin-66b5774985-zm7gq\" (UID: \"42bcb6e8-91ca-47d1-818e-f664423bba51\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq"
Jul 17 04:57:00.378264 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.378096    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42bcb6e8-91ca-47d1-818e-f664423bba51-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zm7gq\" (UID: \"42bcb6e8-91ca-47d1-818e-f664423bba51\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq"
Jul 17 04:57:00.378264 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.378203    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42bcb6e8-91ca-47d1-818e-f664423bba51-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zm7gq\" (UID: \"42bcb6e8-91ca-47d1-818e-f664423bba51\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq"
Jul 17 04:57:00.378264 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:00.378216    2564 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 17 04:57:00.378441 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:00.378274    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42bcb6e8-91ca-47d1-818e-f664423bba51-plugin-serving-cert podName:42bcb6e8-91ca-47d1-818e-f664423bba51 nodeName:}" failed. No retries permitted until 2026-07-17 04:57:00.878257247 +0000 UTC m=+455.555863571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/42bcb6e8-91ca-47d1-818e-f664423bba51-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-zm7gq" (UID: "42bcb6e8-91ca-47d1-818e-f664423bba51") : secret "plugin-serving-cert" not found
Jul 17 04:57:00.378834 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.378817    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42bcb6e8-91ca-47d1-818e-f664423bba51-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zm7gq\" (UID: \"42bcb6e8-91ca-47d1-818e-f664423bba51\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq"
Jul 17 04:57:00.387685 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.387617    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:00.393361 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.393330    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sss7h\" (UniqueName: \"kubernetes.io/projected/42bcb6e8-91ca-47d1-818e-f664423bba51-kube-api-access-sss7h\") pod \"kuadrant-console-plugin-66b5774985-zm7gq\" (UID: \"42bcb6e8-91ca-47d1-818e-f664423bba51\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq"
Jul 17 04:57:00.574512 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.574477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:00.883925 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.883833    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42bcb6e8-91ca-47d1-818e-f664423bba51-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zm7gq\" (UID: \"42bcb6e8-91ca-47d1-818e-f664423bba51\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq"
Jul 17 04:57:00.886720 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:00.886694    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42bcb6e8-91ca-47d1-818e-f664423bba51-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zm7gq\" (UID: \"42bcb6e8-91ca-47d1-818e-f664423bba51\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq"
Jul 17 04:57:01.077321 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:01.077280    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq"
Jul 17 04:57:01.249995 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:01.249959    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq"]
Jul 17 04:57:01.251705 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:57:01.251617    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42bcb6e8_91ca_47d1_818e_f664423bba51.slice/crio-1de268920e7d627eeb4e45cfe6ed327f121d25df2f0559620ec43fae00d1c6ca WatchSource:0}: Error finding container 1de268920e7d627eeb4e45cfe6ed327f121d25df2f0559620ec43fae00d1c6ca: Status 404 returned error can't find the container with id 1de268920e7d627eeb4e45cfe6ed327f121d25df2f0559620ec43fae00d1c6ca
Jul 17 04:57:02.234595 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:02.234544    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq" event={"ID":"42bcb6e8-91ca-47d1-818e-f664423bba51","Type":"ContainerStarted","Data":"1de268920e7d627eeb4e45cfe6ed327f121d25df2f0559620ec43fae00d1c6ca"}
Jul 17 04:57:03.787062 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:03.787018    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:03.888809 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:03.888702    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:08.156614 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:08.156569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:08.256847 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:08.256810    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:10.225725 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:10.225690    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:57:11.615742 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.615700    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:11.715795 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.715755    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:11.920851 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.920757    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"]
Jul 17 04:57:11.921027 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.920977    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556" podUID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" containerName="manager" containerID="cri-o://180e9a100bafab13281353c09280e1baa5e66bba087ed26a6548caff28c5d6c4" gracePeriod=2
Jul 17 04:57:11.931280 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.930965    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"]
Jul 17 04:57:11.933076 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:11.932666    2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"7fe11016-19ff-4f5c-9403-c2b503ce8bd4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-m5556\": pods \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:57:11.943721 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.942564    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"]
Jul 17 04:57:11.943721 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.943172    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" containerName="manager"
Jul 17 04:57:11.943721 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.943192    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" containerName="manager"
Jul 17 04:57:11.943721 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.943294    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" containerName="manager"
Jul 17 04:57:11.959829 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.959797    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"]
Jul 17 04:57:11.959987 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.959859    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"]
Jul 17 04:57:11.959987 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.959913    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"
Jul 17 04:57:11.960077 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.960045    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" containerName="manager" containerID="cri-o://983085d486e32b37b8caeb652fa5a49a616e22aaf681c6cf2ce4e59c465b2b3c" gracePeriod=2
Jul 17 04:57:11.962356 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.962332    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"]
Jul 17 04:57:11.962771 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:11.962739    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zwnjd\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:57:11.965074 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:11.965042    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:57:11.967414 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:11.967379    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zwnjd\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:57:11.969988 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:11.969958    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:57:11.973736 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.973701    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chhjn"]
Jul 17 04:57:11.974480 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.974457    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" containerName="manager"
Jul 17 04:57:11.974599 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.974586    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" containerName="manager"
Jul 17 04:57:11.974922 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.974900    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" containerName="manager"
Jul 17 04:57:11.979698 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.979674    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chhjn"
Jul 17 04:57:11.991488 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:11.991453    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chhjn"]
Jul 17 04:57:11.995459 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:11.995408    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zwnjd\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:57:11.997932 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:11.997887    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:57:12.062086 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:12.062044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:12.091297 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:12.091250    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40ca6671-4d39-4b32-b322-2bddcda1422d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6sw9w\" (UID: \"40ca6671-4d39-4b32-b322-2bddcda1422d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"
Jul 17 04:57:12.091493 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:12.091386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw2kp\" (UniqueName: \"kubernetes.io/projected/40ca6671-4d39-4b32-b322-2bddcda1422d-kube-api-access-bw2kp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6sw9w\" (UID: \"40ca6671-4d39-4b32-b322-2bddcda1422d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"
Jul 17 04:57:12.091565 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:12.091528    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5xnd\" (UniqueName: \"kubernetes.io/projected/2cbf602b-ccb7-4d82-a282-efd4dd0c8ff9-kube-api-access-k5xnd\") pod \"limitador-operator-controller-manager-859d7b78bd-chhjn\" (UID: \"2cbf602b-ccb7-4d82-a282-efd4dd0c8ff9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chhjn"
Jul 17 04:57:12.164810 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:12.164770    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:12.193225 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:12.193123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5xnd\" (UniqueName: \"kubernetes.io/projected/2cbf602b-ccb7-4d82-a282-efd4dd0c8ff9-kube-api-access-k5xnd\") pod \"limitador-operator-controller-manager-859d7b78bd-chhjn\" (UID: \"2cbf602b-ccb7-4d82-a282-efd4dd0c8ff9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chhjn"
Jul 17 04:57:12.193225 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:12.193199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40ca6671-4d39-4b32-b322-2bddcda1422d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6sw9w\" (UID: \"40ca6671-4d39-4b32-b322-2bddcda1422d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"
Jul 17 04:57:12.193450 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:12.193275    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw2kp\" (UniqueName: \"kubernetes.io/projected/40ca6671-4d39-4b32-b322-2bddcda1422d-kube-api-access-bw2kp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6sw9w\" (UID: \"40ca6671-4d39-4b32-b322-2bddcda1422d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"
Jul 17 04:57:12.193699 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:12.193674    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40ca6671-4d39-4b32-b322-2bddcda1422d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6sw9w\" (UID: \"40ca6671-4d39-4b32-b322-2bddcda1422d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"
Jul 17 04:57:12.206512 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:12.206477    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5xnd\" (UniqueName: \"kubernetes.io/projected/2cbf602b-ccb7-4d82-a282-efd4dd0c8ff9-kube-api-access-k5xnd\") pod \"limitador-operator-controller-manager-859d7b78bd-chhjn\" (UID: \"2cbf602b-ccb7-4d82-a282-efd4dd0c8ff9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chhjn"
Jul 17 04:57:12.206736 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:12.206564    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw2kp\" (UniqueName: \"kubernetes.io/projected/40ca6671-4d39-4b32-b322-2bddcda1422d-kube-api-access-bw2kp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6sw9w\" (UID: \"40ca6671-4d39-4b32-b322-2bddcda1422d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"
Jul 17 04:57:12.356256 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:12.356219    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"
Jul 17 04:57:12.364998 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:12.364964    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chhjn"
Jul 17 04:57:14.619084 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:14.619044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:14.719413 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:14.719374    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:19.817244 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:19.817201    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:19.917784 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:19.917742    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:23.216160 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:23.216127    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:23.281771 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:23.281735    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:24.309136 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.309107    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:57:24.311283 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:24.311240    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zwnjd\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:57:24.312813 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.312784    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:57:24.315349 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:24.315307    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zwnjd\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:57:24.317293 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:24.317267    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:57:24.340794 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.340768    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"]
Jul 17 04:57:24.341174 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:57:24.341151    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ca6671_4d39_4b32_b322_2bddcda1422d.slice/crio-c43554d62881318b347bd2455746d3224a7996786b896a5d1f9152824d836b4a WatchSource:0}: Error finding container c43554d62881318b347bd2455746d3224a7996786b896a5d1f9152824d836b4a: Status 404 returned error can't find the container with id c43554d62881318b347bd2455746d3224a7996786b896a5d1f9152824d836b4a
Jul 17 04:57:24.371148 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.371123    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chhjn"]
Jul 17 04:57:24.380902 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:57:24.380876    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cbf602b_ccb7_4d82_a282_efd4dd0c8ff9.slice/crio-61441d8a3cf4ff7cf0d8c49472394d7695a499b17dba3a2985116687f1efa40a WatchSource:0}: Error finding container 61441d8a3cf4ff7cf0d8c49472394d7695a499b17dba3a2985116687f1efa40a: Status 404 returned error can't find the container with id 61441d8a3cf4ff7cf0d8c49472394d7695a499b17dba3a2985116687f1efa40a
Jul 17 04:57:24.384217 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.384189    2564 generic.go:356] "Generic (PLEG): container finished" podID="3836ec50-05bf-4d1f-9a23-13f2d6424908" containerID="983085d486e32b37b8caeb652fa5a49a616e22aaf681c6cf2ce4e59c465b2b3c" exitCode=0
Jul 17 04:57:24.384325 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.384231    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:57:24.384325 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.384291    2564 scope.go:117] "RemoveContainer" containerID="983085d486e32b37b8caeb652fa5a49a616e22aaf681c6cf2ce4e59c465b2b3c"
Jul 17 04:57:24.386117 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.386090    2564 generic.go:356] "Generic (PLEG): container finished" podID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" containerID="180e9a100bafab13281353c09280e1baa5e66bba087ed26a6548caff28c5d6c4" exitCode=0
Jul 17 04:57:24.386222 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.386130    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:57:24.386502 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:24.386480    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zwnjd\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:57:24.388214 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.388137    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq" event={"ID":"42bcb6e8-91ca-47d1-818e-f664423bba51","Type":"ContainerStarted","Data":"e309d8afd732e70262fa96e122cdedfe1e79499e2728a693ac43e52d6d1e23c5"}
Jul 17 04:57:24.388512 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:24.388479    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:57:24.389679 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.389656    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w" event={"ID":"40ca6671-4d39-4b32-b322-2bddcda1422d","Type":"ContainerStarted","Data":"c43554d62881318b347bd2455746d3224a7996786b896a5d1f9152824d836b4a"}
Jul 17 04:57:24.390416 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:24.390388    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zwnjd\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:57:24.392122 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:24.392098    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:57:24.403943 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.403923    2564 scope.go:117] "RemoveContainer" containerID="983085d486e32b37b8caeb652fa5a49a616e22aaf681c6cf2ce4e59c465b2b3c"
Jul 17 04:57:24.404288 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:24.404263    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"983085d486e32b37b8caeb652fa5a49a616e22aaf681c6cf2ce4e59c465b2b3c\": container with ID starting with 983085d486e32b37b8caeb652fa5a49a616e22aaf681c6cf2ce4e59c465b2b3c not found: ID does not exist" containerID="983085d486e32b37b8caeb652fa5a49a616e22aaf681c6cf2ce4e59c465b2b3c"
Jul 17 04:57:24.404387 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.404294    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"983085d486e32b37b8caeb652fa5a49a616e22aaf681c6cf2ce4e59c465b2b3c"} err="failed to get container status \"983085d486e32b37b8caeb652fa5a49a616e22aaf681c6cf2ce4e59c465b2b3c\": rpc error: code = NotFound desc = could not find container \"983085d486e32b37b8caeb652fa5a49a616e22aaf681c6cf2ce4e59c465b2b3c\": container with ID starting with 983085d486e32b37b8caeb652fa5a49a616e22aaf681c6cf2ce4e59c465b2b3c not found: ID does not exist"
Jul 17 04:57:24.404387 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.404312    2564 scope.go:117] "RemoveContainer" containerID="180e9a100bafab13281353c09280e1baa5e66bba087ed26a6548caff28c5d6c4"
Jul 17 04:57:24.407736 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.407693    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zm7gq" podStartSLOduration=1.447975419 podStartE2EDuration="24.4076788s" totalImagesPullingTime="22.959703381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:57:24.40516793 +0000 UTC m=+479.082774277" watchObservedRunningTime="2026-07-17 04:57:24.4076788 +0000 UTC m=+479.085285146"
Jul 17 04:57:24.415895 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.415864    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9mqb\" (UniqueName: \"kubernetes.io/projected/3836ec50-05bf-4d1f-9a23-13f2d6424908-kube-api-access-t9mqb\") pod \"3836ec50-05bf-4d1f-9a23-13f2d6424908\" (UID: \"3836ec50-05bf-4d1f-9a23-13f2d6424908\") "
Jul 17 04:57:24.416006 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.415933    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fe11016-19ff-4f5c-9403-c2b503ce8bd4-extensions-socket-volume\") pod \"7fe11016-19ff-4f5c-9403-c2b503ce8bd4\" (UID: \"7fe11016-19ff-4f5c-9403-c2b503ce8bd4\") "
Jul 17 04:57:24.416065 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.416035    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkhwk\" (UniqueName: \"kubernetes.io/projected/7fe11016-19ff-4f5c-9403-c2b503ce8bd4-kube-api-access-dkhwk\") pod \"7fe11016-19ff-4f5c-9403-c2b503ce8bd4\" (UID: \"7fe11016-19ff-4f5c-9403-c2b503ce8bd4\") "
Jul 17 04:57:24.416749 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.416706    2564 scope.go:117] "RemoveContainer" containerID="180e9a100bafab13281353c09280e1baa5e66bba087ed26a6548caff28c5d6c4"
Jul 17 04:57:24.416973 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.416925    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fe11016-19ff-4f5c-9403-c2b503ce8bd4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7fe11016-19ff-4f5c-9403-c2b503ce8bd4" (UID: "7fe11016-19ff-4f5c-9403-c2b503ce8bd4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:57:24.417086 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:24.417047    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"180e9a100bafab13281353c09280e1baa5e66bba087ed26a6548caff28c5d6c4\": container with ID starting with 180e9a100bafab13281353c09280e1baa5e66bba087ed26a6548caff28c5d6c4 not found: ID does not exist" containerID="180e9a100bafab13281353c09280e1baa5e66bba087ed26a6548caff28c5d6c4"
Jul 17 04:57:24.417161 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.417079    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"180e9a100bafab13281353c09280e1baa5e66bba087ed26a6548caff28c5d6c4"} err="failed to get container status \"180e9a100bafab13281353c09280e1baa5e66bba087ed26a6548caff28c5d6c4\": rpc error: code = NotFound desc = could not find container \"180e9a100bafab13281353c09280e1baa5e66bba087ed26a6548caff28c5d6c4\": container with ID starting with 180e9a100bafab13281353c09280e1baa5e66bba087ed26a6548caff28c5d6c4 not found: ID does not exist"
Jul 17 04:57:24.419430 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.419358    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3836ec50-05bf-4d1f-9a23-13f2d6424908-kube-api-access-t9mqb" (OuterVolumeSpecName: "kube-api-access-t9mqb") pod "3836ec50-05bf-4d1f-9a23-13f2d6424908" (UID: "3836ec50-05bf-4d1f-9a23-13f2d6424908"). InnerVolumeSpecName "kube-api-access-t9mqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:57:24.419613 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.419568    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fe11016-19ff-4f5c-9403-c2b503ce8bd4-kube-api-access-dkhwk" (OuterVolumeSpecName: "kube-api-access-dkhwk") pod "7fe11016-19ff-4f5c-9403-c2b503ce8bd4" (UID: "7fe11016-19ff-4f5c-9403-c2b503ce8bd4"). InnerVolumeSpecName "kube-api-access-dkhwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:57:24.517790 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.517750    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fe11016-19ff-4f5c-9403-c2b503ce8bd4-extensions-socket-volume\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:57:24.517790 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.517786    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkhwk\" (UniqueName: \"kubernetes.io/projected/7fe11016-19ff-4f5c-9403-c2b503ce8bd4-kube-api-access-dkhwk\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:57:24.518009 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:24.517800    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9mqb\" (UniqueName: \"kubernetes.io/projected/3836ec50-05bf-4d1f-9a23-13f2d6424908-kube-api-access-t9mqb\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:57:24.698340 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:24.698308    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zwnjd\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:57:24.700235 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:24.700210    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:57:24.702066 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:24.702042    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zwnjd\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:57:24.703758 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:24.703741    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:57:25.398445 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:25.398325    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chhjn" event={"ID":"2cbf602b-ccb7-4d82-a282-efd4dd0c8ff9","Type":"ContainerStarted","Data":"7a78e50c6aa3aa9e18507ebf62dc7ab379993a2eddb2e7e278ad1bdb9854d7c4"}
Jul 17 04:57:25.398445 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:25.398398    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chhjn" event={"ID":"2cbf602b-ccb7-4d82-a282-efd4dd0c8ff9","Type":"ContainerStarted","Data":"61441d8a3cf4ff7cf0d8c49472394d7695a499b17dba3a2985116687f1efa40a"}
Jul 17 04:57:25.398445 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:25.398431    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chhjn"
Jul 17 04:57:25.399841 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:25.399814    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w" event={"ID":"40ca6671-4d39-4b32-b322-2bddcda1422d","Type":"ContainerStarted","Data":"ca79be8c20f13eee5f6c898d22b975c68531630ee7ecdc9ba1f2f9b90f798885"}
Jul 17 04:57:25.400840 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:25.400816    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zwnjd\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:57:25.402839 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:25.402819    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:57:25.421421 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:25.421364    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chhjn" podStartSLOduration=14.421347995 podStartE2EDuration="14.421347995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:57:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:57:25.420386867 +0000 UTC m=+480.097993214" watchObservedRunningTime="2026-07-17 04:57:25.421347995 +0000 UTC m=+480.098954341"
Jul 17 04:57:25.429193 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:25.428897    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:57:25.449493 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:25.449449    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zwnjd\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:57:25.449696 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:25.449593    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w" podStartSLOduration=14.449575693 podStartE2EDuration="14.449575693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:57:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:57:25.447332868 +0000 UTC m=+480.124939205" watchObservedRunningTime="2026-07-17 04:57:25.449575693 +0000 UTC m=+480.127182039"
Jul 17 04:57:25.855686 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:25.855617    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zwnjd\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zwnjd"
Jul 17 04:57:25.857459 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:25.857431    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3836ec50-05bf-4d1f-9a23-13f2d6424908" path="/var/lib/kubelet/pods/3836ec50-05bf-4d1f-9a23-13f2d6424908/volumes"
Jul 17 04:57:25.857744 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:25.857721    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5556\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5556"
Jul 17 04:57:25.857808 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:25.857801    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fe11016-19ff-4f5c-9403-c2b503ce8bd4" path="/var/lib/kubelet/pods/7fe11016-19ff-4f5c-9403-c2b503ce8bd4/volumes"
Jul 17 04:57:26.406202 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:26.406174    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"
Jul 17 04:57:27.952044 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:27.952013    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"]
Jul 17 04:57:28.217424 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.217342    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"]
Jul 17 04:57:28.223179 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.223153    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"
Jul 17 04:57:28.234026 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.233991    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"]
Jul 17 04:57:28.354813 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.354768    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tbw7\" (UniqueName: \"kubernetes.io/projected/1d4a4141-7235-4a4b-b458-0be577bbb8d2-kube-api-access-4tbw7\") pod \"kuadrant-operator-controller-manager-86878c769f-7mppn\" (UID: \"1d4a4141-7235-4a4b-b458-0be577bbb8d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"
Jul 17 04:57:28.355009 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.354855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d4a4141-7235-4a4b-b458-0be577bbb8d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7mppn\" (UID: \"1d4a4141-7235-4a4b-b458-0be577bbb8d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"
Jul 17 04:57:28.418028 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.417956    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w" podUID="40ca6671-4d39-4b32-b322-2bddcda1422d" containerName="manager" containerID="cri-o://ca79be8c20f13eee5f6c898d22b975c68531630ee7ecdc9ba1f2f9b90f798885" gracePeriod=10
Jul 17 04:57:28.455790 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.455749    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tbw7\" (UniqueName: \"kubernetes.io/projected/1d4a4141-7235-4a4b-b458-0be577bbb8d2-kube-api-access-4tbw7\") pod \"kuadrant-operator-controller-manager-86878c769f-7mppn\" (UID: \"1d4a4141-7235-4a4b-b458-0be577bbb8d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"
Jul 17 04:57:28.455977 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.455830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d4a4141-7235-4a4b-b458-0be577bbb8d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7mppn\" (UID: \"1d4a4141-7235-4a4b-b458-0be577bbb8d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"
Jul 17 04:57:28.456237 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.456215    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d4a4141-7235-4a4b-b458-0be577bbb8d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7mppn\" (UID: \"1d4a4141-7235-4a4b-b458-0be577bbb8d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"
Jul 17 04:57:28.464906 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.464874    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tbw7\" (UniqueName: \"kubernetes.io/projected/1d4a4141-7235-4a4b-b458-0be577bbb8d2-kube-api-access-4tbw7\") pod \"kuadrant-operator-controller-manager-86878c769f-7mppn\" (UID: \"1d4a4141-7235-4a4b-b458-0be577bbb8d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"
Jul 17 04:57:28.534139 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.534108    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"
Jul 17 04:57:28.686315 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.686288    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"
Jul 17 04:57:28.693792 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.693765    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"]
Jul 17 04:57:28.695689 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:57:28.695668    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d4a4141_7235_4a4b_b458_0be577bbb8d2.slice/crio-2efa48714209da561021738c9031f8778dc4414bcc2e1845a0c92c61cec8321f WatchSource:0}: Error finding container 2efa48714209da561021738c9031f8778dc4414bcc2e1845a0c92c61cec8321f: Status 404 returned error can't find the container with id 2efa48714209da561021738c9031f8778dc4414bcc2e1845a0c92c61cec8321f
Jul 17 04:57:28.860188 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.860149    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40ca6671-4d39-4b32-b322-2bddcda1422d-extensions-socket-volume\") pod \"40ca6671-4d39-4b32-b322-2bddcda1422d\" (UID: \"40ca6671-4d39-4b32-b322-2bddcda1422d\") "
Jul 17 04:57:28.860395 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.860254    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw2kp\" (UniqueName: \"kubernetes.io/projected/40ca6671-4d39-4b32-b322-2bddcda1422d-kube-api-access-bw2kp\") pod \"40ca6671-4d39-4b32-b322-2bddcda1422d\" (UID: \"40ca6671-4d39-4b32-b322-2bddcda1422d\") "
Jul 17 04:57:28.860619 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.860590    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ca6671-4d39-4b32-b322-2bddcda1422d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "40ca6671-4d39-4b32-b322-2bddcda1422d" (UID: "40ca6671-4d39-4b32-b322-2bddcda1422d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 04:57:28.862463 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.862439    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ca6671-4d39-4b32-b322-2bddcda1422d-kube-api-access-bw2kp" (OuterVolumeSpecName: "kube-api-access-bw2kp") pod "40ca6671-4d39-4b32-b322-2bddcda1422d" (UID: "40ca6671-4d39-4b32-b322-2bddcda1422d"). InnerVolumeSpecName "kube-api-access-bw2kp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 04:57:28.961428 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.961388    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw2kp\" (UniqueName: \"kubernetes.io/projected/40ca6671-4d39-4b32-b322-2bddcda1422d-kube-api-access-bw2kp\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:57:28.961428 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:28.961428    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40ca6671-4d39-4b32-b322-2bddcda1422d-extensions-socket-volume\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 04:57:29.425784 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:29.425752    2564 generic.go:356] "Generic (PLEG): container finished" podID="40ca6671-4d39-4b32-b322-2bddcda1422d" containerID="ca79be8c20f13eee5f6c898d22b975c68531630ee7ecdc9ba1f2f9b90f798885" exitCode=0
Jul 17 04:57:29.425784 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:29.425796    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"
Jul 17 04:57:29.426084 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:29.425839    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w" event={"ID":"40ca6671-4d39-4b32-b322-2bddcda1422d","Type":"ContainerDied","Data":"ca79be8c20f13eee5f6c898d22b975c68531630ee7ecdc9ba1f2f9b90f798885"}
Jul 17 04:57:29.426084 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:29.425895    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w" event={"ID":"40ca6671-4d39-4b32-b322-2bddcda1422d","Type":"ContainerDied","Data":"c43554d62881318b347bd2455746d3224a7996786b896a5d1f9152824d836b4a"}
Jul 17 04:57:29.426084 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:29.425929    2564 scope.go:117] "RemoveContainer" containerID="ca79be8c20f13eee5f6c898d22b975c68531630ee7ecdc9ba1f2f9b90f798885"
Jul 17 04:57:29.427950 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:29.427918    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn" event={"ID":"1d4a4141-7235-4a4b-b458-0be577bbb8d2","Type":"ContainerStarted","Data":"8b2ff462f6cac00ea3011a8977039b3ac3dbbde690ef74ea694f839e4a118417"}
Jul 17 04:57:29.428053 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:29.427980    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn" event={"ID":"1d4a4141-7235-4a4b-b458-0be577bbb8d2","Type":"ContainerStarted","Data":"2efa48714209da561021738c9031f8778dc4414bcc2e1845a0c92c61cec8321f"}
Jul 17 04:57:29.428053 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:29.428014    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"
Jul 17 04:57:29.443304 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:29.443280    2564 scope.go:117] "RemoveContainer" containerID="ca79be8c20f13eee5f6c898d22b975c68531630ee7ecdc9ba1f2f9b90f798885"
Jul 17 04:57:29.443732 ip-10-0-129-234 kubenswrapper[2564]: E0717 04:57:29.443708    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca79be8c20f13eee5f6c898d22b975c68531630ee7ecdc9ba1f2f9b90f798885\": container with ID starting with ca79be8c20f13eee5f6c898d22b975c68531630ee7ecdc9ba1f2f9b90f798885 not found: ID does not exist" containerID="ca79be8c20f13eee5f6c898d22b975c68531630ee7ecdc9ba1f2f9b90f798885"
Jul 17 04:57:29.443813 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:29.443744    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca79be8c20f13eee5f6c898d22b975c68531630ee7ecdc9ba1f2f9b90f798885"} err="failed to get container status \"ca79be8c20f13eee5f6c898d22b975c68531630ee7ecdc9ba1f2f9b90f798885\": rpc error: code = NotFound desc = could not find container \"ca79be8c20f13eee5f6c898d22b975c68531630ee7ecdc9ba1f2f9b90f798885\": container with ID starting with ca79be8c20f13eee5f6c898d22b975c68531630ee7ecdc9ba1f2f9b90f798885 not found: ID does not exist"
Jul 17 04:57:29.453396 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:29.453346    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn" podStartSLOduration=1.453328529 podStartE2EDuration="1.453328529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:57:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:57:29.450171705 +0000 UTC m=+484.127778050" watchObservedRunningTime="2026-07-17 04:57:29.453328529 +0000 UTC m=+484.130934878"
Jul 17 04:57:29.465170 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:29.465123    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"]
Jul 17 04:57:29.471233 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:29.471201    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6sw9w"]
Jul 17 04:57:29.858245 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:29.858214    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40ca6671-4d39-4b32-b322-2bddcda1422d" path="/var/lib/kubelet/pods/40ca6671-4d39-4b32-b322-2bddcda1422d/volumes"
Jul 17 04:57:36.409121 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:36.409090    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chhjn"
Jul 17 04:57:40.437397 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:40.437360    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"
Jul 17 04:57:44.305892 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:44.305848    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:44.635271 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:44.635172    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:47.084765 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:47.084730    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:47.185110 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:47.185069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:59.743800 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:59.743676    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:57:59.800666 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:57:59.800604    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:58:00.032405 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.032317    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 04:58:00.032811 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.032797    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ca6671-4d39-4b32-b322-2bddcda1422d" containerName="manager"
Jul 17 04:58:00.032863 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.032815    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ca6671-4d39-4b32-b322-2bddcda1422d" containerName="manager"
Jul 17 04:58:00.032903 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.032896    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ca6671-4d39-4b32-b322-2bddcda1422d" containerName="manager"
Jul 17 04:58:00.044882 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.044854    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 04:58:00.045023 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.044960    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"
Jul 17 04:58:00.047410 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.047391    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 17 04:58:00.061807 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.061782    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 04:58:00.142208 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.142171    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8cb95a74-9ee6-41e4-9027-837d24c4d4dd-config-file\") pod \"limitador-limitador-54d6d988d5-gqzpc\" (UID: \"8cb95a74-9ee6-41e4-9027-837d24c4d4dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"
Jul 17 04:58:00.142208 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.142206    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsp7r\" (UniqueName: \"kubernetes.io/projected/8cb95a74-9ee6-41e4-9027-837d24c4d4dd-kube-api-access-dsp7r\") pod \"limitador-limitador-54d6d988d5-gqzpc\" (UID: \"8cb95a74-9ee6-41e4-9027-837d24c4d4dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"
Jul 17 04:58:00.243533 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.243489    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8cb95a74-9ee6-41e4-9027-837d24c4d4dd-config-file\") pod \"limitador-limitador-54d6d988d5-gqzpc\" (UID: \"8cb95a74-9ee6-41e4-9027-837d24c4d4dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"
Jul 17 04:58:00.243533 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.243529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsp7r\" (UniqueName: \"kubernetes.io/projected/8cb95a74-9ee6-41e4-9027-837d24c4d4dd-kube-api-access-dsp7r\") pod \"limitador-limitador-54d6d988d5-gqzpc\" (UID: \"8cb95a74-9ee6-41e4-9027-837d24c4d4dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"
Jul 17 04:58:00.244150 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.244129    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8cb95a74-9ee6-41e4-9027-837d24c4d4dd-config-file\") pod \"limitador-limitador-54d6d988d5-gqzpc\" (UID: \"8cb95a74-9ee6-41e4-9027-837d24c4d4dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"
Jul 17 04:58:00.252144 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.252110    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsp7r\" (UniqueName: \"kubernetes.io/projected/8cb95a74-9ee6-41e4-9027-837d24c4d4dd-kube-api-access-dsp7r\") pod \"limitador-limitador-54d6d988d5-gqzpc\" (UID: \"8cb95a74-9ee6-41e4-9027-837d24c4d4dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"
Jul 17 04:58:00.356563 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.356527    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"
Jul 17 04:58:00.459724 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.459657    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:58:00.509408 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.509377    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 04:58:00.510957 ip-10-0-129-234 kubenswrapper[2564]: W0717 04:58:00.510925    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb95a74_9ee6_41e4_9027_837d24c4d4dd.slice/crio-6ffc033d918904f0ee0ee1423b36de3561ea8fd0ccc093d35ff98ac24ddefe57 WatchSource:0}: Error finding container 6ffc033d918904f0ee0ee1423b36de3561ea8fd0ccc093d35ff98ac24ddefe57: Status 404 returned error can't find the container with id 6ffc033d918904f0ee0ee1423b36de3561ea8fd0ccc093d35ff98ac24ddefe57
Jul 17 04:58:00.530069 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.524395    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:58:00.600349 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:00.600308    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gqzpc" event={"ID":"8cb95a74-9ee6-41e4-9027-837d24c4d4dd","Type":"ContainerStarted","Data":"6ffc033d918904f0ee0ee1423b36de3561ea8fd0ccc093d35ff98ac24ddefe57"}
Jul 17 04:58:03.621279 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:03.621236    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gqzpc" event={"ID":"8cb95a74-9ee6-41e4-9027-837d24c4d4dd","Type":"ContainerStarted","Data":"3786249bd980bcb153862456835d695219ba8991ac59731ecf4d9aedc53df4cc"}
Jul 17 04:58:03.621756 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:03.621362    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"
Jul 17 04:58:03.638349 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:03.638282    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-gqzpc" podStartSLOduration=0.953536483 podStartE2EDuration="3.638264851s" totalImagesPullingTime="2.684728368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 04:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 04:58:03.636794287 +0000 UTC m=+518.314400638" watchObservedRunningTime="2026-07-17 04:58:03.638264851 +0000 UTC m=+518.315871241"
Jul 17 04:58:14.630009 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:14.629976    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"
Jul 17 04:58:17.635461 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:17.635378    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:58:17.735749 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:17.735705    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:58:20.480815 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:20.480782    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:58:20.579618 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:20.579575    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:58:20.975492 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:20.975449    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:58:33.988042 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:33.988000    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:58:34.056677 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:34.056612    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:58:40.272859 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:40.272825    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:58:40.365333 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:40.365296    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:58:40.419809 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:40.419774    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:58:43.766389 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:43.766344    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:58:43.860018 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:58:43.859989    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:59:16.686693 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:59:16.686658    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:59:16.818823 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:59:16.818788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:59:17.282286 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:59:17.282247    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:59:17.502813 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:59:17.502777    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:59:17.795387 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:59:17.795355    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:59:17.899600 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:59:17.899563    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:59:18.042059 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:59:18.042020    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 04:59:25.806946 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:59:25.806915    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 04:59:25.813355 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:59:25.813328    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 04:59:28.480974 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:59:28.480935    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:59:28.579051 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:59:28.579018    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:59:48.921368 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:59:48.921272    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:59:51.233731 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:59:51.233692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:59:51.729346 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:59:51.729304    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 04:59:58.650308 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:59:58.650268    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 04:59:59.627379 ip-10-0-129-234 kubenswrapper[2564]: I0717 04:59:59.627340    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:00:16.812701 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.812656    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"]
Jul 17 05:00:16.817217 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.817190    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.819913 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.819890    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 05:00:16.821550 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.821520    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 17 05:00:16.821925 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.821883    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 05:00:16.822064 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.822001    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-q7v2x\""
Jul 17 05:00:16.824860 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.824835    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"]
Jul 17 05:00:16.846118 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.846085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:00:16.865295 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.865245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.865295 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.865295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.865532 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.865349    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mdg5\" (UniqueName: \"kubernetes.io/projected/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-kube-api-access-9mdg5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.865532 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.865387    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.865532 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.865430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.865532 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.865479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.966683 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.966644    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.966887 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.966714    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.966887 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.966794    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.966887 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.966822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.966887 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.966856    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mdg5\" (UniqueName: \"kubernetes.io/projected/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-kube-api-access-9mdg5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.967112 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.966895    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.967180 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.967120    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.967180 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.967147    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.967283 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.967213    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.969283 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.969260    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.969608 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.969588    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:16.974692 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:16.974668    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mdg5\" (UniqueName: \"kubernetes.io/projected/a56bf6b6-368b-46f8-b4c9-67b7b9047fcc-kube-api-access-9mdg5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bf7n4\" (UID: \"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:17.131738 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:17.131617    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:17.279431 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:17.279400    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"]
Jul 17 05:00:17.281571 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:00:17.281548    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda56bf6b6_368b_46f8_b4c9_67b7b9047fcc.slice/crio-ba0d7a74f620c8d15efca06e15fb289e00c931ae239c9d86d3d83d189e912f23 WatchSource:0}: Error finding container ba0d7a74f620c8d15efca06e15fb289e00c931ae239c9d86d3d83d189e912f23: Status 404 returned error can't find the container with id ba0d7a74f620c8d15efca06e15fb289e00c931ae239c9d86d3d83d189e912f23
Jul 17 05:00:17.283314 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:17.283297    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 05:00:17.384402 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:17.384314    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4" event={"ID":"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc","Type":"ContainerStarted","Data":"ba0d7a74f620c8d15efca06e15fb289e00c931ae239c9d86d3d83d189e912f23"}
Jul 17 05:00:18.130381 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:18.130341    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:00:30.460754 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:30.460659    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4" event={"ID":"a56bf6b6-368b-46f8-b4c9-67b7b9047fcc","Type":"ContainerStarted","Data":"61deb2ef81a42014c345c84d8d93b77303dbbd82c9b0ba77306745a27a6dcbaa"}
Jul 17 05:00:30.477562 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:30.477496    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4" podStartSLOduration=1.655208819 podStartE2EDuration="14.477474052s" totalImagesPullingTime="12.822265233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:00:30.477299298 +0000 UTC m=+665.154905645" watchObservedRunningTime="2026-07-17 05:00:30.477474052 +0000 UTC m=+665.155080398"
Jul 17 05:00:37.132091 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:37.132035    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:37.132564 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:37.132115    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:37.145025 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:37.144993    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:37.518319 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:37.518219    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bf7n4"
Jul 17 05:00:40.688184 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:40.688142    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:00:40.743596 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:40.743561    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:00:42.934117 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:42.934069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:00:44.720845 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:44.720807    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:00:48.246245 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:00:48.246206    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:01:03.129232 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:03.129190    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:01:05.031444 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.031408    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:01:05.733928 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.733879    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"]
Jul 17 05:01:05.740897 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.740859    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.743364 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.743341    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 17 05:01:05.749725 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.749692    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"]
Jul 17 05:01:05.759711 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.759672    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:01:05.808601 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.808564    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66be40f8-52db-46a2-a19e-453fd4207026-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.808601 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.808610    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66be40f8-52db-46a2-a19e-453fd4207026-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.808914 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.808782    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66be40f8-52db-46a2-a19e-453fd4207026-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.808914 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.808821    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66be40f8-52db-46a2-a19e-453fd4207026-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.808914 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.808857    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr85t\" (UniqueName: \"kubernetes.io/projected/66be40f8-52db-46a2-a19e-453fd4207026-kube-api-access-tr85t\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.809076 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.808968    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66be40f8-52db-46a2-a19e-453fd4207026-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.910318 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.910275    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66be40f8-52db-46a2-a19e-453fd4207026-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.910503 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.910345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66be40f8-52db-46a2-a19e-453fd4207026-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.910503 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.910444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66be40f8-52db-46a2-a19e-453fd4207026-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.910503 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.910499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66be40f8-52db-46a2-a19e-453fd4207026-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.910739 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.910545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66be40f8-52db-46a2-a19e-453fd4207026-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.910739 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.910576    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr85t\" (UniqueName: \"kubernetes.io/projected/66be40f8-52db-46a2-a19e-453fd4207026-kube-api-access-tr85t\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.910847 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.910812    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66be40f8-52db-46a2-a19e-453fd4207026-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.910905 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.910881    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66be40f8-52db-46a2-a19e-453fd4207026-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.910999 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.910958    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66be40f8-52db-46a2-a19e-453fd4207026-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.913038 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.913015    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66be40f8-52db-46a2-a19e-453fd4207026-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.913290 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.913271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66be40f8-52db-46a2-a19e-453fd4207026-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:05.920613 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:05.920574    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr85t\" (UniqueName: \"kubernetes.io/projected/66be40f8-52db-46a2-a19e-453fd4207026-kube-api-access-tr85t\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p\" (UID: \"66be40f8-52db-46a2-a19e-453fd4207026\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:06.052867 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:06.052772    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:06.207502 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:06.207476    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"]
Jul 17 05:01:06.208713 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:01:06.208676    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66be40f8_52db_46a2_a19e_453fd4207026.slice/crio-5e7eb047812fabb5f461929761ab8ff867d5388f1e17d2127429008dd6f604cb WatchSource:0}: Error finding container 5e7eb047812fabb5f461929761ab8ff867d5388f1e17d2127429008dd6f604cb: Status 404 returned error can't find the container with id 5e7eb047812fabb5f461929761ab8ff867d5388f1e17d2127429008dd6f604cb
Jul 17 05:01:06.677328 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:06.677243    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p" event={"ID":"66be40f8-52db-46a2-a19e-453fd4207026","Type":"ContainerStarted","Data":"6a9056e2b7c744ef879102194de0bb665b905a5f2d83e5a9994e0db9fb6537a3"}
Jul 17 05:01:06.677328 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:06.677287    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p" event={"ID":"66be40f8-52db-46a2-a19e-453fd4207026","Type":"ContainerStarted","Data":"5e7eb047812fabb5f461929761ab8ff867d5388f1e17d2127429008dd6f604cb"}
Jul 17 05:01:06.696737 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:06.696679    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p" podStartSLOduration=1.509920564 podStartE2EDuration="1.696660777s" totalImagesPullingTime="186.740213ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:01:06.693878801 +0000 UTC m=+701.371485141" watchObservedRunningTime="2026-07-17 05:01:06.696660777 +0000 UTC m=+701.374267164"
Jul 17 05:01:14.228677 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:14.228634    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:01:16.053164 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:16.053119    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:16.053593 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:16.053472    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:16.066230 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:16.066200    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:01:16.747251 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:01:16.747183    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p"
Jul 17 05:02:16.667306 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:02:16.667270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:02:33.073600 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:02:33.073540    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:02:33.171856 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:02:33.171808    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:02:34.206501 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:02:34.206458    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:02:34.306689 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:02:34.306621    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:03:04.040050 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:03:04.039960    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:03:13.629834 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:03:13.629796    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:03:23.635980 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:03:23.635940    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:03:38.420112 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:03:38.420071    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:04:25.845578 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:04:25.845547    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:04:25.848812 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:04:25.848788    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:04:39.844359 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:04:39.844314    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:04:40.723030 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:04:40.722983    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:05:04.644950 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:05:04.644911    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:05:13.733343 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:05:13.733294    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:05:14.228414 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:05:14.228376    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:05:14.326318 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:05:14.326281    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:05:14.475000 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:05:14.474970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:05:15.017186 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:05:15.017155    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:05:15.122756 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:05:15.122712    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:05:20.046928 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:05:20.046885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:05:21.485113 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:05:21.485082    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:05:26.378607 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:05:26.378570    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:05:26.478590 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:05:26.478534    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:05:43.734041 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:05:43.734006    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:05:53.030843 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:05:53.030759    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:06:05.440224 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:06:05.440184    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:06:14.530677 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:06:14.530619    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:06:25.029845 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:06:25.029807    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:06:34.434816 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:06:34.434773    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:06:46.026863 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:06:46.026825    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:06:56.556239 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:06:56.556197    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:07:18.131766 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:07:18.131669    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:07:29.233187 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:07:29.233139    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:07:33.898518 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:07:33.898476    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:07:51.132320 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:07:51.132282    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:08:01.526955 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:08:01.526925    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:08:18.335180 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:08:18.335138    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:08:27.837815 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:08:27.837772    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:08:42.731245 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:08:42.731198    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:09:20.537036 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:20.536954    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"]
Jul 17 05:09:20.537523 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:20.537174    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn" podUID="1d4a4141-7235-4a4b-b458-0be577bbb8d2" containerName="manager" containerID="cri-o://8b2ff462f6cac00ea3011a8977039b3ac3dbbde690ef74ea694f839e4a118417" gracePeriod=10
Jul 17 05:09:23.401964 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.401933    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"
Jul 17 05:09:23.442384 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.442337    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tbw7\" (UniqueName: \"kubernetes.io/projected/1d4a4141-7235-4a4b-b458-0be577bbb8d2-kube-api-access-4tbw7\") pod \"1d4a4141-7235-4a4b-b458-0be577bbb8d2\" (UID: \"1d4a4141-7235-4a4b-b458-0be577bbb8d2\") "
Jul 17 05:09:23.442578 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.442404    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d4a4141-7235-4a4b-b458-0be577bbb8d2-extensions-socket-volume\") pod \"1d4a4141-7235-4a4b-b458-0be577bbb8d2\" (UID: \"1d4a4141-7235-4a4b-b458-0be577bbb8d2\") "
Jul 17 05:09:23.442907 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.442874    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d4a4141-7235-4a4b-b458-0be577bbb8d2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1d4a4141-7235-4a4b-b458-0be577bbb8d2" (UID: "1d4a4141-7235-4a4b-b458-0be577bbb8d2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:09:23.444883 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.444849    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d4a4141-7235-4a4b-b458-0be577bbb8d2-kube-api-access-4tbw7" (OuterVolumeSpecName: "kube-api-access-4tbw7") pod "1d4a4141-7235-4a4b-b458-0be577bbb8d2" (UID: "1d4a4141-7235-4a4b-b458-0be577bbb8d2"). InnerVolumeSpecName "kube-api-access-4tbw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:09:23.543589 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.543505    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tbw7\" (UniqueName: \"kubernetes.io/projected/1d4a4141-7235-4a4b-b458-0be577bbb8d2-kube-api-access-4tbw7\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:09:23.543589 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.543535    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d4a4141-7235-4a4b-b458-0be577bbb8d2-extensions-socket-volume\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:09:23.594585 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.594546    2564 generic.go:356] "Generic (PLEG): container finished" podID="1d4a4141-7235-4a4b-b458-0be577bbb8d2" containerID="8b2ff462f6cac00ea3011a8977039b3ac3dbbde690ef74ea694f839e4a118417" exitCode=0
Jul 17 05:09:23.594815 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.594605    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"
Jul 17 05:09:23.594815 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.594662    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn" event={"ID":"1d4a4141-7235-4a4b-b458-0be577bbb8d2","Type":"ContainerDied","Data":"8b2ff462f6cac00ea3011a8977039b3ac3dbbde690ef74ea694f839e4a118417"}
Jul 17 05:09:23.594815 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.594720    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn" event={"ID":"1d4a4141-7235-4a4b-b458-0be577bbb8d2","Type":"ContainerDied","Data":"2efa48714209da561021738c9031f8778dc4414bcc2e1845a0c92c61cec8321f"}
Jul 17 05:09:23.594815 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.594746    2564 scope.go:117] "RemoveContainer" containerID="8b2ff462f6cac00ea3011a8977039b3ac3dbbde690ef74ea694f839e4a118417"
Jul 17 05:09:23.606812 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.606790    2564 scope.go:117] "RemoveContainer" containerID="8b2ff462f6cac00ea3011a8977039b3ac3dbbde690ef74ea694f839e4a118417"
Jul 17 05:09:23.607138 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:09:23.607119    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b2ff462f6cac00ea3011a8977039b3ac3dbbde690ef74ea694f839e4a118417\": container with ID starting with 8b2ff462f6cac00ea3011a8977039b3ac3dbbde690ef74ea694f839e4a118417 not found: ID does not exist" containerID="8b2ff462f6cac00ea3011a8977039b3ac3dbbde690ef74ea694f839e4a118417"
Jul 17 05:09:23.607211 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.607153    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b2ff462f6cac00ea3011a8977039b3ac3dbbde690ef74ea694f839e4a118417"} err="failed to get container status \"8b2ff462f6cac00ea3011a8977039b3ac3dbbde690ef74ea694f839e4a118417\": rpc error: code = NotFound desc = could not find container \"8b2ff462f6cac00ea3011a8977039b3ac3dbbde690ef74ea694f839e4a118417\": container with ID starting with 8b2ff462f6cac00ea3011a8977039b3ac3dbbde690ef74ea694f839e4a118417 not found: ID does not exist"
Jul 17 05:09:23.616853 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.616825    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"]
Jul 17 05:09:23.621081 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.621056    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mppn"]
Jul 17 05:09:23.858662 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:23.858604    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d4a4141-7235-4a4b-b458-0be577bbb8d2" path="/var/lib/kubelet/pods/1d4a4141-7235-4a4b-b458-0be577bbb8d2/volumes"
Jul 17 05:09:25.886001 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:25.885976    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:09:25.886423 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:09:25.886067    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:10:19.964487 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:19.964383    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:10:20.055653 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:20.055596    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:10:21.626603 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:21.626557    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-28hw6"]
Jul 17 05:10:21.627072 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:21.627057    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d4a4141-7235-4a4b-b458-0be577bbb8d2" containerName="manager"
Jul 17 05:10:21.627116 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:21.627073    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d4a4141-7235-4a4b-b458-0be577bbb8d2" containerName="manager"
Jul 17 05:10:21.627176 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:21.627166    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d4a4141-7235-4a4b-b458-0be577bbb8d2" containerName="manager"
Jul 17 05:10:21.630447 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:21.630426    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-28hw6"
Jul 17 05:10:21.633146 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:21.633108    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dznhn\""
Jul 17 05:10:21.646263 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:21.646223    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-28hw6"]
Jul 17 05:10:21.787186 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:21.787145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6dg6\" (UniqueName: \"kubernetes.io/projected/72aee62a-7824-4d23-905e-fbbc59a9c2d6-kube-api-access-r6dg6\") pod \"kuadrant-operator-controller-manager-86878c769f-28hw6\" (UID: \"72aee62a-7824-4d23-905e-fbbc59a9c2d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-28hw6"
Jul 17 05:10:21.787395 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:21.787201    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72aee62a-7824-4d23-905e-fbbc59a9c2d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-28hw6\" (UID: \"72aee62a-7824-4d23-905e-fbbc59a9c2d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-28hw6"
Jul 17 05:10:21.888613 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:21.888513    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6dg6\" (UniqueName: \"kubernetes.io/projected/72aee62a-7824-4d23-905e-fbbc59a9c2d6-kube-api-access-r6dg6\") pod \"kuadrant-operator-controller-manager-86878c769f-28hw6\" (UID: \"72aee62a-7824-4d23-905e-fbbc59a9c2d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-28hw6"
Jul 17 05:10:21.888613 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:21.888570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72aee62a-7824-4d23-905e-fbbc59a9c2d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-28hw6\" (UID: \"72aee62a-7824-4d23-905e-fbbc59a9c2d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-28hw6"
Jul 17 05:10:21.888995 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:21.888973    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72aee62a-7824-4d23-905e-fbbc59a9c2d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-28hw6\" (UID: \"72aee62a-7824-4d23-905e-fbbc59a9c2d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-28hw6"
Jul 17 05:10:21.897403 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:21.897365    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6dg6\" (UniqueName: \"kubernetes.io/projected/72aee62a-7824-4d23-905e-fbbc59a9c2d6-kube-api-access-r6dg6\") pod \"kuadrant-operator-controller-manager-86878c769f-28hw6\" (UID: \"72aee62a-7824-4d23-905e-fbbc59a9c2d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-28hw6"
Jul 17 05:10:21.941936 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:21.941898    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-28hw6"
Jul 17 05:10:22.096120 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:22.096091    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-28hw6"]
Jul 17 05:10:22.097931 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:10:22.097901    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72aee62a_7824_4d23_905e_fbbc59a9c2d6.slice/crio-272f36e64383d027c3979a1e5e9e965fe65316739e5ec542a1e34b6f0e867e04 WatchSource:0}: Error finding container 272f36e64383d027c3979a1e5e9e965fe65316739e5ec542a1e34b6f0e867e04: Status 404 returned error can't find the container with id 272f36e64383d027c3979a1e5e9e965fe65316739e5ec542a1e34b6f0e867e04
Jul 17 05:10:22.942219 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:22.942181    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-28hw6" event={"ID":"72aee62a-7824-4d23-905e-fbbc59a9c2d6","Type":"ContainerStarted","Data":"573851ffaed52839fd0c0d30a90d44e9f8661bdcadba9f098e3f3f640ff860a8"}
Jul 17 05:10:22.942219 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:22.942237    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-28hw6" event={"ID":"72aee62a-7824-4d23-905e-fbbc59a9c2d6","Type":"ContainerStarted","Data":"272f36e64383d027c3979a1e5e9e965fe65316739e5ec542a1e34b6f0e867e04"}
Jul 17 05:10:22.942822 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:22.942404    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-28hw6"
Jul 17 05:10:22.963274 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:22.963217    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-28hw6" podStartSLOduration=1.9631999759999998 podStartE2EDuration="1.963199976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:10:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:10:22.960007125 +0000 UTC m=+1257.637613486" watchObservedRunningTime="2026-07-17 05:10:22.963199976 +0000 UTC m=+1257.640806401"
Jul 17 05:10:33.951464 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:33.951433    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-28hw6"
Jul 17 05:10:44.127877 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:44.127832    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:10:56.537356 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:10:56.537312    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:11:05.733496 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:11:05.733456    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:11:17.047690 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:11:17.047648    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:11:26.747086 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:11:26.747044    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:11:37.935978 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:11:37.935942    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:11:46.846813 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:11:46.846717    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:11:58.438564 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:11:58.438528    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:12:07.929443 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:12:07.929399    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:12:18.331546 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:12:18.331509    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:12:29.033079 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:12:29.032998    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:12:51.330129 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:12:51.330095    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:13:00.839895 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:13:00.839856    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:13:11.931745 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:13:11.931699    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:13:19.827817 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:13:19.827723    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:13:30.433780 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:13:30.433742    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:13:47.226874 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:13:47.226836    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:13:56.633551 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:13:56.633513    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:14:06.129512 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:14:06.129479    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:14:15.463806 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:14:15.463762    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:14:25.922810 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:14:25.922780    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:14:25.924498 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:14:25.924474    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:14:31.928350 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:14:31.928307    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:14:40.132797 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:14:40.132761    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:14:49.633086 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:14:49.633000    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:15:04.229003 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:15:04.228964    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:15:14.227046 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:15:14.227007    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:15:24.646049 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:15:24.646011    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:15:36.136945 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:15:36.136903    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:15:53.732512 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:15:53.732480    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:16:02.208995 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:02.208963    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:16:07.641161 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:07.641109    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:16:22.527202 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:22.527115    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:16:27.433243 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:27.433209    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:16:27.583181 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:27.583113    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:16:27.907370 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:27.907327    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:16:33.647997 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:33.647953    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:16:33.749547 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:33.749516    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:16:33.857838 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:33.857805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:16:33.954778 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:33.954653    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:16:35.048486 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:35.048448    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:16:35.147124 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:35.147092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:16:35.259601 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:35.259566    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:16:35.358800 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:35.358766    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:16:35.713260 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:35.713167    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:16:35.814218 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:35.814181    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:16:37.421829 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:37.421794    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:16:38.933029 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:16:38.932988    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:18:03.805534 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:18:03.805452    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:18:32.591207 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:18:32.591169    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:18:34.612420 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:18:34.612385    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:19:25.959490 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:25.959464    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:19:25.962903 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:25.962874    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:19:40.155175 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:40.155142    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:19:40.264967 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:40.264934    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:19:43.233053 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:43.233018    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:19:46.015566 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:46.015534    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:19:46.205112 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:46.205079    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:19:52.061835 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:52.061783    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:19:52.161956 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:52.161929    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:19:52.338485 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:52.338394    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:19:52.443936 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:52.443903    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:19:52.540047 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:52.539992    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:19:53.868343 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:53.868306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:19:54.143435 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:54.143349    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:19:54.272996 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:54.272961    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:19:54.588304 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:54.588269    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:19:54.695650 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:54.695596    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:19:57.033899 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:19:57.033857    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:20:01.604013 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:20:01.603982    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:20:01.704211 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:20:01.704172    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:20:11.650173 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:20:11.650132    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:20:11.750098 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:20:11.750062    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:20:15.303785 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:20:15.303751    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:20:16.229721 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:20:16.229691    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:20:16.309984 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:20:16.309952    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:20:58.458202 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:20:58.458107    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:20:58.563357 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:20:58.563330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:21:01.235108 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:21:01.235066    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:21:04.514227 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:21:04.514184    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:21:05.777277 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:21:05.777245    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:21:10.085127 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:21:10.085087    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:21:10.150009 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:21:10.149981    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:21:10.303474 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:21:10.303444    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:21:10.361588 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:21:10.361510    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:21:11.395342 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:21:11.395305    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:21:11.494225 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:21:11.494190    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:21:11.592997 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:21:11.592965    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:21:11.699766 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:21:11.699687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:21:12.164817 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:21:12.164781    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:21:12.265941 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:21:12.265903    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:21:13.937138 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:21:13.937111    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:21:14.130303 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:21:14.130267    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:23:57.064115 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:23:57.064010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:24:25.995946 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:24:25.995918    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:24:26.001730 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:24:26.001705    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:24:49.053203 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:24:49.053165    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:24:49.132839 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:24:49.132802    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:25:02.260276 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:25:02.260247    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:25:02.359148 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:25:02.359113    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:25:07.374589 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:25:07.374549    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:25:17.193229 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:25:17.193141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:25:17.294540 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:25:17.294506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:27:16.808039 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:16.807946    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:27:17.883594 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:17.883527    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:27:19.830714 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:19.830664    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:27:22.370768 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:22.370578    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:27:22.901235 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:22.901196    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:27:28.322530 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:28.322496    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:27:28.383811 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:28.383778    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:27:28.600221 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:28.600127    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:27:29.706102 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:29.706064    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:27:29.782152 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:29.782112    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:27:29.849766 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:29.849734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:27:30.298027 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:30.297967    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:27:30.399046 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:30.399017    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:27:30.500505 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:30.500471    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:27:33.432088 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:33.432045    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:27:43.221523 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:43.221490    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:27:43.322352 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:43.322315    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:27:46.870769 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:27:46.870725    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:29:26.033366 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:29:26.033337    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:29:26.048272 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:29:26.048229    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:30:03.192388 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:03.192332    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:03.358243 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:03.358193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:14.862214 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:14.862174    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:14.962847 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:14.962796    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:34.274844 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:34.274804    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:34.396608 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:34.396572    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:37.042370 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:37.042326    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:30:39.987218 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:39.987190    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:40.568063 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:40.568022    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:40.666685 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:40.666651    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:41.105514 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:41.105481    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:41.200723 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:41.200682    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:41.300637 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:41.300582    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:42.878638 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:42.878598    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:48.828307 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:48.828272    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:48.931478 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:48.931439    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:49.036067 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:49.036031    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:49.153363 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:49.153263    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:30:49.667912 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:30:49.667877    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:31:01.121111 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:31:01.121079    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:31:15.616510 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:31:15.616461    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:31:21.297970 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:31:21.297886    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:31:21.365706 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:31:21.365668    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:31:21.458401 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:31:21.458370    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:31:21.558549 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:31:21.558510    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:31:26.753416 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:31:26.753375    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:31:37.398859 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:31:37.398821    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:31:41.370400 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:31:41.370364    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:31:41.469974 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:31:41.469943    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:31:43.295986 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:31:43.295944    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:31:43.368724 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:31:43.368691    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:31:43.471765 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:31:43.471611    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:31:53.993344 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:31:53.993306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:31:54.778168 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:31:54.778128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:00.845639 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:00.845594    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:00.953803 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:00.953764    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:01.047356 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:01.047319    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:01.146165 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:01.146069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:01.968729 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:01.968696    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:02.077700 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:02.077656    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:02.189421 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:02.189373    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:03.779448 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:03.779406    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:04.512133 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:04.512093    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:32:09.561424 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:09.561384    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:09.626891 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:09.626855    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:10.243084 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:10.243033    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:14.540921 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:14.540877    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:32:16.032223 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:16.032185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:16.132872 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:16.132838    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:16.272124 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:16.272089    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:16.605153 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:16.605115    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:17.151030 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:17.150997    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:19.623498 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:19.623466    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:20.729048 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:20.729011    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:24.168253 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:24.168215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:24.839776 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:24.839739    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:24.941264 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:24.941228    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:25.314183 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:25.314151    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:25.795531 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:25.795442    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:32:31.156073 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:31.156038    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:31.257583 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:31.257543    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:42.037680 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:42.037619    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:45.330950 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:45.330914    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:32:46.601288 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:46.601248    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:52.467379 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:52.467338    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:52.535611 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:52.535572    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:57.291415 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:57.291380    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:57.539155 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:57.539119    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:57.744556 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:57.744526    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:57.886823 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:57.886790    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:32:57.964136 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:32:57.964100    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:03.575857 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:03.575820    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:03.650615 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:03.650570    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:03.735187 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:03.735152    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:03.930463 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:03.930374    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:10.139807 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:10.139767    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:10.264549 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:10.264512    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:16.997418 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:16.997375    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:17.241975 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:17.241933    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:17.370476 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:17.370440    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:19.826851 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:19.826806    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:20.026671 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:20.026638    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:20.119674 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:20.119539    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:20.538298 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:20.538192    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:20.672536 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:20.672500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:20.773347 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:20.773309    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:24.232592 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:24.232555    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:27.530594 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:27.530555    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:33:42.264970 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:42.264936    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:33:45.536900 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:33:45.536852    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:34:04.733666 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:04.733616    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:34:07.601325 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:07.601289    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk"]
Jul 17 05:34:07.605032 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:07.605010    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk"
Jul 17 05:34:07.608114 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:07.608082    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qh8zj\""
Jul 17 05:34:07.608114 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:07.608098    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 05:34:07.613471 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:07.613439    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk"]
Jul 17 05:34:07.760052 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:07.760012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dfebe5f-034f-4327-9069-c17581f632e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk\" (UID: \"5dfebe5f-034f-4327-9069-c17581f632e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk"
Jul 17 05:34:07.861495 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:07.861407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dfebe5f-034f-4327-9069-c17581f632e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk\" (UID: \"5dfebe5f-034f-4327-9069-c17581f632e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk"
Jul 17 05:34:07.862089 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:07.862067    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dfebe5f-034f-4327-9069-c17581f632e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk\" (UID: \"5dfebe5f-034f-4327-9069-c17581f632e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk"
Jul 17 05:34:07.917174 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:07.917136    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk"
Jul 17 05:34:08.066757 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:08.066729    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk"]
Jul 17 05:34:08.068618 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:34:08.068588    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dfebe5f_034f_4327_9069_c17581f632e4.slice/crio-3b125006537547d186c8c3f9a0c2e41c211c3168e8129f7bf8ab32633e620181 WatchSource:0}: Error finding container 3b125006537547d186c8c3f9a0c2e41c211c3168e8129f7bf8ab32633e620181: Status 404 returned error can't find the container with id 3b125006537547d186c8c3f9a0c2e41c211c3168e8129f7bf8ab32633e620181
Jul 17 05:34:08.070508 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:08.070485    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 05:34:08.196580 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:08.196491    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk" event={"ID":"5dfebe5f-034f-4327-9069-c17581f632e4","Type":"ContainerStarted","Data":"3b125006537547d186c8c3f9a0c2e41c211c3168e8129f7bf8ab32633e620181"}
Jul 17 05:34:10.935184 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:10.935138    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l"]
Jul 17 05:34:10.938794 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:10.938776    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l"
Jul 17 05:34:10.947085 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:10.947026    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l"]
Jul 17 05:34:11.092886 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:11.092850    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4fff9a-2feb-4fb3-ac18-c2abae3e9e75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4e221674-g6f9l\" (UID: \"be4fff9a-2feb-4fb3-ac18-c2abae3e9e75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l"
Jul 17 05:34:11.193473 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:11.193436    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4fff9a-2feb-4fb3-ac18-c2abae3e9e75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4e221674-g6f9l\" (UID: \"be4fff9a-2feb-4fb3-ac18-c2abae3e9e75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l"
Jul 17 05:34:11.194150 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:11.194125    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4fff9a-2feb-4fb3-ac18-c2abae3e9e75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4e221674-g6f9l\" (UID: \"be4fff9a-2feb-4fb3-ac18-c2abae3e9e75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l"
Jul 17 05:34:11.221398 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:11.221360    2564 generic.go:356] "Generic (PLEG): container finished" podID="5dfebe5f-034f-4327-9069-c17581f632e4" containerID="294e0122e8a87a183f2202a2436ddb08fcfb8131bf50cc485c45371088a9fda8" exitCode=0
Jul 17 05:34:11.221579 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:11.221444    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk" event={"ID":"5dfebe5f-034f-4327-9069-c17581f632e4","Type":"ContainerDied","Data":"294e0122e8a87a183f2202a2436ddb08fcfb8131bf50cc485c45371088a9fda8"}
Jul 17 05:34:11.250557 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:11.250526    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l"
Jul 17 05:34:11.396998 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:11.396967    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l"]
Jul 17 05:34:11.398529 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:34:11.398498    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4fff9a_2feb_4fb3_ac18_c2abae3e9e75.slice/crio-75dfd657150629c3f72812e1da07a1b678cb4e1e9c0006fa17b07718847d789b WatchSource:0}: Error finding container 75dfd657150629c3f72812e1da07a1b678cb4e1e9c0006fa17b07718847d789b: Status 404 returned error can't find the container with id 75dfd657150629c3f72812e1da07a1b678cb4e1e9c0006fa17b07718847d789b
Jul 17 05:34:12.228882 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:12.228816    2564 generic.go:356] "Generic (PLEG): container finished" podID="be4fff9a-2feb-4fb3-ac18-c2abae3e9e75" containerID="4d6d0f14586641f44b137e3453fcb9815a6e5da8d8f7414ce9c12052cd707041" exitCode=6
Jul 17 05:34:12.229280 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:12.228881    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l" event={"ID":"be4fff9a-2feb-4fb3-ac18-c2abae3e9e75","Type":"ContainerDied","Data":"4d6d0f14586641f44b137e3453fcb9815a6e5da8d8f7414ce9c12052cd707041"}
Jul 17 05:34:12.229280 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:12.228934    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l" event={"ID":"be4fff9a-2feb-4fb3-ac18-c2abae3e9e75","Type":"ContainerStarted","Data":"75dfd657150629c3f72812e1da07a1b678cb4e1e9c0006fa17b07718847d789b"}
Jul 17 05:34:12.229280 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:12.229165    2564 scope.go:117] "RemoveContainer" containerID="4d6d0f14586641f44b137e3453fcb9815a6e5da8d8f7414ce9c12052cd707041"
Jul 17 05:34:12.369779 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:12.369707    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk"
Jul 17 05:34:12.506779 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:12.506746    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dfebe5f-034f-4327-9069-c17581f632e4-maas-api-service-ca\") pod \"5dfebe5f-034f-4327-9069-c17581f632e4\" (UID: \"5dfebe5f-034f-4327-9069-c17581f632e4\") "
Jul 17 05:34:12.507102 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:12.507076    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dfebe5f-034f-4327-9069-c17581f632e4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5dfebe5f-034f-4327-9069-c17581f632e4" (UID: "5dfebe5f-034f-4327-9069-c17581f632e4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:34:12.608260 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:12.608227    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dfebe5f-034f-4327-9069-c17581f632e4-maas-api-service-ca\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:34:13.236899 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:13.236799    2564 generic.go:356] "Generic (PLEG): container finished" podID="be4fff9a-2feb-4fb3-ac18-c2abae3e9e75" containerID="bc7af647bb905fbe23667b5caefc4a6427469a8b7e75290c3db551a8628a39bc" exitCode=6
Jul 17 05:34:13.236899 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:13.236875    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l" event={"ID":"be4fff9a-2feb-4fb3-ac18-c2abae3e9e75","Type":"ContainerDied","Data":"bc7af647bb905fbe23667b5caefc4a6427469a8b7e75290c3db551a8628a39bc"}
Jul 17 05:34:13.237419 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:13.236935    2564 scope.go:117] "RemoveContainer" containerID="4d6d0f14586641f44b137e3453fcb9815a6e5da8d8f7414ce9c12052cd707041"
Jul 17 05:34:13.237419 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:13.237128    2564 scope.go:117] "RemoveContainer" containerID="bc7af647bb905fbe23667b5caefc4a6427469a8b7e75290c3db551a8628a39bc"
Jul 17 05:34:13.237519 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:34:13.237419    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4e221674-g6f9l_odh-ai-gateway-infra(be4fff9a-2feb-4fb3-ac18-c2abae3e9e75)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l" podUID="be4fff9a-2feb-4fb3-ac18-c2abae3e9e75"
Jul 17 05:34:13.238318 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:13.238302    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk"
Jul 17 05:34:13.238400 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:13.238299    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk" event={"ID":"5dfebe5f-034f-4327-9069-c17581f632e4","Type":"ContainerDied","Data":"3b125006537547d186c8c3f9a0c2e41c211c3168e8129f7bf8ab32633e620181"}
Jul 17 05:34:13.238461 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:13.238423    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b125006537547d186c8c3f9a0c2e41c211c3168e8129f7bf8ab32633e620181"
Jul 17 05:34:14.245273 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:14.245240    2564 scope.go:117] "RemoveContainer" containerID="bc7af647bb905fbe23667b5caefc4a6427469a8b7e75290c3db551a8628a39bc"
Jul 17 05:34:14.245695 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:34:14.245443    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4e221674-g6f9l_odh-ai-gateway-infra(be4fff9a-2feb-4fb3-ac18-c2abae3e9e75)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l" podUID="be4fff9a-2feb-4fb3-ac18-c2abae3e9e75"
Jul 17 05:34:18.116789 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:18.116685    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:34:21.638198 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:21.638164    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:34:22.695252 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:22.695175    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:34:25.859110 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:25.859076    2564 scope.go:117] "RemoveContainer" containerID="bc7af647bb905fbe23667b5caefc4a6427469a8b7e75290c3db551a8628a39bc"
Jul 17 05:34:26.082129 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:26.082102    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:34:26.089985 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:26.089959    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:34:26.323299 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:26.323261    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l" event={"ID":"be4fff9a-2feb-4fb3-ac18-c2abae3e9e75","Type":"ContainerStarted","Data":"d3b12f310dd2080000276b2c222086ed57654beb0796b9ae9579db723356e42a"}
Jul 17 05:34:26.339948 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:26.339886    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l" podStartSLOduration=16.339863731 podStartE2EDuration="16.339863731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:34:26.339299794 +0000 UTC m=+2701.016906140" watchObservedRunningTime="2026-07-17 05:34:26.339863731 +0000 UTC m=+2701.017470078"
Jul 17 05:34:27.331410 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:27.331376    2564 generic.go:356] "Generic (PLEG): container finished" podID="be4fff9a-2feb-4fb3-ac18-c2abae3e9e75" containerID="d3b12f310dd2080000276b2c222086ed57654beb0796b9ae9579db723356e42a" exitCode=6
Jul 17 05:34:27.331891 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:27.331453    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l" event={"ID":"be4fff9a-2feb-4fb3-ac18-c2abae3e9e75","Type":"ContainerDied","Data":"d3b12f310dd2080000276b2c222086ed57654beb0796b9ae9579db723356e42a"}
Jul 17 05:34:27.331891 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:27.331523    2564 scope.go:117] "RemoveContainer" containerID="bc7af647bb905fbe23667b5caefc4a6427469a8b7e75290c3db551a8628a39bc"
Jul 17 05:34:27.332004 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:27.331910    2564 scope.go:117] "RemoveContainer" containerID="d3b12f310dd2080000276b2c222086ed57654beb0796b9ae9579db723356e42a"
Jul 17 05:34:27.332169 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:34:27.332147    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4e221674-g6f9l_odh-ai-gateway-infra(be4fff9a-2feb-4fb3-ac18-c2abae3e9e75)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l" podUID="be4fff9a-2feb-4fb3-ac18-c2abae3e9e75"
Jul 17 05:34:27.349692 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:27.349656    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l"]
Jul 17 05:34:27.746491 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:27.746401    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:34:28.482385 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:28.482357    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l"
Jul 17 05:34:28.555860 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:28.555826    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4fff9a-2feb-4fb3-ac18-c2abae3e9e75-maas-api-service-ca\") pod \"be4fff9a-2feb-4fb3-ac18-c2abae3e9e75\" (UID: \"be4fff9a-2feb-4fb3-ac18-c2abae3e9e75\") "
Jul 17 05:34:28.556202 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:28.556180    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be4fff9a-2feb-4fb3-ac18-c2abae3e9e75-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "be4fff9a-2feb-4fb3-ac18-c2abae3e9e75" (UID: "be4fff9a-2feb-4fb3-ac18-c2abae3e9e75"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:34:28.656581 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:28.656487    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4fff9a-2feb-4fb3-ac18-c2abae3e9e75-maas-api-service-ca\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:34:29.345758 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:29.345720    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l" event={"ID":"be4fff9a-2feb-4fb3-ac18-c2abae3e9e75","Type":"ContainerDied","Data":"75dfd657150629c3f72812e1da07a1b678cb4e1e9c0006fa17b07718847d789b"}
Jul 17 05:34:29.345939 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:29.345809    2564 scope.go:117] "RemoveContainer" containerID="d3b12f310dd2080000276b2c222086ed57654beb0796b9ae9579db723356e42a"
Jul 17 05:34:29.345939 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:29.345731    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l"
Jul 17 05:34:29.371727 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:29.371693    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l"]
Jul 17 05:34:29.379205 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:29.379177    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-g6f9l"]
Jul 17 05:34:29.858560 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:29.858516    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be4fff9a-2feb-4fb3-ac18-c2abae3e9e75" path="/var/lib/kubelet/pods/be4fff9a-2feb-4fb3-ac18-c2abae3e9e75/volumes"
Jul 17 05:34:34.528896 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:34.528862    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:34:34.630037 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:34.630005    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:34:39.099828 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.099788    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq"]
Jul 17 05:34:39.100280 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.100190    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dfebe5f-034f-4327-9069-c17581f632e4" containerName="revoke-keys"
Jul 17 05:34:39.100280 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.100200    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dfebe5f-034f-4327-9069-c17581f632e4" containerName="revoke-keys"
Jul 17 05:34:39.100280 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.100218    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4fff9a-2feb-4fb3-ac18-c2abae3e9e75" containerName="revoke-keys"
Jul 17 05:34:39.100280 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.100223    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4fff9a-2feb-4fb3-ac18-c2abae3e9e75" containerName="revoke-keys"
Jul 17 05:34:39.100280 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.100230    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4fff9a-2feb-4fb3-ac18-c2abae3e9e75" containerName="revoke-keys"
Jul 17 05:34:39.100280 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.100236    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4fff9a-2feb-4fb3-ac18-c2abae3e9e75" containerName="revoke-keys"
Jul 17 05:34:39.100280 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.100244    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4fff9a-2feb-4fb3-ac18-c2abae3e9e75" containerName="revoke-keys"
Jul 17 05:34:39.100280 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.100248    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4fff9a-2feb-4fb3-ac18-c2abae3e9e75" containerName="revoke-keys"
Jul 17 05:34:39.100547 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.100322    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="be4fff9a-2feb-4fb3-ac18-c2abae3e9e75" containerName="revoke-keys"
Jul 17 05:34:39.100547 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.100330    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="be4fff9a-2feb-4fb3-ac18-c2abae3e9e75" containerName="revoke-keys"
Jul 17 05:34:39.100547 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.100334    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="be4fff9a-2feb-4fb3-ac18-c2abae3e9e75" containerName="revoke-keys"
Jul 17 05:34:39.100547 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.100342    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dfebe5f-034f-4327-9069-c17581f632e4" containerName="revoke-keys"
Jul 17 05:34:39.103565 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.103542    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq"
Jul 17 05:34:39.106382 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.106353    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qh8zj\""
Jul 17 05:34:39.106507 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.106353    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 05:34:39.112205 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.112175    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq"]
Jul 17 05:34:39.156610 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.156562    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04528b8e-7c62-4290-a29b-4a25fbaee7ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq\" (UID: \"04528b8e-7c62-4290-a29b-4a25fbaee7ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq"
Jul 17 05:34:39.258046 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.258003    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04528b8e-7c62-4290-a29b-4a25fbaee7ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq\" (UID: \"04528b8e-7c62-4290-a29b-4a25fbaee7ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq"
Jul 17 05:34:39.258715 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.258696    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04528b8e-7c62-4290-a29b-4a25fbaee7ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq\" (UID: \"04528b8e-7c62-4290-a29b-4a25fbaee7ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq"
Jul 17 05:34:39.416288 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.416196    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq"
Jul 17 05:34:39.562320 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:39.562292    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq"]
Jul 17 05:34:39.563934 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:34:39.563910    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04528b8e_7c62_4290_a29b_4a25fbaee7ea.slice/crio-43b83fc6c703c20ccc2f2764a71d25cdbdc46225b4768091b402b6dcf15c8b1d WatchSource:0}: Error finding container 43b83fc6c703c20ccc2f2764a71d25cdbdc46225b4768091b402b6dcf15c8b1d: Status 404 returned error can't find the container with id 43b83fc6c703c20ccc2f2764a71d25cdbdc46225b4768091b402b6dcf15c8b1d
Jul 17 05:34:40.411261 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:40.411229    2564 generic.go:356] "Generic (PLEG): container finished" podID="04528b8e-7c62-4290-a29b-4a25fbaee7ea" containerID="0b0b992e1cea107ac15c5c668498c2e38a15514d66ed4d592ed2210a17a05ada" exitCode=6
Jul 17 05:34:40.411704 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:40.411319    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq" event={"ID":"04528b8e-7c62-4290-a29b-4a25fbaee7ea","Type":"ContainerDied","Data":"0b0b992e1cea107ac15c5c668498c2e38a15514d66ed4d592ed2210a17a05ada"}
Jul 17 05:34:40.411704 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:40.411383    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq" event={"ID":"04528b8e-7c62-4290-a29b-4a25fbaee7ea","Type":"ContainerStarted","Data":"43b83fc6c703c20ccc2f2764a71d25cdbdc46225b4768091b402b6dcf15c8b1d"}
Jul 17 05:34:40.411704 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:40.411494    2564 scope.go:117] "RemoveContainer" containerID="0b0b992e1cea107ac15c5c668498c2e38a15514d66ed4d592ed2210a17a05ada"
Jul 17 05:34:41.419116 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:41.419075    2564 generic.go:356] "Generic (PLEG): container finished" podID="04528b8e-7c62-4290-a29b-4a25fbaee7ea" containerID="ba4367f498c94bc72eef77a5f3359f34d59bd3fe88bc976960e37b23cf8e7979" exitCode=6
Jul 17 05:34:41.419547 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:41.419160    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq" event={"ID":"04528b8e-7c62-4290-a29b-4a25fbaee7ea","Type":"ContainerDied","Data":"ba4367f498c94bc72eef77a5f3359f34d59bd3fe88bc976960e37b23cf8e7979"}
Jul 17 05:34:41.419547 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:41.419252    2564 scope.go:117] "RemoveContainer" containerID="0b0b992e1cea107ac15c5c668498c2e38a15514d66ed4d592ed2210a17a05ada"
Jul 17 05:34:41.419547 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:41.419487    2564 scope.go:117] "RemoveContainer" containerID="ba4367f498c94bc72eef77a5f3359f34d59bd3fe88bc976960e37b23cf8e7979"
Jul 17 05:34:41.419779 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:34:41.419761    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq_odh-ai-gateway-infra(04528b8e-7c62-4290-a29b-4a25fbaee7ea)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq" podUID="04528b8e-7c62-4290-a29b-4a25fbaee7ea"
Jul 17 05:34:42.391587 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:42.391548    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:34:42.428726 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:42.428693    2564 scope.go:117] "RemoveContainer" containerID="ba4367f498c94bc72eef77a5f3359f34d59bd3fe88bc976960e37b23cf8e7979"
Jul 17 05:34:42.429129 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:34:42.428993    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq_odh-ai-gateway-infra(04528b8e-7c62-4290-a29b-4a25fbaee7ea)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq" podUID="04528b8e-7c62-4290-a29b-4a25fbaee7ea"
Jul 17 05:34:55.854045 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:55.854017    2564 scope.go:117] "RemoveContainer" containerID="ba4367f498c94bc72eef77a5f3359f34d59bd3fe88bc976960e37b23cf8e7979"
Jul 17 05:34:56.514019 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:56.513987    2564 generic.go:356] "Generic (PLEG): container finished" podID="04528b8e-7c62-4290-a29b-4a25fbaee7ea" containerID="d4c4a2e79c578c977b7ed94fc23aaf9be8ed73bfa5e2029f669becd91db4e133" exitCode=6
Jul 17 05:34:56.514195 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:56.514057    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq" event={"ID":"04528b8e-7c62-4290-a29b-4a25fbaee7ea","Type":"ContainerDied","Data":"d4c4a2e79c578c977b7ed94fc23aaf9be8ed73bfa5e2029f669becd91db4e133"}
Jul 17 05:34:56.514195 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:56.514121    2564 scope.go:117] "RemoveContainer" containerID="ba4367f498c94bc72eef77a5f3359f34d59bd3fe88bc976960e37b23cf8e7979"
Jul 17 05:34:56.514459 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:56.514440    2564 scope.go:117] "RemoveContainer" containerID="d4c4a2e79c578c977b7ed94fc23aaf9be8ed73bfa5e2029f669becd91db4e133"
Jul 17 05:34:56.514695 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:34:56.514677    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq_odh-ai-gateway-infra(04528b8e-7c62-4290-a29b-4a25fbaee7ea)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq" podUID="04528b8e-7c62-4290-a29b-4a25fbaee7ea"
Jul 17 05:34:57.546302 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:57.546246    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq"]
Jul 17 05:34:57.700481 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:57.700444    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq"
Jul 17 05:34:57.737020 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:57.736979    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04528b8e-7c62-4290-a29b-4a25fbaee7ea-maas-api-service-ca\") pod \"04528b8e-7c62-4290-a29b-4a25fbaee7ea\" (UID: \"04528b8e-7c62-4290-a29b-4a25fbaee7ea\") "
Jul 17 05:34:57.737370 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:57.737345    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04528b8e-7c62-4290-a29b-4a25fbaee7ea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "04528b8e-7c62-4290-a29b-4a25fbaee7ea" (UID: "04528b8e-7c62-4290-a29b-4a25fbaee7ea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:34:57.838332 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:57.838278    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04528b8e-7c62-4290-a29b-4a25fbaee7ea-maas-api-service-ca\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:34:58.529453 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:58.529414    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq" event={"ID":"04528b8e-7c62-4290-a29b-4a25fbaee7ea","Type":"ContainerDied","Data":"43b83fc6c703c20ccc2f2764a71d25cdbdc46225b4768091b402b6dcf15c8b1d"}
Jul 17 05:34:58.529453 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:58.529442    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq"
Jul 17 05:34:58.529751 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:58.529480    2564 scope.go:117] "RemoveContainer" containerID="d4c4a2e79c578c977b7ed94fc23aaf9be8ed73bfa5e2029f669becd91db4e133"
Jul 17 05:34:58.547670 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:58.547639    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq"]
Jul 17 05:34:58.555093 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:58.555065    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8a383ce-qz2hq"]
Jul 17 05:34:59.858160 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:34:59.858123    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04528b8e-7c62-4290-a29b-4a25fbaee7ea" path="/var/lib/kubelet/pods/04528b8e-7c62-4290-a29b-4a25fbaee7ea/volumes"
Jul 17 05:35:04.026779 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:04.026739    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:04.124614 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:04.124575    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:04.559162 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:04.559112    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:05.055426 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:05.055336    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:10.647842 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:10.647803    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:10.714665 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:10.714612    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:15.039226 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:15.039194    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:15.278795 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:15.278761    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:16.371739 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:16.371691    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:16.472511 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:16.472475    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:16.570928 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:16.570885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:17.356862 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:17.356832    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:17.454177 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:17.454141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:17.565482 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:17.565450    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:19.012299 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:19.012260    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:19.534652 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:19.534590    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:35:25.205729 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:25.205683    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:25.272644 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:25.272590    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:25.898004 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:25.897948    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:31.738255 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:31.738217    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:31.846603 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:31.846562    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:31.938653 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:31.938599    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:34.134435 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:34.134390    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:35:42.469475 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:42.469426    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:35:42.813346 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:35:42.813311    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:03.803457 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:03.803363    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:09.866863 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:09.866821    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:09.967380 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:09.967339    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:10.245138 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:10.245048    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:10.624402 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:10.624357    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:10.864064 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:10.864034    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:13.789383 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:13.789342    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:13.877840 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:13.877796    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:13.960055 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:13.960022    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:14.261510 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:14.261468    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:14.564740 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:14.564708    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:14.665420 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:14.665385    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:18.336977 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:18.336938    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:18.738987 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:18.738889    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:19.029620 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:19.029538    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:19.231885 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:19.231846    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:21.841963 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:21.841918    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:21.954539 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:21.954487    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:36:21.961943 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:21.961899    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:22.042314 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:22.042265    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:22.265382 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:22.265278    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:22.639363 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:22.639322    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:22.733261 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:22.733229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:26.368265 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:26.368229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:33.263180 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:33.263142    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:33.348906 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:33.348871    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:36:34.630837 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.630804    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz"]
Jul 17 05:36:34.631236 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.631207    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04528b8e-7c62-4290-a29b-4a25fbaee7ea" containerName="revoke-keys"
Jul 17 05:36:34.631236 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.631217    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="04528b8e-7c62-4290-a29b-4a25fbaee7ea" containerName="revoke-keys"
Jul 17 05:36:34.631236 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.631232    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04528b8e-7c62-4290-a29b-4a25fbaee7ea" containerName="revoke-keys"
Jul 17 05:36:34.631354 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.631237    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="04528b8e-7c62-4290-a29b-4a25fbaee7ea" containerName="revoke-keys"
Jul 17 05:36:34.631354 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.631245    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04528b8e-7c62-4290-a29b-4a25fbaee7ea" containerName="revoke-keys"
Jul 17 05:36:34.631354 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.631252    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="04528b8e-7c62-4290-a29b-4a25fbaee7ea" containerName="revoke-keys"
Jul 17 05:36:34.631354 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.631332    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="04528b8e-7c62-4290-a29b-4a25fbaee7ea" containerName="revoke-keys"
Jul 17 05:36:34.631354 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.631341    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="04528b8e-7c62-4290-a29b-4a25fbaee7ea" containerName="revoke-keys"
Jul 17 05:36:34.634379 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.634361    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz"
Jul 17 05:36:34.636936 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.636910    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 05:36:34.637023 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.636995    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qh8zj\""
Jul 17 05:36:34.639505 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.639481    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8da08b26-a08e-4e98-b2e4-6ebffe8da946-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz\" (UID: \"8da08b26-a08e-4e98-b2e4-6ebffe8da946\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz"
Jul 17 05:36:34.642902 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.642792    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz"]
Jul 17 05:36:34.740766 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.740731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8da08b26-a08e-4e98-b2e4-6ebffe8da946-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz\" (UID: \"8da08b26-a08e-4e98-b2e4-6ebffe8da946\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz"
Jul 17 05:36:34.741393 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.741363    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8da08b26-a08e-4e98-b2e4-6ebffe8da946-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz\" (UID: \"8da08b26-a08e-4e98-b2e4-6ebffe8da946\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz"
Jul 17 05:36:34.948694 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:34.948565    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz"
Jul 17 05:36:35.092280 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:35.092252    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz"]
Jul 17 05:36:35.093879 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:36:35.093853    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da08b26_a08e_4e98_b2e4_6ebffe8da946.slice/crio-6456ef6e0bd6856da5a93e71cd5d751e492f189328b429d4fd41faf48a2167eb WatchSource:0}: Error finding container 6456ef6e0bd6856da5a93e71cd5d751e492f189328b429d4fd41faf48a2167eb: Status 404 returned error can't find the container with id 6456ef6e0bd6856da5a93e71cd5d751e492f189328b429d4fd41faf48a2167eb
Jul 17 05:36:35.499174 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:35.499133    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:35.599183 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:35.599141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:36.103378 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:36.103345    2564 generic.go:356] "Generic (PLEG): container finished" podID="8da08b26-a08e-4e98-b2e4-6ebffe8da946" containerID="44e7f368bd5963a7c16a146414b95a52c8813294e4ebca3dbe1e543c7074a8e7" exitCode=6
Jul 17 05:36:36.103905 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:36.103387    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz" event={"ID":"8da08b26-a08e-4e98-b2e4-6ebffe8da946","Type":"ContainerDied","Data":"44e7f368bd5963a7c16a146414b95a52c8813294e4ebca3dbe1e543c7074a8e7"}
Jul 17 05:36:36.103905 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:36.103438    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz" event={"ID":"8da08b26-a08e-4e98-b2e4-6ebffe8da946","Type":"ContainerStarted","Data":"6456ef6e0bd6856da5a93e71cd5d751e492f189328b429d4fd41faf48a2167eb"}
Jul 17 05:36:36.103905 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:36.103621    2564 scope.go:117] "RemoveContainer" containerID="44e7f368bd5963a7c16a146414b95a52c8813294e4ebca3dbe1e543c7074a8e7"
Jul 17 05:36:37.111092 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:37.111056    2564 generic.go:356] "Generic (PLEG): container finished" podID="8da08b26-a08e-4e98-b2e4-6ebffe8da946" containerID="0e2d4034ec046c8804981b7e990b448f8852b5629122f021e9a64b6b8cc91e14" exitCode=6
Jul 17 05:36:37.111501 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:37.111140    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz" event={"ID":"8da08b26-a08e-4e98-b2e4-6ebffe8da946","Type":"ContainerDied","Data":"0e2d4034ec046c8804981b7e990b448f8852b5629122f021e9a64b6b8cc91e14"}
Jul 17 05:36:37.111501 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:37.111195    2564 scope.go:117] "RemoveContainer" containerID="44e7f368bd5963a7c16a146414b95a52c8813294e4ebca3dbe1e543c7074a8e7"
Jul 17 05:36:37.111501 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:37.111398    2564 scope.go:117] "RemoveContainer" containerID="0e2d4034ec046c8804981b7e990b448f8852b5629122f021e9a64b6b8cc91e14"
Jul 17 05:36:37.111701 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:36:37.111665    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz_odh-ai-gateway-infra(8da08b26-a08e-4e98-b2e4-6ebffe8da946)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz" podUID="8da08b26-a08e-4e98-b2e4-6ebffe8da946"
Jul 17 05:36:38.118561 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:38.118536    2564 scope.go:117] "RemoveContainer" containerID="0e2d4034ec046c8804981b7e990b448f8852b5629122f021e9a64b6b8cc91e14"
Jul 17 05:36:38.118955 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:36:38.118733    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz_odh-ai-gateway-infra(8da08b26-a08e-4e98-b2e4-6ebffe8da946)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz" podUID="8da08b26-a08e-4e98-b2e4-6ebffe8da946"
Jul 17 05:36:43.234519 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:43.234483    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:36:43.670570 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:43.670510    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:43.771286 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:43.771206    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:45.694972 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:45.694932    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:36:51.851436 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:51.851406    2564 scope.go:117] "RemoveContainer" containerID="0e2d4034ec046c8804981b7e990b448f8852b5629122f021e9a64b6b8cc91e14"
Jul 17 05:36:52.202574 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:52.202543    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz" event={"ID":"8da08b26-a08e-4e98-b2e4-6ebffe8da946","Type":"ContainerStarted","Data":"7b1627fbfb65d3401709d530ad06fdaac1547070d00ab23ff82f3860dc31589f"}
Jul 17 05:36:52.219923 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:52.219875    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz" podStartSLOduration=18.219860114 podStartE2EDuration="18.219860114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:36:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:36:52.218978444 +0000 UTC m=+2846.896584796" watchObservedRunningTime="2026-07-17 05:36:52.219860114 +0000 UTC m=+2846.897466459"
Jul 17 05:36:53.209687 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:53.209644    2564 generic.go:356] "Generic (PLEG): container finished" podID="8da08b26-a08e-4e98-b2e4-6ebffe8da946" containerID="7b1627fbfb65d3401709d530ad06fdaac1547070d00ab23ff82f3860dc31589f" exitCode=6
Jul 17 05:36:53.210129 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:53.209703    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz" event={"ID":"8da08b26-a08e-4e98-b2e4-6ebffe8da946","Type":"ContainerDied","Data":"7b1627fbfb65d3401709d530ad06fdaac1547070d00ab23ff82f3860dc31589f"}
Jul 17 05:36:53.210129 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:53.209791    2564 scope.go:117] "RemoveContainer" containerID="0e2d4034ec046c8804981b7e990b448f8852b5629122f021e9a64b6b8cc91e14"
Jul 17 05:36:53.210129 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:53.210027    2564 scope.go:117] "RemoveContainer" containerID="7b1627fbfb65d3401709d530ad06fdaac1547070d00ab23ff82f3860dc31589f"
Jul 17 05:36:53.210269 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:36:53.210251    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz_odh-ai-gateway-infra(8da08b26-a08e-4e98-b2e4-6ebffe8da946)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz" podUID="8da08b26-a08e-4e98-b2e4-6ebffe8da946"
Jul 17 05:36:53.231987 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:53.231948    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz"]
Jul 17 05:36:54.365175 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:54.365151    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz"
Jul 17 05:36:54.428951 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:54.428915    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8da08b26-a08e-4e98-b2e4-6ebffe8da946-maas-api-service-ca\") pod \"8da08b26-a08e-4e98-b2e4-6ebffe8da946\" (UID: \"8da08b26-a08e-4e98-b2e4-6ebffe8da946\") "
Jul 17 05:36:54.429279 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:54.429256    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8da08b26-a08e-4e98-b2e4-6ebffe8da946-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8da08b26-a08e-4e98-b2e4-6ebffe8da946" (UID: "8da08b26-a08e-4e98-b2e4-6ebffe8da946"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:36:54.530351 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:54.530260    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8da08b26-a08e-4e98-b2e4-6ebffe8da946-maas-api-service-ca\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:36:55.224500 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:55.224466    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz"
Jul 17 05:36:55.224722 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:55.224496    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz" event={"ID":"8da08b26-a08e-4e98-b2e4-6ebffe8da946","Type":"ContainerDied","Data":"6456ef6e0bd6856da5a93e71cd5d751e492f189328b429d4fd41faf48a2167eb"}
Jul 17 05:36:55.224722 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:55.224562    2564 scope.go:117] "RemoveContainer" containerID="7b1627fbfb65d3401709d530ad06fdaac1547070d00ab23ff82f3860dc31589f"
Jul 17 05:36:55.249308 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:55.249267    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz"]
Jul 17 05:36:55.255738 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:55.255706    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-2kqvz"]
Jul 17 05:36:55.857556 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:36:55.857523    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8da08b26-a08e-4e98-b2e4-6ebffe8da946" path="/var/lib/kubelet/pods/8da08b26-a08e-4e98-b2e4-6ebffe8da946/volumes"
Jul 17 05:37:03.534845 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.534809    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"]
Jul 17 05:37:03.535321 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.535304    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8da08b26-a08e-4e98-b2e4-6ebffe8da946" containerName="revoke-keys"
Jul 17 05:37:03.535368 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.535323    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8da08b26-a08e-4e98-b2e4-6ebffe8da946" containerName="revoke-keys"
Jul 17 05:37:03.535368 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.535336    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8da08b26-a08e-4e98-b2e4-6ebffe8da946" containerName="revoke-keys"
Jul 17 05:37:03.535368 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.535342    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8da08b26-a08e-4e98-b2e4-6ebffe8da946" containerName="revoke-keys"
Jul 17 05:37:03.535463 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.535439    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8da08b26-a08e-4e98-b2e4-6ebffe8da946" containerName="revoke-keys"
Jul 17 05:37:03.535463 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.535454    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8da08b26-a08e-4e98-b2e4-6ebffe8da946" containerName="revoke-keys"
Jul 17 05:37:03.535546 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.535467    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="04528b8e-7c62-4290-a29b-4a25fbaee7ea" containerName="revoke-keys"
Jul 17 05:37:03.535546 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.535482    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8da08b26-a08e-4e98-b2e4-6ebffe8da946" containerName="revoke-keys"
Jul 17 05:37:03.540340 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.540322    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.543063 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.543039    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-63fb52\"/\"openshift-service-ca.crt\""
Jul 17 05:37:03.544048 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.544022    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-63fb52\"/\"test-model-63fb52-kserve-self-signed-certs\""
Jul 17 05:37:03.544152 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.544059    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-63fb52\"/\"default-dockercfg-b95wm\""
Jul 17 05:37:03.544152 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.544126    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-63fb52\"/\"kube-root-ca.crt\""
Jul 17 05:37:03.552397 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.552369    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"]
Jul 17 05:37:03.560715 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.560687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:37:03.615716 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.615681    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-tmp-dir\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.615923 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.615730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-dshm\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.615923 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.615758    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24a06942-9095-4901-b35a-3c9d2fed9ba8-tls-certs\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.615923 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.615851    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pkq9\" (UniqueName: \"kubernetes.io/projected/24a06942-9095-4901-b35a-3c9d2fed9ba8-kube-api-access-9pkq9\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.615923 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.615896    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-home\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.615923 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.615913    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-model-cache\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.716577 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.716544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pkq9\" (UniqueName: \"kubernetes.io/projected/24a06942-9095-4901-b35a-3c9d2fed9ba8-kube-api-access-9pkq9\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.716778 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.716592    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-home\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.716778 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.716616    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-model-cache\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.716778 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.716706    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-tmp-dir\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.716778 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.716750    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-dshm\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.716981 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.716783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24a06942-9095-4901-b35a-3c9d2fed9ba8-tls-certs\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.717042 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.717010    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-home\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.717042 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.717028    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-model-cache\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.717148 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.717116    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-tmp-dir\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.719142 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.719113    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-dshm\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.719261 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.719247    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24a06942-9095-4901-b35a-3c9d2fed9ba8-tls-certs\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.725379 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.725354    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pkq9\" (UniqueName: \"kubernetes.io/projected/24a06942-9095-4901-b35a-3c9d2fed9ba8-kube-api-access-9pkq9\") pod \"test-model-63fb52-kserve-5dc796cfb9-tb6mf\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") " pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:03.852840 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:03.852806    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:04.012261 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:04.012232    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"]
Jul 17 05:37:04.014185 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:37:04.014154    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24a06942_9095_4901_b35a_3c9d2fed9ba8.slice/crio-62b4e32c3ce6e983923420e06a04b6dbb57e8d43d82380bf8f8d4b82302e2f08 WatchSource:0}: Error finding container 62b4e32c3ce6e983923420e06a04b6dbb57e8d43d82380bf8f8d4b82302e2f08: Status 404 returned error can't find the container with id 62b4e32c3ce6e983923420e06a04b6dbb57e8d43d82380bf8f8d4b82302e2f08
Jul 17 05:37:04.288591 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:04.288510    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf" event={"ID":"24a06942-9095-4901-b35a-3c9d2fed9ba8","Type":"ContainerStarted","Data":"66a506b73c796ecf9ba35734a56f251052ac8383dd06c32c1c7bc76559a4889d"}
Jul 17 05:37:04.288591 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:04.288552    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf" event={"ID":"24a06942-9095-4901-b35a-3c9d2fed9ba8","Type":"ContainerStarted","Data":"62b4e32c3ce6e983923420e06a04b6dbb57e8d43d82380bf8f8d4b82302e2f08"}
Jul 17 05:37:04.308434 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:04.308381    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf" podStartSLOduration=1.308363701 podStartE2EDuration="1.308363701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:37:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:37:04.307086971 +0000 UTC m=+2858.984693317" watchObservedRunningTime="2026-07-17 05:37:04.308363701 +0000 UTC m=+2858.985970083"
Jul 17 05:37:07.744537 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:07.744497    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:37:13.859518 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:13.859479    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:13.860029 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:13.859530    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:13.867544 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:13.867521    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:14.361908 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:14.361876    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:22.331866 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:22.331780    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:37:25.083001 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:25.082943    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:37:25.958896 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:25.958862    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"]
Jul 17 05:37:26.186003 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:26.185965    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:37:26.694149 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:26.694110    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:37:26.789308 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:26.789280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:37:35.334487 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:35.334443    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:37:36.700181 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:36.700134    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:37:40.981322 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:40.981268    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf" podUID="24a06942-9095-4901-b35a-3c9d2fed9ba8" containerName="main" containerID="cri-o://66a506b73c796ecf9ba35734a56f251052ac8383dd06c32c1c7bc76559a4889d" gracePeriod=45
Jul 17 05:37:41.188406 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.188373    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:37:41.247351 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.247289    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:41.343982 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.343954    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24a06942-9095-4901-b35a-3c9d2fed9ba8-tls-certs\") pod \"24a06942-9095-4901-b35a-3c9d2fed9ba8\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") "
Jul 17 05:37:41.344192 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.344012    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-tmp-dir\") pod \"24a06942-9095-4901-b35a-3c9d2fed9ba8\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") "
Jul 17 05:37:41.344192 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.344050    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pkq9\" (UniqueName: \"kubernetes.io/projected/24a06942-9095-4901-b35a-3c9d2fed9ba8-kube-api-access-9pkq9\") pod \"24a06942-9095-4901-b35a-3c9d2fed9ba8\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") "
Jul 17 05:37:41.344192 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.344071    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-home\") pod \"24a06942-9095-4901-b35a-3c9d2fed9ba8\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") "
Jul 17 05:37:41.344192 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.344099    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-model-cache\") pod \"24a06942-9095-4901-b35a-3c9d2fed9ba8\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") "
Jul 17 05:37:41.344192 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.344163    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-dshm\") pod \"24a06942-9095-4901-b35a-3c9d2fed9ba8\" (UID: \"24a06942-9095-4901-b35a-3c9d2fed9ba8\") "
Jul 17 05:37:41.344434 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.344319    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "24a06942-9095-4901-b35a-3c9d2fed9ba8" (UID: "24a06942-9095-4901-b35a-3c9d2fed9ba8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:37:41.344434 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.344337    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-home" (OuterVolumeSpecName: "home") pod "24a06942-9095-4901-b35a-3c9d2fed9ba8" (UID: "24a06942-9095-4901-b35a-3c9d2fed9ba8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:37:41.344434 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.344407    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-model-cache" (OuterVolumeSpecName: "model-cache") pod "24a06942-9095-4901-b35a-3c9d2fed9ba8" (UID: "24a06942-9095-4901-b35a-3c9d2fed9ba8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:37:41.344556 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.344533    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-tmp-dir\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:37:41.344556 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.344552    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-home\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:37:41.344697 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.344562    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-model-cache\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:37:41.346602 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.346569    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24a06942-9095-4901-b35a-3c9d2fed9ba8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "24a06942-9095-4901-b35a-3c9d2fed9ba8" (UID: "24a06942-9095-4901-b35a-3c9d2fed9ba8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:37:41.346602 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.346572    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24a06942-9095-4901-b35a-3c9d2fed9ba8-kube-api-access-9pkq9" (OuterVolumeSpecName: "kube-api-access-9pkq9") pod "24a06942-9095-4901-b35a-3c9d2fed9ba8" (UID: "24a06942-9095-4901-b35a-3c9d2fed9ba8"). InnerVolumeSpecName "kube-api-access-9pkq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:37:41.346781 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.346567    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-dshm" (OuterVolumeSpecName: "dshm") pod "24a06942-9095-4901-b35a-3c9d2fed9ba8" (UID: "24a06942-9095-4901-b35a-3c9d2fed9ba8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:37:41.445478 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.445430    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24a06942-9095-4901-b35a-3c9d2fed9ba8-dshm\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:37:41.445478 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.445468    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24a06942-9095-4901-b35a-3c9d2fed9ba8-tls-certs\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:37:41.445478 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.445479    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pkq9\" (UniqueName: \"kubernetes.io/projected/24a06942-9095-4901-b35a-3c9d2fed9ba8-kube-api-access-9pkq9\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:37:41.509119 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.509020    2564 generic.go:356] "Generic (PLEG): container finished" podID="24a06942-9095-4901-b35a-3c9d2fed9ba8" containerID="66a506b73c796ecf9ba35734a56f251052ac8383dd06c32c1c7bc76559a4889d" exitCode=0
Jul 17 05:37:41.509119 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.509074    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"
Jul 17 05:37:41.509331 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.509108    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf" event={"ID":"24a06942-9095-4901-b35a-3c9d2fed9ba8","Type":"ContainerDied","Data":"66a506b73c796ecf9ba35734a56f251052ac8383dd06c32c1c7bc76559a4889d"}
Jul 17 05:37:41.509331 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.509158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf" event={"ID":"24a06942-9095-4901-b35a-3c9d2fed9ba8","Type":"ContainerDied","Data":"62b4e32c3ce6e983923420e06a04b6dbb57e8d43d82380bf8f8d4b82302e2f08"}
Jul 17 05:37:41.509331 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.509182    2564 scope.go:117] "RemoveContainer" containerID="66a506b73c796ecf9ba35734a56f251052ac8383dd06c32c1c7bc76559a4889d"
Jul 17 05:37:41.526142 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.526119    2564 scope.go:117] "RemoveContainer" containerID="66a506b73c796ecf9ba35734a56f251052ac8383dd06c32c1c7bc76559a4889d"
Jul 17 05:37:41.526456 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:37:41.526437    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66a506b73c796ecf9ba35734a56f251052ac8383dd06c32c1c7bc76559a4889d\": container with ID starting with 66a506b73c796ecf9ba35734a56f251052ac8383dd06c32c1c7bc76559a4889d not found: ID does not exist" containerID="66a506b73c796ecf9ba35734a56f251052ac8383dd06c32c1c7bc76559a4889d"
Jul 17 05:37:41.526500 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.526466    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66a506b73c796ecf9ba35734a56f251052ac8383dd06c32c1c7bc76559a4889d"} err="failed to get container status \"66a506b73c796ecf9ba35734a56f251052ac8383dd06c32c1c7bc76559a4889d\": rpc error: code = NotFound desc = could not find container \"66a506b73c796ecf9ba35734a56f251052ac8383dd06c32c1c7bc76559a4889d\": container with ID starting with 66a506b73c796ecf9ba35734a56f251052ac8383dd06c32c1c7bc76559a4889d not found: ID does not exist"
Jul 17 05:37:41.536132 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.536105    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"]
Jul 17 05:37:41.541312 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.541282    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-63fb52/test-model-63fb52-kserve-5dc796cfb9-tb6mf"]
Jul 17 05:37:41.857821 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:41.857786    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24a06942-9095-4901-b35a-3c9d2fed9ba8" path="/var/lib/kubelet/pods/24a06942-9095-4901-b35a-3c9d2fed9ba8/volumes"
Jul 17 05:37:45.438550 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:45.438507    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:37:47.180639 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:47.180599    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:37:47.256936 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:47.256896    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:37:51.885451 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:51.885410    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:37:52.132845 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:52.132809    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:37:52.883769 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:52.883721    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:37:52.984648 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:37:52.984588    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:02.900401 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:02.900353    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:04.512152 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:04.512110    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:05.936293 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:05.936253    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:38:07.354164 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:07.354127    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:13.091198 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:13.091161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:13.191746 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:13.191702    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:18.123318 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:18.123278    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:18.439949 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:18.439855    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:18.787430 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:18.787336    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:19.200842 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:19.200798    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:19.579089 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:19.579055    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:22.526398 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:22.526356    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:22.621976 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:22.621938    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:22.704388 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:22.704349    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:22.809767 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:22.809734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:23.263568 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:23.263481    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:23.362163 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:23.362124    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:27.028687 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:27.028653    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:27.243228 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:27.243181    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:38:27.510823 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:27.510788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:27.869379 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:27.869339    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:28.323896 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:28.323864    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:30.696267 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:30.696231    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:30.789873 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:30.789829    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:30.863384 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:30.863346    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:31.000582 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:31.000492    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:31.409726 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:31.409688    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:31.502315 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:31.502277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:35.091457 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:35.091417    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:37.843686 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:37.843619    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:38:43.990977 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:43.990934    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:44.106130 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:44.106036    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:52.409852 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:52.409749    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:52.508305 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:52.508270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:53.845558 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:53.845523    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:53.945221 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:53.945187    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:54.179296 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:54.179211    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:38:57.533246 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:57.533207    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:38:58.360068 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:38:58.360036    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:04.618320 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:04.618280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:04.691365 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:04.691321    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:09.079642 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:09.079600    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:09.304543 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:09.304497    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:09.973788 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:09.973746    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:10.077387 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:10.077346    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:19.900205 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:19.900161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:23.537235 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:23.537190    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:39:24.517016 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:24.516977    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:26.121019 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:26.120991    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:39:26.134091 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:26.134065    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:39:30.383086 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:30.383051    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:30.483079 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:30.483039    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:35.346146 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:35.346107    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:35.535223 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:35.535189    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:35.901872 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:35.901838    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:36.240649 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:36.240531    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:36.442967 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:36.442935    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:38.930287 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:38.930250    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:39.033948 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:39.033912    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:39.132115 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:39.132086    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:39.314962 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:39.314927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:39.631492 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:39.631404    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:39.732435 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:39.732398    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:43.462093 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:43.462056    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:43.811388 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:43.811351    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:44.140748 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:44.140653    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:44.238173 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:44.238140    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:44.441475 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:44.441390    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:39:47.052217 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:47.052183    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:47.155245 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:47.155200    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:47.253270 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:47.253237    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:47.604699 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:47.604661    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:47.855141 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:47.855056    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:47.956395 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:47.956363    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:51.078383 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:51.078341    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:51.555481 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:51.555391    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:39:57.634161 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:57.634121    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:39:59.932022 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:59.931976    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"]
Jul 17 05:39:59.932517 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:59.932489    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24a06942-9095-4901-b35a-3c9d2fed9ba8" containerName="main"
Jul 17 05:39:59.932517 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:59.932514    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="24a06942-9095-4901-b35a-3c9d2fed9ba8" containerName="main"
Jul 17 05:39:59.932677 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:59.932563    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8da08b26-a08e-4e98-b2e4-6ebffe8da946" containerName="revoke-keys"
Jul 17 05:39:59.932677 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:59.932573    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8da08b26-a08e-4e98-b2e4-6ebffe8da946" containerName="revoke-keys"
Jul 17 05:39:59.932764 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:59.932705    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="24a06942-9095-4901-b35a-3c9d2fed9ba8" containerName="main"
Jul 17 05:39:59.934873 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:59.934852    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:39:59.938702 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:59.938674    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-560f5b\"/\"openshift-service-ca.crt\""
Jul 17 05:39:59.938833 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:59.938714    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-560f5b\"/\"auth-test-model-560f5b-kserve-self-signed-certs\""
Jul 17 05:39:59.938833 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:59.938714    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-560f5b\"/\"default-dockercfg-zqffw\""
Jul 17 05:39:59.938833 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:59.938716    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-560f5b\"/\"kube-root-ca.crt\""
Jul 17 05:39:59.944971 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:59.944945    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"]
Jul 17 05:39:59.965312 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:39:59.965255    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:40:00.033073 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.033029    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-home\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.033073 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.033076    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-tls-certs\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.033311 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.033144    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-dshm\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.033311 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.033201    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-tmp-dir\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.033311 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.033226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-model-cache\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.033311 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.033250    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79klh\" (UniqueName: \"kubernetes.io/projected/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-kube-api-access-79klh\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.134220 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.134184    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-tls-certs\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.134430 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.134234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-dshm\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.134430 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.134351    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-tmp-dir\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.134430 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.134390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-model-cache\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.134430 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.134420    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79klh\" (UniqueName: \"kubernetes.io/projected/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-kube-api-access-79klh\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.134682 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.134523    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-home\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.134772 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.134750    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-tmp-dir\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.134831 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.134792    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-model-cache\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.134870 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.134856    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-home\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.136738 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.136718    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-dshm\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.137057 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.137040    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-tls-certs\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.143287 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.143258    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79klh\" (UniqueName: \"kubernetes.io/projected/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-kube-api-access-79klh\") pod \"auth-test-model-560f5b-kserve-68df766899-fws2r\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") " pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.245231 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.245134    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:00.404773 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.404746    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"]
Jul 17 05:40:00.405928 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:40:00.405893    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd2ae053_1113_4a42_bdef_d9b1ea44d54c.slice/crio-dd65c34df7025fb4be0b7fc6e8f729cc9249a950ea7ddca275ca65e69188bdaa WatchSource:0}: Error finding container dd65c34df7025fb4be0b7fc6e8f729cc9249a950ea7ddca275ca65e69188bdaa: Status 404 returned error can't find the container with id dd65c34df7025fb4be0b7fc6e8f729cc9249a950ea7ddca275ca65e69188bdaa
Jul 17 05:40:00.648302 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.648267    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:40:00.748657 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:00.748594    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:40:01.364386 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:01.364350    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r" event={"ID":"fd2ae053-1113-4a42-bdef-d9b1ea44d54c","Type":"ContainerStarted","Data":"83597bdc2cdfa1890ddd18c43051809d124ab59b9ea7830365b98b462af57b2b"}
Jul 17 05:40:01.364386 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:01.364392    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r" event={"ID":"fd2ae053-1113-4a42-bdef-d9b1ea44d54c","Type":"ContainerStarted","Data":"dd65c34df7025fb4be0b7fc6e8f729cc9249a950ea7ddca275ca65e69188bdaa"}
Jul 17 05:40:01.383924 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:01.383864    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r" podStartSLOduration=2.383846306 podStartE2EDuration="2.383846306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:40:01.383334051 +0000 UTC m=+3036.060940397" watchObservedRunningTime="2026-07-17 05:40:01.383846306 +0000 UTC m=+3036.061452652"
Jul 17 05:40:04.076103 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:04.076059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:40:04.142235 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:04.142193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:40:04.890843 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:04.890794    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:40:04.992277 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:04.992228    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:40:05.732727 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:05.732694    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:40:08.979870 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:08.979832    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:40:09.080280 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:09.080249    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:40:10.245956 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:10.245901    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:10.246417 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:10.246202    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:10.258858 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:10.258823    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:10.427998 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:10.427965    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:40:17.053334 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.053254    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"]
Jul 17 05:40:17.057104 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.057085    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.062281 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.062253    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-823cda\"/\"default-dockercfg-9xxzq\""
Jul 17 05:40:17.062443 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.062259    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-823cda\"/\"openshift-service-ca.crt\""
Jul 17 05:40:17.062520 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.062454    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-823cda\"/\"kube-root-ca.crt\""
Jul 17 05:40:17.062520 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.062466    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-823cda\"/\"auth-test-model-823cda-kserve-self-signed-certs\""
Jul 17 05:40:17.068335 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.068305    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"]
Jul 17 05:40:17.074300 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.074269    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:40:17.100889 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.100836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-home\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.100889 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.100886    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c914cafe-0ecc-484b-af19-68cfeb7601b2-tls-certs\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.101112 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.100967    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-tmp-dir\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.101112 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.101017    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-dshm\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.101112 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.101042    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7xfp\" (UniqueName: \"kubernetes.io/projected/c914cafe-0ecc-484b-af19-68cfeb7601b2-kube-api-access-s7xfp\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.101112 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.101077    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-model-cache\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.201805 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.201763    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-home\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.201805 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.201802    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c914cafe-0ecc-484b-af19-68cfeb7601b2-tls-certs\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.202072 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.201845    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-tmp-dir\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.202072 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.201898    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-dshm\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.202072 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.201921    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7xfp\" (UniqueName: \"kubernetes.io/projected/c914cafe-0ecc-484b-af19-68cfeb7601b2-kube-api-access-s7xfp\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.202072 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.201947    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-model-cache\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.202318 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.202273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-home\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.202318 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.202283    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-tmp-dir\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.202466 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.202440    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-model-cache\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.204424 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.204403    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-dshm\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.204607 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.204589    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c914cafe-0ecc-484b-af19-68cfeb7601b2-tls-certs\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.212911 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.212884    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7xfp\" (UniqueName: \"kubernetes.io/projected/c914cafe-0ecc-484b-af19-68cfeb7601b2-kube-api-access-s7xfp\") pod \"auth-test-model-823cda-kserve-6cb9bd698c-g762k\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") " pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.369040 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.368996    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:17.523602 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:17.523571    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"]
Jul 17 05:40:17.525397 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:40:17.525370    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc914cafe_0ecc_484b_af19_68cfeb7601b2.slice/crio-181793ddf6edfa2c67b46ab224c790bd310eaf23c590343ea4f7c6fe5191042a WatchSource:0}: Error finding container 181793ddf6edfa2c67b46ab224c790bd310eaf23c590343ea4f7c6fe5191042a: Status 404 returned error can't find the container with id 181793ddf6edfa2c67b46ab224c790bd310eaf23c590343ea4f7c6fe5191042a
Jul 17 05:40:18.467167 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:18.467124    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k" event={"ID":"c914cafe-0ecc-484b-af19-68cfeb7601b2","Type":"ContainerStarted","Data":"1bcce49c2474236dfaf26fbd6d518f3bf073b21cdf620474f36ac1cdbec3896f"}
Jul 17 05:40:18.467528 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:18.467179    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k" event={"ID":"c914cafe-0ecc-484b-af19-68cfeb7601b2","Type":"ContainerStarted","Data":"181793ddf6edfa2c67b46ab224c790bd310eaf23c590343ea4f7c6fe5191042a"}
Jul 17 05:40:18.484364 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:18.484301    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k" podStartSLOduration=1.484281307 podStartE2EDuration="1.484281307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:40:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:40:18.482502346 +0000 UTC m=+3053.160108697" watchObservedRunningTime="2026-07-17 05:40:18.484281307 +0000 UTC m=+3053.161887654"
Jul 17 05:40:21.035415 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:21.035370    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:40:27.267385 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:27.267344    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:40:27.321835 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:27.321800    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:40:27.369676 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:27.369621    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:27.369872 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:27.369689    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:27.383016 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:27.382983    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:27.531284 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:27.531203    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:40:38.034051 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:38.034002    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:40:56.733198 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:40:56.733160    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:41:13.224113 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:41:13.224071    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:41:30.428324 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:41:30.428280    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:41:45.425220 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:41:45.425176    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:42:04.725662 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:04.725539    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:42:17.727545 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:17.727503    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"]
Jul 17 05:42:17.773100 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:17.773063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:42:18.720355 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:18.720318    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"]
Jul 17 05:42:18.740062 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:18.740032    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:42:22.654019 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:22.653976    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:42:23.528831 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:23.528798    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:42:32.749920 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:32.749870    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r" podUID="fd2ae053-1113-4a42-bdef-d9b1ea44d54c" containerName="main" containerID="cri-o://83597bdc2cdfa1890ddd18c43051809d124ab59b9ea7830365b98b462af57b2b" gracePeriod=45
Jul 17 05:42:33.021650 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.021605    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:42:33.089998 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.089959    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-dshm\") pod \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") "
Jul 17 05:42:33.090184 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.090027    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-tmp-dir\") pod \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") "
Jul 17 05:42:33.090184 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.090069    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-tls-certs\") pod \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") "
Jul 17 05:42:33.090184 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.090106    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-home\") pod \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") "
Jul 17 05:42:33.090184 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.090142    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-model-cache\") pod \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") "
Jul 17 05:42:33.090184 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.090177    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79klh\" (UniqueName: \"kubernetes.io/projected/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-kube-api-access-79klh\") pod \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\" (UID: \"fd2ae053-1113-4a42-bdef-d9b1ea44d54c\") "
Jul 17 05:42:33.090513 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.090317    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-home" (OuterVolumeSpecName: "home") pod "fd2ae053-1113-4a42-bdef-d9b1ea44d54c" (UID: "fd2ae053-1113-4a42-bdef-d9b1ea44d54c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:42:33.090513 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.090346    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fd2ae053-1113-4a42-bdef-d9b1ea44d54c" (UID: "fd2ae053-1113-4a42-bdef-d9b1ea44d54c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:42:33.090513 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.090420    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-model-cache" (OuterVolumeSpecName: "model-cache") pod "fd2ae053-1113-4a42-bdef-d9b1ea44d54c" (UID: "fd2ae053-1113-4a42-bdef-d9b1ea44d54c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:42:33.090710 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.090579    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-tmp-dir\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:42:33.090710 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.090599    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-home\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:42:33.090710 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.090614    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-model-cache\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:42:33.092605 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.092575    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-dshm" (OuterVolumeSpecName: "dshm") pod "fd2ae053-1113-4a42-bdef-d9b1ea44d54c" (UID: "fd2ae053-1113-4a42-bdef-d9b1ea44d54c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:42:33.092605 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.092589    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-kube-api-access-79klh" (OuterVolumeSpecName: "kube-api-access-79klh") pod "fd2ae053-1113-4a42-bdef-d9b1ea44d54c" (UID: "fd2ae053-1113-4a42-bdef-d9b1ea44d54c"). InnerVolumeSpecName "kube-api-access-79klh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:42:33.092605 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.092594    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fd2ae053-1113-4a42-bdef-d9b1ea44d54c" (UID: "fd2ae053-1113-4a42-bdef-d9b1ea44d54c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:42:33.192093 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.192049    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-tls-certs\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:42:33.192093 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.192087    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79klh\" (UniqueName: \"kubernetes.io/projected/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-kube-api-access-79klh\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:42:33.192093 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.192098    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd2ae053-1113-4a42-bdef-d9b1ea44d54c-dshm\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:42:33.273528 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.273436    2564 generic.go:356] "Generic (PLEG): container finished" podID="fd2ae053-1113-4a42-bdef-d9b1ea44d54c" containerID="83597bdc2cdfa1890ddd18c43051809d124ab59b9ea7830365b98b462af57b2b" exitCode=0
Jul 17 05:42:33.273528 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.273484    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"
Jul 17 05:42:33.273805 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.273521    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r" event={"ID":"fd2ae053-1113-4a42-bdef-d9b1ea44d54c","Type":"ContainerDied","Data":"83597bdc2cdfa1890ddd18c43051809d124ab59b9ea7830365b98b462af57b2b"}
Jul 17 05:42:33.273805 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.273578    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r" event={"ID":"fd2ae053-1113-4a42-bdef-d9b1ea44d54c","Type":"ContainerDied","Data":"dd65c34df7025fb4be0b7fc6e8f729cc9249a950ea7ddca275ca65e69188bdaa"}
Jul 17 05:42:33.273805 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.273602    2564 scope.go:117] "RemoveContainer" containerID="83597bdc2cdfa1890ddd18c43051809d124ab59b9ea7830365b98b462af57b2b"
Jul 17 05:42:33.288016 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.287620    2564 scope.go:117] "RemoveContainer" containerID="83597bdc2cdfa1890ddd18c43051809d124ab59b9ea7830365b98b462af57b2b"
Jul 17 05:42:33.288367 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:42:33.288343    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83597bdc2cdfa1890ddd18c43051809d124ab59b9ea7830365b98b462af57b2b\": container with ID starting with 83597bdc2cdfa1890ddd18c43051809d124ab59b9ea7830365b98b462af57b2b not found: ID does not exist" containerID="83597bdc2cdfa1890ddd18c43051809d124ab59b9ea7830365b98b462af57b2b"
Jul 17 05:42:33.288491 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.288378    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83597bdc2cdfa1890ddd18c43051809d124ab59b9ea7830365b98b462af57b2b"} err="failed to get container status \"83597bdc2cdfa1890ddd18c43051809d124ab59b9ea7830365b98b462af57b2b\": rpc error: code = NotFound desc = could not find container \"83597bdc2cdfa1890ddd18c43051809d124ab59b9ea7830365b98b462af57b2b\": container with ID starting with 83597bdc2cdfa1890ddd18c43051809d124ab59b9ea7830365b98b462af57b2b not found: ID does not exist"
Jul 17 05:42:33.298539 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.298505    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"]
Jul 17 05:42:33.302237 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.302212    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-560f5b/auth-test-model-560f5b-kserve-68df766899-fws2r"]
Jul 17 05:42:33.741850 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.741781    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k" podUID="c914cafe-0ecc-484b-af19-68cfeb7601b2" containerName="main" containerID="cri-o://1bcce49c2474236dfaf26fbd6d518f3bf073b21cdf620474f36ac1cdbec3896f" gracePeriod=45
Jul 17 05:42:33.858576 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:33.858542    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd2ae053-1113-4a42-bdef-d9b1ea44d54c" path="/var/lib/kubelet/pods/fd2ae053-1113-4a42-bdef-d9b1ea44d54c/volumes"
Jul 17 05:42:34.003070 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.002997    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:42:34.101145 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.101099    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-dshm\") pod \"c914cafe-0ecc-484b-af19-68cfeb7601b2\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") "
Jul 17 05:42:34.101329 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.101154    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-home\") pod \"c914cafe-0ecc-484b-af19-68cfeb7601b2\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") "
Jul 17 05:42:34.101329 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.101213    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-model-cache\") pod \"c914cafe-0ecc-484b-af19-68cfeb7601b2\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") "
Jul 17 05:42:34.101329 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.101234    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c914cafe-0ecc-484b-af19-68cfeb7601b2-tls-certs\") pod \"c914cafe-0ecc-484b-af19-68cfeb7601b2\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") "
Jul 17 05:42:34.101329 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.101279    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-tmp-dir\") pod \"c914cafe-0ecc-484b-af19-68cfeb7601b2\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") "
Jul 17 05:42:34.101536 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.101331    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7xfp\" (UniqueName: \"kubernetes.io/projected/c914cafe-0ecc-484b-af19-68cfeb7601b2-kube-api-access-s7xfp\") pod \"c914cafe-0ecc-484b-af19-68cfeb7601b2\" (UID: \"c914cafe-0ecc-484b-af19-68cfeb7601b2\") "
Jul 17 05:42:34.101536 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.101483    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-home" (OuterVolumeSpecName: "home") pod "c914cafe-0ecc-484b-af19-68cfeb7601b2" (UID: "c914cafe-0ecc-484b-af19-68cfeb7601b2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:42:34.101536 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.101519    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-model-cache" (OuterVolumeSpecName: "model-cache") pod "c914cafe-0ecc-484b-af19-68cfeb7601b2" (UID: "c914cafe-0ecc-484b-af19-68cfeb7601b2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:42:34.101686 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.101670    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-home\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:42:34.101743 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.101691    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-model-cache\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:42:34.101777 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.101749    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c914cafe-0ecc-484b-af19-68cfeb7601b2" (UID: "c914cafe-0ecc-484b-af19-68cfeb7601b2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:42:34.103844 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.103813    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c914cafe-0ecc-484b-af19-68cfeb7601b2-kube-api-access-s7xfp" (OuterVolumeSpecName: "kube-api-access-s7xfp") pod "c914cafe-0ecc-484b-af19-68cfeb7601b2" (UID: "c914cafe-0ecc-484b-af19-68cfeb7601b2"). InnerVolumeSpecName "kube-api-access-s7xfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:42:34.103963 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.103945    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c914cafe-0ecc-484b-af19-68cfeb7601b2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c914cafe-0ecc-484b-af19-68cfeb7601b2" (UID: "c914cafe-0ecc-484b-af19-68cfeb7601b2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:42:34.104051 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.104034    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-dshm" (OuterVolumeSpecName: "dshm") pod "c914cafe-0ecc-484b-af19-68cfeb7601b2" (UID: "c914cafe-0ecc-484b-af19-68cfeb7601b2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:42:34.202502 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.202460    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-dshm\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:42:34.202502 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.202493    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c914cafe-0ecc-484b-af19-68cfeb7601b2-tls-certs\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:42:34.202502 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.202502    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c914cafe-0ecc-484b-af19-68cfeb7601b2-tmp-dir\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:42:34.202805 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.202523    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7xfp\" (UniqueName: \"kubernetes.io/projected/c914cafe-0ecc-484b-af19-68cfeb7601b2-kube-api-access-s7xfp\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:42:34.281066 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.280972    2564 generic.go:356] "Generic (PLEG): container finished" podID="c914cafe-0ecc-484b-af19-68cfeb7601b2" containerID="1bcce49c2474236dfaf26fbd6d518f3bf073b21cdf620474f36ac1cdbec3896f" exitCode=0
Jul 17 05:42:34.281066 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.281049    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"
Jul 17 05:42:34.281303 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.281054    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k" event={"ID":"c914cafe-0ecc-484b-af19-68cfeb7601b2","Type":"ContainerDied","Data":"1bcce49c2474236dfaf26fbd6d518f3bf073b21cdf620474f36ac1cdbec3896f"}
Jul 17 05:42:34.281303 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.281102    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k" event={"ID":"c914cafe-0ecc-484b-af19-68cfeb7601b2","Type":"ContainerDied","Data":"181793ddf6edfa2c67b46ab224c790bd310eaf23c590343ea4f7c6fe5191042a"}
Jul 17 05:42:34.281303 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.281123    2564 scope.go:117] "RemoveContainer" containerID="1bcce49c2474236dfaf26fbd6d518f3bf073b21cdf620474f36ac1cdbec3896f"
Jul 17 05:42:34.291854 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.291831    2564 scope.go:117] "RemoveContainer" containerID="1bcce49c2474236dfaf26fbd6d518f3bf073b21cdf620474f36ac1cdbec3896f"
Jul 17 05:42:34.292201 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:42:34.292181    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bcce49c2474236dfaf26fbd6d518f3bf073b21cdf620474f36ac1cdbec3896f\": container with ID starting with 1bcce49c2474236dfaf26fbd6d518f3bf073b21cdf620474f36ac1cdbec3896f not found: ID does not exist" containerID="1bcce49c2474236dfaf26fbd6d518f3bf073b21cdf620474f36ac1cdbec3896f"
Jul 17 05:42:34.292247 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.292212    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bcce49c2474236dfaf26fbd6d518f3bf073b21cdf620474f36ac1cdbec3896f"} err="failed to get container status \"1bcce49c2474236dfaf26fbd6d518f3bf073b21cdf620474f36ac1cdbec3896f\": rpc error: code = NotFound desc = could not find container \"1bcce49c2474236dfaf26fbd6d518f3bf073b21cdf620474f36ac1cdbec3896f\": container with ID starting with 1bcce49c2474236dfaf26fbd6d518f3bf073b21cdf620474f36ac1cdbec3896f not found: ID does not exist"
Jul 17 05:42:34.302890 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.302858    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"]
Jul 17 05:42:34.306760 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:34.306727    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-823cda/auth-test-model-823cda-kserve-6cb9bd698c-g762k"]
Jul 17 05:42:35.859860 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:35.859821    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c914cafe-0ecc-484b-af19-68cfeb7601b2" path="/var/lib/kubelet/pods/c914cafe-0ecc-484b-af19-68cfeb7601b2/volumes"
Jul 17 05:42:37.620009 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:37.619965    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c"]
Jul 17 05:42:37.620560 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:37.620538    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd2ae053-1113-4a42-bdef-d9b1ea44d54c" containerName="main"
Jul 17 05:42:37.620679 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:37.620563    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd2ae053-1113-4a42-bdef-d9b1ea44d54c" containerName="main"
Jul 17 05:42:37.620679 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:37.620613    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c914cafe-0ecc-484b-af19-68cfeb7601b2" containerName="main"
Jul 17 05:42:37.620679 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:37.620641    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c914cafe-0ecc-484b-af19-68cfeb7601b2" containerName="main"
Jul 17 05:42:37.620848 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:37.620745    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c914cafe-0ecc-484b-af19-68cfeb7601b2" containerName="main"
Jul 17 05:42:37.620848 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:37.620762    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd2ae053-1113-4a42-bdef-d9b1ea44d54c" containerName="main"
Jul 17 05:42:37.623866 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:37.623846    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c"
Jul 17 05:42:37.627288 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:37.626709    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 05:42:37.627288 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:37.626709    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qh8zj\""
Jul 17 05:42:37.629152 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:37.629120    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c"]
Jul 17 05:42:37.735172 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:37.735132    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a939e5-a581-4cc5-aadc-007be67da598-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c\" (UID: \"d6a939e5-a581-4cc5-aadc-007be67da598\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c"
Jul 17 05:42:37.835674 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:37.835622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a939e5-a581-4cc5-aadc-007be67da598-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c\" (UID: \"d6a939e5-a581-4cc5-aadc-007be67da598\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c"
Jul 17 05:42:37.836238 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:37.836219    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a939e5-a581-4cc5-aadc-007be67da598-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c\" (UID: \"d6a939e5-a581-4cc5-aadc-007be67da598\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c"
Jul 17 05:42:37.936853 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:37.936768    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c"
Jul 17 05:42:38.078212 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:38.078166    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c"]
Jul 17 05:42:38.079539 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:42:38.079502    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a939e5_a581_4cc5_aadc_007be67da598.slice/crio-4751caff4261ad7f64f502d98c6d13000b52c083f82669e075cd0306675926ab WatchSource:0}: Error finding container 4751caff4261ad7f64f502d98c6d13000b52c083f82669e075cd0306675926ab: Status 404 returned error can't find the container with id 4751caff4261ad7f64f502d98c6d13000b52c083f82669e075cd0306675926ab
Jul 17 05:42:38.308114 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:38.308078    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c" event={"ID":"d6a939e5-a581-4cc5-aadc-007be67da598","Type":"ContainerStarted","Data":"4751caff4261ad7f64f502d98c6d13000b52c083f82669e075cd0306675926ab"}
Jul 17 05:42:39.034789 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.034693    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"]
Jul 17 05:42:39.039379 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.039354    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:42:39.039526 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.039506    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.043587 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.043550    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-823cda\"/\"default-dockercfg-9xxzq\""
Jul 17 05:42:39.043587 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.043586    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-823cda\"/\"kube-root-ca.crt\""
Jul 17 05:42:39.043795 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.043591    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-823cda\"/\"sub-test-model-823cda-kserve-self-signed-certs\""
Jul 17 05:42:39.043795 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.043590    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-823cda\"/\"openshift-service-ca.crt\""
Jul 17 05:42:39.052168 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.052141    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"]
Jul 17 05:42:39.067809 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.067776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:42:39.149253 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.149223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-home\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.149466 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.149275    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-tmp-dir\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.149466 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.149293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb288a86-0098-40fd-b6f5-c370a50d87db-tls-certs\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.149466 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.149426    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-model-cache\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.149605 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.149491    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-dshm\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.149605 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.149521    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d52rj\" (UniqueName: \"kubernetes.io/projected/cb288a86-0098-40fd-b6f5-c370a50d87db-kube-api-access-d52rj\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.250955 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.250919    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-home\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.251120 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.250988    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-tmp-dir\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.251120 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.251014    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb288a86-0098-40fd-b6f5-c370a50d87db-tls-certs\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.251120 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.251079    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-model-cache\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.251120 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.251116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-dshm\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.251317 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.251143    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d52rj\" (UniqueName: \"kubernetes.io/projected/cb288a86-0098-40fd-b6f5-c370a50d87db-kube-api-access-d52rj\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.251408 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.251386    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-home\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.251474 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.251446    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-tmp-dir\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.251517 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.251502    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-model-cache\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.253585 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.253564    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-dshm\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.253795 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.253780    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb288a86-0098-40fd-b6f5-c370a50d87db-tls-certs\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.259132 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.259113    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d52rj\" (UniqueName: \"kubernetes.io/projected/cb288a86-0098-40fd-b6f5-c370a50d87db-kube-api-access-d52rj\") pod \"sub-test-model-823cda-kserve-6f85bf4749-g7kxn\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") " pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.315819 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.315788    2564 generic.go:356] "Generic (PLEG): container finished" podID="d6a939e5-a581-4cc5-aadc-007be67da598" containerID="cb113e5d7202a0a63b67538246fb8f948b0844ecf6f1777ffe52c6c2193f5c78" exitCode=6
Jul 17 05:42:39.316008 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.315883    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c" event={"ID":"d6a939e5-a581-4cc5-aadc-007be67da598","Type":"ContainerDied","Data":"cb113e5d7202a0a63b67538246fb8f948b0844ecf6f1777ffe52c6c2193f5c78"}
Jul 17 05:42:39.316062 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.316051    2564 scope.go:117] "RemoveContainer" containerID="cb113e5d7202a0a63b67538246fb8f948b0844ecf6f1777ffe52c6c2193f5c78"
Jul 17 05:42:39.349400 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.349377    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:39.495179 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:39.495146    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"]
Jul 17 05:42:39.496718 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:42:39.496693    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb288a86_0098_40fd_b6f5_c370a50d87db.slice/crio-99321bb8bc8b9a4fbb6a0142bf0afbf2a16b9a9477431974eac8bc3f83afbd0c WatchSource:0}: Error finding container 99321bb8bc8b9a4fbb6a0142bf0afbf2a16b9a9477431974eac8bc3f83afbd0c: Status 404 returned error can't find the container with id 99321bb8bc8b9a4fbb6a0142bf0afbf2a16b9a9477431974eac8bc3f83afbd0c
Jul 17 05:42:40.323292 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:40.323254    2564 generic.go:356] "Generic (PLEG): container finished" podID="d6a939e5-a581-4cc5-aadc-007be67da598" containerID="cb90a87c28965ba18251cd07f993cccb9b6b8c78c284cbbe5fde4643e40dd2aa" exitCode=6
Jul 17 05:42:40.323771 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:40.323346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c" event={"ID":"d6a939e5-a581-4cc5-aadc-007be67da598","Type":"ContainerDied","Data":"cb90a87c28965ba18251cd07f993cccb9b6b8c78c284cbbe5fde4643e40dd2aa"}
Jul 17 05:42:40.323771 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:40.323423    2564 scope.go:117] "RemoveContainer" containerID="cb113e5d7202a0a63b67538246fb8f948b0844ecf6f1777ffe52c6c2193f5c78"
Jul 17 05:42:40.323771 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:40.323658    2564 scope.go:117] "RemoveContainer" containerID="cb90a87c28965ba18251cd07f993cccb9b6b8c78c284cbbe5fde4643e40dd2aa"
Jul 17 05:42:40.323964 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:42:40.323941    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c_odh-ai-gateway-infra(d6a939e5-a581-4cc5-aadc-007be67da598)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c" podUID="d6a939e5-a581-4cc5-aadc-007be67da598"
Jul 17 05:42:40.325146 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:40.325125    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn" event={"ID":"cb288a86-0098-40fd-b6f5-c370a50d87db","Type":"ContainerStarted","Data":"99446b5047ec4bb1b2b6143d9661aacbfc92ae1b570e9dd7e6cfc7b639b75fca"}
Jul 17 05:42:40.325247 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:40.325159    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn" event={"ID":"cb288a86-0098-40fd-b6f5-c370a50d87db","Type":"ContainerStarted","Data":"99321bb8bc8b9a4fbb6a0142bf0afbf2a16b9a9477431974eac8bc3f83afbd0c"}
Jul 17 05:42:40.355542 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:40.355486    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn" podStartSLOduration=1.355469292 podStartE2EDuration="1.355469292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:42:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:42:40.352664024 +0000 UTC m=+3195.030270362" watchObservedRunningTime="2026-07-17 05:42:40.355469292 +0000 UTC m=+3195.033075637"
Jul 17 05:42:41.333152 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:41.333121    2564 scope.go:117] "RemoveContainer" containerID="cb90a87c28965ba18251cd07f993cccb9b6b8c78c284cbbe5fde4643e40dd2aa"
Jul 17 05:42:41.333549 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:42:41.333324    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c_odh-ai-gateway-infra(d6a939e5-a581-4cc5-aadc-007be67da598)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c" podUID="d6a939e5-a581-4cc5-aadc-007be67da598"
Jul 17 05:42:41.602900 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:41.602804    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:42:41.655958 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:41.655924    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:42:49.350157 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:49.350117    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:49.350686 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:49.350178    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:49.363179 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:49.363151    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:49.394350 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:49.394319    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:42:52.533002 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:52.532966    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:42:54.943101 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:54.943059    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2"]
Jul 17 05:42:54.948098 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:54.948078    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2"
Jul 17 05:42:54.954449 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:54.954403    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2"]
Jul 17 05:42:55.110576 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:55.110535    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c4cab29-0651-4331-a0c1-edf456d1d233-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2\" (UID: \"7c4cab29-0651-4331-a0c1-edf456d1d233\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2"
Jul 17 05:42:55.211667 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:55.211524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c4cab29-0651-4331-a0c1-edf456d1d233-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2\" (UID: \"7c4cab29-0651-4331-a0c1-edf456d1d233\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2"
Jul 17 05:42:55.212264 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:55.212234    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c4cab29-0651-4331-a0c1-edf456d1d233-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2\" (UID: \"7c4cab29-0651-4331-a0c1-edf456d1d233\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2"
Jul 17 05:42:55.261177 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:55.261139    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2"
Jul 17 05:42:55.406400 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:55.406370    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2"]
Jul 17 05:42:55.407906 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:42:55.407878    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c4cab29_0651_4331_a0c1_edf456d1d233.slice/crio-320e8f26ce127a8934abcc4df60453127f3f735ff45e2514e169392dd31bea46 WatchSource:0}: Error finding container 320e8f26ce127a8934abcc4df60453127f3f735ff45e2514e169392dd31bea46: Status 404 returned error can't find the container with id 320e8f26ce127a8934abcc4df60453127f3f735ff45e2514e169392dd31bea46
Jul 17 05:42:55.418164 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:55.418126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2" event={"ID":"7c4cab29-0651-4331-a0c1-edf456d1d233","Type":"ContainerStarted","Data":"320e8f26ce127a8934abcc4df60453127f3f735ff45e2514e169392dd31bea46"}
Jul 17 05:42:56.426091 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:56.425977    2564 generic.go:356] "Generic (PLEG): container finished" podID="7c4cab29-0651-4331-a0c1-edf456d1d233" containerID="8a43361f79b3eaa2c993f44f92a89bf6c5f810f3fe53b962444dd7792e8b4f9d" exitCode=6
Jul 17 05:42:56.426091 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:56.426073    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2" event={"ID":"7c4cab29-0651-4331-a0c1-edf456d1d233","Type":"ContainerDied","Data":"8a43361f79b3eaa2c993f44f92a89bf6c5f810f3fe53b962444dd7792e8b4f9d"}
Jul 17 05:42:56.426618 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:56.426306    2564 scope.go:117] "RemoveContainer" containerID="8a43361f79b3eaa2c993f44f92a89bf6c5f810f3fe53b962444dd7792e8b4f9d"
Jul 17 05:42:56.851514 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:56.851479    2564 scope.go:117] "RemoveContainer" containerID="cb90a87c28965ba18251cd07f993cccb9b6b8c78c284cbbe5fde4643e40dd2aa"
Jul 17 05:42:57.434497 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:57.434399    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c" event={"ID":"d6a939e5-a581-4cc5-aadc-007be67da598","Type":"ContainerStarted","Data":"348d613619fa3b4cb86d75e19ca4c1c2d8a3cb2be04b7b1183917bd2515a4661"}
Jul 17 05:42:57.436222 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:57.436194    2564 generic.go:356] "Generic (PLEG): container finished" podID="7c4cab29-0651-4331-a0c1-edf456d1d233" containerID="82c0225375f1fc26c0831b6245d96509af832a51b9a37a7714917fe2d5e64e65" exitCode=6
Jul 17 05:42:57.436360 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:57.436283    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2" event={"ID":"7c4cab29-0651-4331-a0c1-edf456d1d233","Type":"ContainerDied","Data":"82c0225375f1fc26c0831b6245d96509af832a51b9a37a7714917fe2d5e64e65"}
Jul 17 05:42:57.436360 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:57.436343    2564 scope.go:117] "RemoveContainer" containerID="8a43361f79b3eaa2c993f44f92a89bf6c5f810f3fe53b962444dd7792e8b4f9d"
Jul 17 05:42:57.436446 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:57.436406    2564 scope.go:117] "RemoveContainer" containerID="82c0225375f1fc26c0831b6245d96509af832a51b9a37a7714917fe2d5e64e65"
Jul 17 05:42:57.436671 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:42:57.436642    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2_odh-ai-gateway-infra(7c4cab29-0651-4331-a0c1-edf456d1d233)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2" podUID="7c4cab29-0651-4331-a0c1-edf456d1d233"
Jul 17 05:42:57.451810 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:57.451766    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c" podStartSLOduration=20.451751051 podStartE2EDuration="20.451751051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:42:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:42:57.44858435 +0000 UTC m=+3212.126190696" watchObservedRunningTime="2026-07-17 05:42:57.451751051 +0000 UTC m=+3212.129357401"
Jul 17 05:42:58.443879 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:58.443845    2564 generic.go:356] "Generic (PLEG): container finished" podID="d6a939e5-a581-4cc5-aadc-007be67da598" containerID="348d613619fa3b4cb86d75e19ca4c1c2d8a3cb2be04b7b1183917bd2515a4661" exitCode=6
Jul 17 05:42:58.444333 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:58.443906    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c" event={"ID":"d6a939e5-a581-4cc5-aadc-007be67da598","Type":"ContainerDied","Data":"348d613619fa3b4cb86d75e19ca4c1c2d8a3cb2be04b7b1183917bd2515a4661"}
Jul 17 05:42:58.444333 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:58.443971    2564 scope.go:117] "RemoveContainer" containerID="cb90a87c28965ba18251cd07f993cccb9b6b8c78c284cbbe5fde4643e40dd2aa"
Jul 17 05:42:58.444333 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:58.444277    2564 scope.go:117] "RemoveContainer" containerID="348d613619fa3b4cb86d75e19ca4c1c2d8a3cb2be04b7b1183917bd2515a4661"
Jul 17 05:42:58.444555 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:42:58.444531    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c_odh-ai-gateway-infra(d6a939e5-a581-4cc5-aadc-007be67da598)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c" podUID="d6a939e5-a581-4cc5-aadc-007be67da598"
Jul 17 05:42:58.445841 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:58.445822    2564 scope.go:117] "RemoveContainer" containerID="82c0225375f1fc26c0831b6245d96509af832a51b9a37a7714917fe2d5e64e65"
Jul 17 05:42:58.446003 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:42:58.445987    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2_odh-ai-gateway-infra(7c4cab29-0651-4331-a0c1-edf456d1d233)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2" podUID="7c4cab29-0651-4331-a0c1-edf456d1d233"
Jul 17 05:42:58.458812 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:58.458788    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c"]
Jul 17 05:42:59.611184 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:59.611157    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c"
Jul 17 05:42:59.755529 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:59.755415    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a939e5-a581-4cc5-aadc-007be67da598-maas-api-service-ca\") pod \"d6a939e5-a581-4cc5-aadc-007be67da598\" (UID: \"d6a939e5-a581-4cc5-aadc-007be67da598\") "
Jul 17 05:42:59.755872 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:59.755847    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6a939e5-a581-4cc5-aadc-007be67da598-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d6a939e5-a581-4cc5-aadc-007be67da598" (UID: "d6a939e5-a581-4cc5-aadc-007be67da598"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:42:59.857016 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:42:59.856987    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a939e5-a581-4cc5-aadc-007be67da598-maas-api-service-ca\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:43:00.460703 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:00.460665    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c" event={"ID":"d6a939e5-a581-4cc5-aadc-007be67da598","Type":"ContainerDied","Data":"4751caff4261ad7f64f502d98c6d13000b52c083f82669e075cd0306675926ab"}
Jul 17 05:43:00.460703 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:00.460702    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c"
Jul 17 05:43:00.460944 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:00.460731    2564 scope.go:117] "RemoveContainer" containerID="348d613619fa3b4cb86d75e19ca4c1c2d8a3cb2be04b7b1183917bd2515a4661"
Jul 17 05:43:00.478087 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:00.478057    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c"]
Jul 17 05:43:00.482246 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:00.482215    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-2hr9c"]
Jul 17 05:43:01.858279 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:01.858239    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6a939e5-a581-4cc5-aadc-007be67da598" path="/var/lib/kubelet/pods/d6a939e5-a581-4cc5-aadc-007be67da598/volumes"
Jul 17 05:43:05.534596 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:05.534549    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:43:11.403382 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:11.403343    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj"]
Jul 17 05:43:11.404020 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:11.403986    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a939e5-a581-4cc5-aadc-007be67da598" containerName="revoke-keys"
Jul 17 05:43:11.404020 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:11.404008    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a939e5-a581-4cc5-aadc-007be67da598" containerName="revoke-keys"
Jul 17 05:43:11.404143 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:11.404066    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a939e5-a581-4cc5-aadc-007be67da598" containerName="revoke-keys"
Jul 17 05:43:11.404143 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:11.404077    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a939e5-a581-4cc5-aadc-007be67da598" containerName="revoke-keys"
Jul 17 05:43:11.404237 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:11.404176    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6a939e5-a581-4cc5-aadc-007be67da598" containerName="revoke-keys"
Jul 17 05:43:11.404237 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:11.404189    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6a939e5-a581-4cc5-aadc-007be67da598" containerName="revoke-keys"
Jul 17 05:43:11.407186 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:11.407165    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj"
Jul 17 05:43:11.417076 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:11.417045    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj"]
Jul 17 05:43:11.467674 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:11.467605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2b27d6d-93da-420e-ae2a-5a5641434482-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4e221674-h8nrj\" (UID: \"b2b27d6d-93da-420e-ae2a-5a5641434482\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj"
Jul 17 05:43:11.568117 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:11.568070    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2b27d6d-93da-420e-ae2a-5a5641434482-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4e221674-h8nrj\" (UID: \"b2b27d6d-93da-420e-ae2a-5a5641434482\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj"
Jul 17 05:43:11.568760 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:11.568740    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2b27d6d-93da-420e-ae2a-5a5641434482-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4e221674-h8nrj\" (UID: \"b2b27d6d-93da-420e-ae2a-5a5641434482\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj"
Jul 17 05:43:11.719431 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:11.719335    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj"
Jul 17 05:43:11.867098 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:11.867068    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj"]
Jul 17 05:43:11.867215 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:43:11.867098    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2b27d6d_93da_420e_ae2a_5a5641434482.slice/crio-fa4fa4ddaa8d479a74dc4e060e45618fcd9461faeb0a5ab6fdafe8dad40d36f4 WatchSource:0}: Error finding container fa4fa4ddaa8d479a74dc4e060e45618fcd9461faeb0a5ab6fdafe8dad40d36f4: Status 404 returned error can't find the container with id fa4fa4ddaa8d479a74dc4e060e45618fcd9461faeb0a5ab6fdafe8dad40d36f4
Jul 17 05:43:12.536466 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:12.536372    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj" event={"ID":"b2b27d6d-93da-420e-ae2a-5a5641434482","Type":"ContainerStarted","Data":"fc5a8fbc0edaf777b8d981721de990ca6c7e2dfe26a414794b7d4640e53aca91"}
Jul 17 05:43:12.536466 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:12.536428    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj" event={"ID":"b2b27d6d-93da-420e-ae2a-5a5641434482","Type":"ContainerStarted","Data":"fa4fa4ddaa8d479a74dc4e060e45618fcd9461faeb0a5ab6fdafe8dad40d36f4"}
Jul 17 05:43:12.552525 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:12.552469    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj" podStartSLOduration=1.552452117 podStartE2EDuration="1.552452117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:43:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:43:12.550919175 +0000 UTC m=+3227.228525531" watchObservedRunningTime="2026-07-17 05:43:12.552452117 +0000 UTC m=+3227.230058463"
Jul 17 05:43:12.852153 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:12.852126    2564 scope.go:117] "RemoveContainer" containerID="82c0225375f1fc26c0831b6245d96509af832a51b9a37a7714917fe2d5e64e65"
Jul 17 05:43:13.544757 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:13.544654    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2" event={"ID":"7c4cab29-0651-4331-a0c1-edf456d1d233","Type":"ContainerStarted","Data":"5f1e08c889b4e74f195232abe476d298ab0681e900aff587739567eeaebbc35c"}
Jul 17 05:43:13.546329 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:13.546294    2564 generic.go:356] "Generic (PLEG): container finished" podID="b2b27d6d-93da-420e-ae2a-5a5641434482" containerID="fc5a8fbc0edaf777b8d981721de990ca6c7e2dfe26a414794b7d4640e53aca91" exitCode=6
Jul 17 05:43:13.546485 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:13.546354    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj" event={"ID":"b2b27d6d-93da-420e-ae2a-5a5641434482","Type":"ContainerDied","Data":"fc5a8fbc0edaf777b8d981721de990ca6c7e2dfe26a414794b7d4640e53aca91"}
Jul 17 05:43:13.546538 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:13.546504    2564 scope.go:117] "RemoveContainer" containerID="fc5a8fbc0edaf777b8d981721de990ca6c7e2dfe26a414794b7d4640e53aca91"
Jul 17 05:43:13.565106 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:13.565050    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2" podStartSLOduration=19.565030861 podStartE2EDuration="19.565030861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:42:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:43:13.562567671 +0000 UTC m=+3228.240174018" watchObservedRunningTime="2026-07-17 05:43:13.565030861 +0000 UTC m=+3228.242637252"
Jul 17 05:43:14.554413 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:14.554375    2564 generic.go:356] "Generic (PLEG): container finished" podID="b2b27d6d-93da-420e-ae2a-5a5641434482" containerID="9c993a2e953169e3af7de975420d9bd9516dcdd6ff506d0d1b624d096b80a3ab" exitCode=6
Jul 17 05:43:14.554925 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:14.554458    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj" event={"ID":"b2b27d6d-93da-420e-ae2a-5a5641434482","Type":"ContainerDied","Data":"9c993a2e953169e3af7de975420d9bd9516dcdd6ff506d0d1b624d096b80a3ab"}
Jul 17 05:43:14.554925 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:14.554521    2564 scope.go:117] "RemoveContainer" containerID="fc5a8fbc0edaf777b8d981721de990ca6c7e2dfe26a414794b7d4640e53aca91"
Jul 17 05:43:14.554925 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:14.554724    2564 scope.go:117] "RemoveContainer" containerID="9c993a2e953169e3af7de975420d9bd9516dcdd6ff506d0d1b624d096b80a3ab"
Jul 17 05:43:14.555099 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:43:14.555033    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4e221674-h8nrj_odh-ai-gateway-infra(b2b27d6d-93da-420e-ae2a-5a5641434482)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj" podUID="b2b27d6d-93da-420e-ae2a-5a5641434482"
Jul 17 05:43:14.556596 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:14.556574    2564 generic.go:356] "Generic (PLEG): container finished" podID="7c4cab29-0651-4331-a0c1-edf456d1d233" containerID="5f1e08c889b4e74f195232abe476d298ab0681e900aff587739567eeaebbc35c" exitCode=6
Jul 17 05:43:14.556716 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:14.556612    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2" event={"ID":"7c4cab29-0651-4331-a0c1-edf456d1d233","Type":"ContainerDied","Data":"5f1e08c889b4e74f195232abe476d298ab0681e900aff587739567eeaebbc35c"}
Jul 17 05:43:14.556907 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:14.556894    2564 scope.go:117] "RemoveContainer" containerID="5f1e08c889b4e74f195232abe476d298ab0681e900aff587739567eeaebbc35c"
Jul 17 05:43:14.557124 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:43:14.557104    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2_odh-ai-gateway-infra(7c4cab29-0651-4331-a0c1-edf456d1d233)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2" podUID="7c4cab29-0651-4331-a0c1-edf456d1d233"
Jul 17 05:43:14.567013 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:14.566993    2564 scope.go:117] "RemoveContainer" containerID="82c0225375f1fc26c0831b6245d96509af832a51b9a37a7714917fe2d5e64e65"
Jul 17 05:43:14.580651 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:14.580604    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2"]
Jul 17 05:43:15.564956 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:15.564925    2564 scope.go:117] "RemoveContainer" containerID="9c993a2e953169e3af7de975420d9bd9516dcdd6ff506d0d1b624d096b80a3ab"
Jul 17 05:43:15.565413 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:43:15.565144    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4e221674-h8nrj_odh-ai-gateway-infra(b2b27d6d-93da-420e-ae2a-5a5641434482)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj" podUID="b2b27d6d-93da-420e-ae2a-5a5641434482"
Jul 17 05:43:15.720337 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:15.720305    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2"
Jul 17 05:43:15.811005 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:15.810965    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c4cab29-0651-4331-a0c1-edf456d1d233-maas-api-service-ca\") pod \"7c4cab29-0651-4331-a0c1-edf456d1d233\" (UID: \"7c4cab29-0651-4331-a0c1-edf456d1d233\") "
Jul 17 05:43:15.811357 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:15.811330    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c4cab29-0651-4331-a0c1-edf456d1d233-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7c4cab29-0651-4331-a0c1-edf456d1d233" (UID: "7c4cab29-0651-4331-a0c1-edf456d1d233"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:43:15.912473 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:15.912434    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c4cab29-0651-4331-a0c1-edf456d1d233-maas-api-service-ca\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:43:16.575215 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:16.575173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2" event={"ID":"7c4cab29-0651-4331-a0c1-edf456d1d233","Type":"ContainerDied","Data":"320e8f26ce127a8934abcc4df60453127f3f735ff45e2514e169392dd31bea46"}
Jul 17 05:43:16.575215 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:16.575207    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2"
Jul 17 05:43:16.575805 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:16.575256    2564 scope.go:117] "RemoveContainer" containerID="5f1e08c889b4e74f195232abe476d298ab0681e900aff587739567eeaebbc35c"
Jul 17 05:43:16.593079 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:16.593050    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2"]
Jul 17 05:43:16.595490 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:16.595465    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf0ad9db-krdp2"]
Jul 17 05:43:17.857896 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:17.857858    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c4cab29-0651-4331-a0c1-edf456d1d233" path="/var/lib/kubelet/pods/7c4cab29-0651-4331-a0c1-edf456d1d233/volumes"
Jul 17 05:43:25.823481 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:25.823447    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:43:28.851089 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:28.851057    2564 scope.go:117] "RemoveContainer" containerID="9c993a2e953169e3af7de975420d9bd9516dcdd6ff506d0d1b624d096b80a3ab"
Jul 17 05:43:29.656761 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:29.656724    2564 generic.go:356] "Generic (PLEG): container finished" podID="b2b27d6d-93da-420e-ae2a-5a5641434482" containerID="ae84b0f642c6730fafe5301901ed478d679f68113f1eda4055e085221c5c8409" exitCode=6
Jul 17 05:43:29.656937 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:29.656800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj" event={"ID":"b2b27d6d-93da-420e-ae2a-5a5641434482","Type":"ContainerDied","Data":"ae84b0f642c6730fafe5301901ed478d679f68113f1eda4055e085221c5c8409"}
Jul 17 05:43:29.656937 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:29.656864    2564 scope.go:117] "RemoveContainer" containerID="9c993a2e953169e3af7de975420d9bd9516dcdd6ff506d0d1b624d096b80a3ab"
Jul 17 05:43:29.657230 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:29.657208    2564 scope.go:117] "RemoveContainer" containerID="ae84b0f642c6730fafe5301901ed478d679f68113f1eda4055e085221c5c8409"
Jul 17 05:43:29.657469 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:43:29.657447    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4e221674-h8nrj_odh-ai-gateway-infra(b2b27d6d-93da-420e-ae2a-5a5641434482)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj" podUID="b2b27d6d-93da-420e-ae2a-5a5641434482"
Jul 17 05:43:30.682717 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:30.682683    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj"]
Jul 17 05:43:30.834416 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:30.834387    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj"
Jul 17 05:43:30.952073 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:30.951973    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2b27d6d-93da-420e-ae2a-5a5641434482-maas-api-service-ca\") pod \"b2b27d6d-93da-420e-ae2a-5a5641434482\" (UID: \"b2b27d6d-93da-420e-ae2a-5a5641434482\") "
Jul 17 05:43:30.952363 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:30.952332    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2b27d6d-93da-420e-ae2a-5a5641434482-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b2b27d6d-93da-420e-ae2a-5a5641434482" (UID: "b2b27d6d-93da-420e-ae2a-5a5641434482"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:43:30.952554 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:30.952432    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2b27d6d-93da-420e-ae2a-5a5641434482-maas-api-service-ca\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:43:31.672435 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:31.672405    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj"
Jul 17 05:43:31.672666 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:31.672452    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj" event={"ID":"b2b27d6d-93da-420e-ae2a-5a5641434482","Type":"ContainerDied","Data":"fa4fa4ddaa8d479a74dc4e060e45618fcd9461faeb0a5ab6fdafe8dad40d36f4"}
Jul 17 05:43:31.672666 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:31.672515    2564 scope.go:117] "RemoveContainer" containerID="ae84b0f642c6730fafe5301901ed478d679f68113f1eda4055e085221c5c8409"
Jul 17 05:43:31.696115 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:31.696075    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj"]
Jul 17 05:43:31.701911 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:31.701870    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4e221674-h8nrj"]
Jul 17 05:43:31.857697 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:31.857663    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2b27d6d-93da-420e-ae2a-5a5641434482" path="/var/lib/kubelet/pods/b2b27d6d-93da-420e-ae2a-5a5641434482/volumes"
Jul 17 05:43:32.025889 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:32.025800    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:43:32.923132 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:32.923093    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"]
Jul 17 05:43:32.934935 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:32.934888    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:43:37.663867 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.663828    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h"]
Jul 17 05:43:37.664274 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.664241    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2b27d6d-93da-420e-ae2a-5a5641434482" containerName="revoke-keys"
Jul 17 05:43:37.664274 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.664252    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2b27d6d-93da-420e-ae2a-5a5641434482" containerName="revoke-keys"
Jul 17 05:43:37.664274 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.664265    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a939e5-a581-4cc5-aadc-007be67da598" containerName="revoke-keys"
Jul 17 05:43:37.664274 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.664270    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a939e5-a581-4cc5-aadc-007be67da598" containerName="revoke-keys"
Jul 17 05:43:37.664402 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.664280    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c4cab29-0651-4331-a0c1-edf456d1d233" containerName="revoke-keys"
Jul 17 05:43:37.664402 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.664287    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c4cab29-0651-4331-a0c1-edf456d1d233" containerName="revoke-keys"
Jul 17 05:43:37.664402 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.664295    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c4cab29-0651-4331-a0c1-edf456d1d233" containerName="revoke-keys"
Jul 17 05:43:37.664402 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.664301    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c4cab29-0651-4331-a0c1-edf456d1d233" containerName="revoke-keys"
Jul 17 05:43:37.664402 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.664321    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2b27d6d-93da-420e-ae2a-5a5641434482" containerName="revoke-keys"
Jul 17 05:43:37.664402 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.664326    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2b27d6d-93da-420e-ae2a-5a5641434482" containerName="revoke-keys"
Jul 17 05:43:37.664402 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.664385    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6a939e5-a581-4cc5-aadc-007be67da598" containerName="revoke-keys"
Jul 17 05:43:37.664402 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.664393    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c4cab29-0651-4331-a0c1-edf456d1d233" containerName="revoke-keys"
Jul 17 05:43:37.664402 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.664401    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2b27d6d-93da-420e-ae2a-5a5641434482" containerName="revoke-keys"
Jul 17 05:43:37.664685 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.664407    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2b27d6d-93da-420e-ae2a-5a5641434482" containerName="revoke-keys"
Jul 17 05:43:37.664685 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.664413    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c4cab29-0651-4331-a0c1-edf456d1d233" containerName="revoke-keys"
Jul 17 05:43:37.664685 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.664418    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2b27d6d-93da-420e-ae2a-5a5641434482" containerName="revoke-keys"
Jul 17 05:43:37.667545 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.667528    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h"
Jul 17 05:43:37.670499 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.670472    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 05:43:37.671603 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.671567    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qh8zj\""
Jul 17 05:43:37.675754 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.675724    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h"]
Jul 17 05:43:37.818837 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.818782    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5473ceb4-34de-4167-9f5c-acbf80a1fadd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h\" (UID: \"5473ceb4-34de-4167-9f5c-acbf80a1fadd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h"
Jul 17 05:43:37.920146 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.920042    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5473ceb4-34de-4167-9f5c-acbf80a1fadd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h\" (UID: \"5473ceb4-34de-4167-9f5c-acbf80a1fadd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h"
Jul 17 05:43:37.920716 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.920694    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5473ceb4-34de-4167-9f5c-acbf80a1fadd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h\" (UID: \"5473ceb4-34de-4167-9f5c-acbf80a1fadd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h"
Jul 17 05:43:37.981089 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:37.981046    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h"
Jul 17 05:43:38.130310 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:38.130276    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h"]
Jul 17 05:43:38.132181 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:43:38.132152    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5473ceb4_34de_4167_9f5c_acbf80a1fadd.slice/crio-5b3489e03586033cc4c3d1f4eda6f4b4f6390a7c44084b18085c00f12850e096 WatchSource:0}: Error finding container 5b3489e03586033cc4c3d1f4eda6f4b4f6390a7c44084b18085c00f12850e096: Status 404 returned error can't find the container with id 5b3489e03586033cc4c3d1f4eda6f4b4f6390a7c44084b18085c00f12850e096
Jul 17 05:43:38.718678 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:38.718640    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h" event={"ID":"5473ceb4-34de-4167-9f5c-acbf80a1fadd","Type":"ContainerStarted","Data":"3086cc4d2645950c7f8997c48e68b9d10212983ade4ab33d3319cedfc50c7d49"}
Jul 17 05:43:38.719130 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:38.718695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h" event={"ID":"5473ceb4-34de-4167-9f5c-acbf80a1fadd","Type":"ContainerStarted","Data":"5b3489e03586033cc4c3d1f4eda6f4b4f6390a7c44084b18085c00f12850e096"}
Jul 17 05:43:38.736276 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:38.736167    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h" podStartSLOduration=1.736148122 podStartE2EDuration="1.736148122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:43:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:43:38.733489425 +0000 UTC m=+3253.411095774" watchObservedRunningTime="2026-07-17 05:43:38.736148122 +0000 UTC m=+3253.413754467"
Jul 17 05:43:39.726501 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:39.726470    2564 generic.go:356] "Generic (PLEG): container finished" podID="5473ceb4-34de-4167-9f5c-acbf80a1fadd" containerID="3086cc4d2645950c7f8997c48e68b9d10212983ade4ab33d3319cedfc50c7d49" exitCode=6
Jul 17 05:43:39.726995 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:39.726563    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h" event={"ID":"5473ceb4-34de-4167-9f5c-acbf80a1fadd","Type":"ContainerDied","Data":"3086cc4d2645950c7f8997c48e68b9d10212983ade4ab33d3319cedfc50c7d49"}
Jul 17 05:43:39.726995 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:39.726753    2564 scope.go:117] "RemoveContainer" containerID="3086cc4d2645950c7f8997c48e68b9d10212983ade4ab33d3319cedfc50c7d49"
Jul 17 05:43:40.734659 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:40.734607    2564 generic.go:356] "Generic (PLEG): container finished" podID="5473ceb4-34de-4167-9f5c-acbf80a1fadd" containerID="84960db6868abfdca440d8f485a529a56e3f0c7484d42e605bfe517309fdff6a" exitCode=6
Jul 17 05:43:40.735140 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:40.734660    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h" event={"ID":"5473ceb4-34de-4167-9f5c-acbf80a1fadd","Type":"ContainerDied","Data":"84960db6868abfdca440d8f485a529a56e3f0c7484d42e605bfe517309fdff6a"}
Jul 17 05:43:40.735140 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:40.734733    2564 scope.go:117] "RemoveContainer" containerID="3086cc4d2645950c7f8997c48e68b9d10212983ade4ab33d3319cedfc50c7d49"
Jul 17 05:43:40.735140 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:40.734941    2564 scope.go:117] "RemoveContainer" containerID="84960db6868abfdca440d8f485a529a56e3f0c7484d42e605bfe517309fdff6a"
Jul 17 05:43:40.735272 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:43:40.735185    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h_odh-ai-gateway-infra(5473ceb4-34de-4167-9f5c-acbf80a1fadd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h" podUID="5473ceb4-34de-4167-9f5c-acbf80a1fadd"
Jul 17 05:43:41.743215 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:41.743186    2564 scope.go:117] "RemoveContainer" containerID="84960db6868abfdca440d8f485a529a56e3f0c7484d42e605bfe517309fdff6a"
Jul 17 05:43:41.743736 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:43:41.743441    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h_odh-ai-gateway-infra(5473ceb4-34de-4167-9f5c-acbf80a1fadd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h" podUID="5473ceb4-34de-4167-9f5c-acbf80a1fadd"
Jul 17 05:43:44.631184 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:44.631148    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:43:46.436481 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.436448    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"]
Jul 17 05:43:46.436895 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.436881    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2b27d6d-93da-420e-ae2a-5a5641434482" containerName="revoke-keys"
Jul 17 05:43:46.436944 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.436897    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2b27d6d-93da-420e-ae2a-5a5641434482" containerName="revoke-keys"
Jul 17 05:43:46.436944 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.436914    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c4cab29-0651-4331-a0c1-edf456d1d233" containerName="revoke-keys"
Jul 17 05:43:46.436944 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.436920    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c4cab29-0651-4331-a0c1-edf456d1d233" containerName="revoke-keys"
Jul 17 05:43:46.437038 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.436993    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c4cab29-0651-4331-a0c1-edf456d1d233" containerName="revoke-keys"
Jul 17 05:43:46.441436 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.441418    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.444347 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.444321    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-560f5b\"/\"openshift-service-ca.crt\""
Jul 17 05:43:46.444510 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.444390    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-560f5b\"/\"kube-root-ca.crt\""
Jul 17 05:43:46.445789 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.445759    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-560f5b\"/\"default-dockercfg-zqffw\""
Jul 17 05:43:46.446056 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.446033    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-560f5b\"/\"rate-test-model-560f5b-kserve-self-signed-certs\""
Jul 17 05:43:46.450159 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.450079    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"]
Jul 17 05:43:46.468320 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.468285    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:43:46.608122 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.608081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-model-cache\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.608301 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.608138    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-home\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.608301 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.608213    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-dshm\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.608301 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.608257    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-tmp-dir\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.608301 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.608294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74b69bb8-9590-450a-82d0-ef3f388f9ee6-tls-certs\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.608469 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.608318    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn6p4\" (UniqueName: \"kubernetes.io/projected/74b69bb8-9590-450a-82d0-ef3f388f9ee6-kube-api-access-qn6p4\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.709029 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.708937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-model-cache\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.709029 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.708993    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-home\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.709029 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.709023    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-dshm\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.709305 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.709137    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-tmp-dir\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.709305 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.709187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74b69bb8-9590-450a-82d0-ef3f388f9ee6-tls-certs\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.709305 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.709204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn6p4\" (UniqueName: \"kubernetes.io/projected/74b69bb8-9590-450a-82d0-ef3f388f9ee6-kube-api-access-qn6p4\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.709466 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.709358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-model-cache\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.709466 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.709456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-home\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.709549 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.709486    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-tmp-dir\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.711684 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.711654    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-dshm\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.711810 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.711795    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74b69bb8-9590-450a-82d0-ef3f388f9ee6-tls-certs\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.718271 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.718251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn6p4\" (UniqueName: \"kubernetes.io/projected/74b69bb8-9590-450a-82d0-ef3f388f9ee6-kube-api-access-qn6p4\") pod \"rate-test-model-560f5b-kserve-794d6755f-7kc9q\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") " pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.753817 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.753785    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:46.906576 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:46.906547    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"]
Jul 17 05:43:46.908355 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:43:46.908323    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74b69bb8_9590_450a_82d0_ef3f388f9ee6.slice/crio-4b1cbac367a3699b4221a40b66f58dcd8808edd293409f6fbbfd462b45a75765 WatchSource:0}: Error finding container 4b1cbac367a3699b4221a40b66f58dcd8808edd293409f6fbbfd462b45a75765: Status 404 returned error can't find the container with id 4b1cbac367a3699b4221a40b66f58dcd8808edd293409f6fbbfd462b45a75765
Jul 17 05:43:47.782328 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:47.782282    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q" event={"ID":"74b69bb8-9590-450a-82d0-ef3f388f9ee6","Type":"ContainerStarted","Data":"2c946472ff6590738e1407db2cc704dbb6cda718039b0cf5bbc2edcc59dadd48"}
Jul 17 05:43:47.782751 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:47.782337    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q" event={"ID":"74b69bb8-9590-450a-82d0-ef3f388f9ee6","Type":"ContainerStarted","Data":"4b1cbac367a3699b4221a40b66f58dcd8808edd293409f6fbbfd462b45a75765"}
Jul 17 05:43:47.800527 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:47.800470    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q" podStartSLOduration=1.8004536290000002 podStartE2EDuration="1.800453629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 05:43:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:43:47.797176234 +0000 UTC m=+3262.474782580" watchObservedRunningTime="2026-07-17 05:43:47.800453629 +0000 UTC m=+3262.478059974"
Jul 17 05:43:47.944906 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:47.944860    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn" podUID="cb288a86-0098-40fd-b6f5-c370a50d87db" containerName="main" containerID="cri-o://99446b5047ec4bb1b2b6143d9661aacbfc92ae1b570e9dd7e6cfc7b639b75fca" gracePeriod=45
Jul 17 05:43:48.213573 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.213542    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:43:48.323541 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.323446    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-tmp-dir\") pod \"cb288a86-0098-40fd-b6f5-c370a50d87db\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") "
Jul 17 05:43:48.323541 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.323499    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb288a86-0098-40fd-b6f5-c370a50d87db-tls-certs\") pod \"cb288a86-0098-40fd-b6f5-c370a50d87db\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") "
Jul 17 05:43:48.323770 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.323559    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-model-cache\") pod \"cb288a86-0098-40fd-b6f5-c370a50d87db\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") "
Jul 17 05:43:48.323770 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.323617    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-home\") pod \"cb288a86-0098-40fd-b6f5-c370a50d87db\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") "
Jul 17 05:43:48.323770 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.323696    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d52rj\" (UniqueName: \"kubernetes.io/projected/cb288a86-0098-40fd-b6f5-c370a50d87db-kube-api-access-d52rj\") pod \"cb288a86-0098-40fd-b6f5-c370a50d87db\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") "
Jul 17 05:43:48.323770 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.323725    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-dshm\") pod \"cb288a86-0098-40fd-b6f5-c370a50d87db\" (UID: \"cb288a86-0098-40fd-b6f5-c370a50d87db\") "
Jul 17 05:43:48.323934 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.323805    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cb288a86-0098-40fd-b6f5-c370a50d87db" (UID: "cb288a86-0098-40fd-b6f5-c370a50d87db"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:43:48.323934 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.323844    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-model-cache" (OuterVolumeSpecName: "model-cache") pod "cb288a86-0098-40fd-b6f5-c370a50d87db" (UID: "cb288a86-0098-40fd-b6f5-c370a50d87db"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:43:48.324027 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.323998    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-home" (OuterVolumeSpecName: "home") pod "cb288a86-0098-40fd-b6f5-c370a50d87db" (UID: "cb288a86-0098-40fd-b6f5-c370a50d87db"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:43:48.324132 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.324109    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-tmp-dir\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:43:48.324132 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.324130    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-model-cache\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:43:48.324927 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.324140    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-home\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:43:48.325968 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.325938    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-dshm" (OuterVolumeSpecName: "dshm") pod "cb288a86-0098-40fd-b6f5-c370a50d87db" (UID: "cb288a86-0098-40fd-b6f5-c370a50d87db"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:43:48.326081 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.325979    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb288a86-0098-40fd-b6f5-c370a50d87db-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cb288a86-0098-40fd-b6f5-c370a50d87db" (UID: "cb288a86-0098-40fd-b6f5-c370a50d87db"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:43:48.326081 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.325984    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb288a86-0098-40fd-b6f5-c370a50d87db-kube-api-access-d52rj" (OuterVolumeSpecName: "kube-api-access-d52rj") pod "cb288a86-0098-40fd-b6f5-c370a50d87db" (UID: "cb288a86-0098-40fd-b6f5-c370a50d87db"). InnerVolumeSpecName "kube-api-access-d52rj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:43:48.425233 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.425197    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d52rj\" (UniqueName: \"kubernetes.io/projected/cb288a86-0098-40fd-b6f5-c370a50d87db-kube-api-access-d52rj\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:43:48.425233 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.425230    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb288a86-0098-40fd-b6f5-c370a50d87db-dshm\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:43:48.425233 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.425242    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb288a86-0098-40fd-b6f5-c370a50d87db-tls-certs\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:43:48.789881 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.789766    2564 generic.go:356] "Generic (PLEG): container finished" podID="cb288a86-0098-40fd-b6f5-c370a50d87db" containerID="99446b5047ec4bb1b2b6143d9661aacbfc92ae1b570e9dd7e6cfc7b639b75fca" exitCode=0
Jul 17 05:43:48.789881 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.789843    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"
Jul 17 05:43:48.789881 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.789858    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn" event={"ID":"cb288a86-0098-40fd-b6f5-c370a50d87db","Type":"ContainerDied","Data":"99446b5047ec4bb1b2b6143d9661aacbfc92ae1b570e9dd7e6cfc7b639b75fca"}
Jul 17 05:43:48.790463 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.789906    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn" event={"ID":"cb288a86-0098-40fd-b6f5-c370a50d87db","Type":"ContainerDied","Data":"99321bb8bc8b9a4fbb6a0142bf0afbf2a16b9a9477431974eac8bc3f83afbd0c"}
Jul 17 05:43:48.790463 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.789925    2564 scope.go:117] "RemoveContainer" containerID="99446b5047ec4bb1b2b6143d9661aacbfc92ae1b570e9dd7e6cfc7b639b75fca"
Jul 17 05:43:48.800595 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.800571    2564 scope.go:117] "RemoveContainer" containerID="99446b5047ec4bb1b2b6143d9661aacbfc92ae1b570e9dd7e6cfc7b639b75fca"
Jul 17 05:43:48.800936 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:43:48.800914    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99446b5047ec4bb1b2b6143d9661aacbfc92ae1b570e9dd7e6cfc7b639b75fca\": container with ID starting with 99446b5047ec4bb1b2b6143d9661aacbfc92ae1b570e9dd7e6cfc7b639b75fca not found: ID does not exist" containerID="99446b5047ec4bb1b2b6143d9661aacbfc92ae1b570e9dd7e6cfc7b639b75fca"
Jul 17 05:43:48.801013 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.800946    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99446b5047ec4bb1b2b6143d9661aacbfc92ae1b570e9dd7e6cfc7b639b75fca"} err="failed to get container status \"99446b5047ec4bb1b2b6143d9661aacbfc92ae1b570e9dd7e6cfc7b639b75fca\": rpc error: code = NotFound desc = could not find container \"99446b5047ec4bb1b2b6143d9661aacbfc92ae1b570e9dd7e6cfc7b639b75fca\": container with ID starting with 99446b5047ec4bb1b2b6143d9661aacbfc92ae1b570e9dd7e6cfc7b639b75fca not found: ID does not exist"
Jul 17 05:43:48.811847 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.811817    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"]
Jul 17 05:43:48.816890 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:48.816861    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-823cda/sub-test-model-823cda-kserve-6f85bf4749-g7kxn"]
Jul 17 05:43:49.858300 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:49.858258    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb288a86-0098-40fd-b6f5-c370a50d87db" path="/var/lib/kubelet/pods/cb288a86-0098-40fd-b6f5-c370a50d87db/volumes"
Jul 17 05:43:52.851837 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:52.851802    2564 scope.go:117] "RemoveContainer" containerID="84960db6868abfdca440d8f485a529a56e3f0c7484d42e605bfe517309fdff6a"
Jul 17 05:43:53.821610 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:53.821581    2564 generic.go:356] "Generic (PLEG): container finished" podID="5473ceb4-34de-4167-9f5c-acbf80a1fadd" containerID="d0a04d2587ffdcd26aede7b6709ff148a0fe63db4a3b3314db67068c05ba3591" exitCode=6
Jul 17 05:43:53.821825 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:53.821664    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h" event={"ID":"5473ceb4-34de-4167-9f5c-acbf80a1fadd","Type":"ContainerDied","Data":"d0a04d2587ffdcd26aede7b6709ff148a0fe63db4a3b3314db67068c05ba3591"}
Jul 17 05:43:53.821825 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:53.821730    2564 scope.go:117] "RemoveContainer" containerID="84960db6868abfdca440d8f485a529a56e3f0c7484d42e605bfe517309fdff6a"
Jul 17 05:43:53.822107 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:53.822090    2564 scope.go:117] "RemoveContainer" containerID="d0a04d2587ffdcd26aede7b6709ff148a0fe63db4a3b3314db67068c05ba3591"
Jul 17 05:43:53.822338 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:43:53.822321    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h_odh-ai-gateway-infra(5473ceb4-34de-4167-9f5c-acbf80a1fadd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h" podUID="5473ceb4-34de-4167-9f5c-acbf80a1fadd"
Jul 17 05:43:54.846942 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:54.846892    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h"]
Jul 17 05:43:55.019849 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:55.019818    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h"
Jul 17 05:43:55.086102 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:55.086067    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5473ceb4-34de-4167-9f5c-acbf80a1fadd-maas-api-service-ca\") pod \"5473ceb4-34de-4167-9f5c-acbf80a1fadd\" (UID: \"5473ceb4-34de-4167-9f5c-acbf80a1fadd\") "
Jul 17 05:43:55.086416 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:55.086390    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5473ceb4-34de-4167-9f5c-acbf80a1fadd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5473ceb4-34de-4167-9f5c-acbf80a1fadd" (UID: "5473ceb4-34de-4167-9f5c-acbf80a1fadd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:43:55.186976 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:55.186882    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5473ceb4-34de-4167-9f5c-acbf80a1fadd-maas-api-service-ca\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:43:55.836238 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:55.836207    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h" event={"ID":"5473ceb4-34de-4167-9f5c-acbf80a1fadd","Type":"ContainerDied","Data":"5b3489e03586033cc4c3d1f4eda6f4b4f6390a7c44084b18085c00f12850e096"}
Jul 17 05:43:55.836467 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:55.836247    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h"
Jul 17 05:43:55.836467 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:55.836268    2564 scope.go:117] "RemoveContainer" containerID="d0a04d2587ffdcd26aede7b6709ff148a0fe63db4a3b3314db67068c05ba3591"
Jul 17 05:43:55.865044 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:55.865005    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h"]
Jul 17 05:43:55.868439 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:55.868405    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9eb8486e-wlr2h"]
Jul 17 05:43:56.754180 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:56.754141    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:56.754180 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:56.754190    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:56.767325 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:56.767289    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:56.857923 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:56.857891    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:43:56.933377 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:56.933341    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:43:57.858093 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:43:57.858057    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5473ceb4-34de-4167-9f5c-acbf80a1fadd" path="/var/lib/kubelet/pods/5473ceb4-34de-4167-9f5c-acbf80a1fadd/volumes"
Jul 17 05:44:13.941035 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:44:13.941000    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:44:15.558578 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:44:15.558546    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:44:19.733515 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:44:19.733478    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:44:26.158560 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:44:26.158532    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:44:26.173977 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:44:26.173945    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:44:26.687398 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:44:26.687356    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:44:26.736647 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:44:26.736600    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:44:35.237165 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:44:35.237120    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:44:49.594350 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:44:49.594233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:44:49.695322 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:44:49.695290    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:44:54.628830 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:44:54.628782    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:44:58.365477 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:44:58.365442    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"]
Jul 17 05:44:58.384773 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:44:58.384737    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:44:59.327755 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:44:59.327714    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:00.299232 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.299192    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7748-140387092528304"]
Jul 17 05:45:00.299811 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.299790    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb288a86-0098-40fd-b6f5-c370a50d87db" containerName="main"
Jul 17 05:45:00.299811 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.299812    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb288a86-0098-40fd-b6f5-c370a50d87db" containerName="main"
Jul 17 05:45:00.299916 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.299824    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5473ceb4-34de-4167-9f5c-acbf80a1fadd" containerName="revoke-keys"
Jul 17 05:45:00.299916 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.299829    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5473ceb4-34de-4167-9f5c-acbf80a1fadd" containerName="revoke-keys"
Jul 17 05:45:00.299916 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.299839    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5473ceb4-34de-4167-9f5c-acbf80a1fadd" containerName="revoke-keys"
Jul 17 05:45:00.299916 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.299845    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5473ceb4-34de-4167-9f5c-acbf80a1fadd" containerName="revoke-keys"
Jul 17 05:45:00.299916 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.299853    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5473ceb4-34de-4167-9f5c-acbf80a1fadd" containerName="revoke-keys"
Jul 17 05:45:00.299916 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.299860    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5473ceb4-34de-4167-9f5c-acbf80a1fadd" containerName="revoke-keys"
Jul 17 05:45:00.300113 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.299938    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5473ceb4-34de-4167-9f5c-acbf80a1fadd" containerName="revoke-keys"
Jul 17 05:45:00.300113 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.299947    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5473ceb4-34de-4167-9f5c-acbf80a1fadd" containerName="revoke-keys"
Jul 17 05:45:00.300113 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.299957    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb288a86-0098-40fd-b6f5-c370a50d87db" containerName="main"
Jul 17 05:45:00.305649 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.305595    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092528304"
Jul 17 05:45:00.309346 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.308953    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qwtmc\""
Jul 17 05:45:00.309675 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.309620    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140387092528304"]
Jul 17 05:45:00.433238 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.433189    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggtdt\" (UniqueName: \"kubernetes.io/projected/80e69d1f-c6ab-4404-b623-6285505c9916-kube-api-access-ggtdt\") pod \"test-curl-7748-140387092528304\" (UID: \"80e69d1f-c6ab-4404-b623-6285505c9916\") " pod="opendatahub/test-curl-7748-140387092528304"
Jul 17 05:45:00.534787 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.534746    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggtdt\" (UniqueName: \"kubernetes.io/projected/80e69d1f-c6ab-4404-b623-6285505c9916-kube-api-access-ggtdt\") pod \"test-curl-7748-140387092528304\" (UID: \"80e69d1f-c6ab-4404-b623-6285505c9916\") " pod="opendatahub/test-curl-7748-140387092528304"
Jul 17 05:45:00.544180 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.544140    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggtdt\" (UniqueName: \"kubernetes.io/projected/80e69d1f-c6ab-4404-b623-6285505c9916-kube-api-access-ggtdt\") pod \"test-curl-7748-140387092528304\" (UID: \"80e69d1f-c6ab-4404-b623-6285505c9916\") " pod="opendatahub/test-curl-7748-140387092528304"
Jul 17 05:45:00.618121 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.618063    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092528304"
Jul 17 05:45:00.770799 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.770765    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140387092528304"]
Jul 17 05:45:00.772372 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:45:00.772341    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80e69d1f_c6ab_4404_b623_6285505c9916.slice/crio-8c23a133a31cf3a81135132ee9e2fc883694e7e57407aa7564a6ccb7403f9677 WatchSource:0}: Error finding container 8c23a133a31cf3a81135132ee9e2fc883694e7e57407aa7564a6ccb7403f9677: Status 404 returned error can't find the container with id 8c23a133a31cf3a81135132ee9e2fc883694e7e57407aa7564a6ccb7403f9677
Jul 17 05:45:00.773698 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:00.773676    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 05:45:01.235700 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:01.235659    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140387092528304" event={"ID":"80e69d1f-c6ab-4404-b623-6285505c9916","Type":"ContainerStarted","Data":"8c23a133a31cf3a81135132ee9e2fc883694e7e57407aa7564a6ccb7403f9677"}
Jul 17 05:45:01.409825 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:01.409781    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:01.509883 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:01.509847    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:02.243250 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:02.243209    2564 generic.go:356] "Generic (PLEG): container finished" podID="80e69d1f-c6ab-4404-b623-6285505c9916" containerID="8ec358b47f0aea07c3d74073a31ada50f17ba2363cf42ca16e5c944756e6b73e" exitCode=0
Jul 17 05:45:02.243443 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:02.243303    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140387092528304" event={"ID":"80e69d1f-c6ab-4404-b623-6285505c9916","Type":"ContainerDied","Data":"8ec358b47f0aea07c3d74073a31ada50f17ba2363cf42ca16e5c944756e6b73e"}
Jul 17 05:45:03.398921 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.398891    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092528304"
Jul 17 05:45:03.416943 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.416907    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7748-140387092528304_80e69d1f-c6ab-4404-b623-6285505c9916/test-curl-7748-140387092528304/0.log"
Jul 17 05:45:03.440432 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.440390    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7748-140387092528304"]
Jul 17 05:45:03.444873 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.444836    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7748-140387092528304"]
Jul 17 05:45:03.564218 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.564175    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggtdt\" (UniqueName: \"kubernetes.io/projected/80e69d1f-c6ab-4404-b623-6285505c9916-kube-api-access-ggtdt\") pod \"80e69d1f-c6ab-4404-b623-6285505c9916\" (UID: \"80e69d1f-c6ab-4404-b623-6285505c9916\") "
Jul 17 05:45:03.565306 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.565280    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7748-140387092443184"]
Jul 17 05:45:03.565762 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.565744    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e69d1f-c6ab-4404-b623-6285505c9916" containerName="test-curl-7748-140387092528304"
Jul 17 05:45:03.565843 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.565766    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e69d1f-c6ab-4404-b623-6285505c9916" containerName="test-curl-7748-140387092528304"
Jul 17 05:45:03.565900 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.565879    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5473ceb4-34de-4167-9f5c-acbf80a1fadd" containerName="revoke-keys"
Jul 17 05:45:03.565900 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.565897    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="80e69d1f-c6ab-4404-b623-6285505c9916" containerName="test-curl-7748-140387092528304"
Jul 17 05:45:03.566533 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.566506    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80e69d1f-c6ab-4404-b623-6285505c9916-kube-api-access-ggtdt" (OuterVolumeSpecName: "kube-api-access-ggtdt") pod "80e69d1f-c6ab-4404-b623-6285505c9916" (UID: "80e69d1f-c6ab-4404-b623-6285505c9916"). InnerVolumeSpecName "kube-api-access-ggtdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:45:03.576953 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.576884    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140387092443184"]
Jul 17 05:45:03.577078 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.577007    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092443184"
Jul 17 05:45:03.665067 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.665030    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rghz\" (UniqueName: \"kubernetes.io/projected/a5144c45-7222-4821-ba77-c65ee512374d-kube-api-access-9rghz\") pod \"test-curl-7748-140387092443184\" (UID: \"a5144c45-7222-4821-ba77-c65ee512374d\") " pod="opendatahub/test-curl-7748-140387092443184"
Jul 17 05:45:03.665290 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.665098    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggtdt\" (UniqueName: \"kubernetes.io/projected/80e69d1f-c6ab-4404-b623-6285505c9916-kube-api-access-ggtdt\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:45:03.766129 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.766088    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rghz\" (UniqueName: \"kubernetes.io/projected/a5144c45-7222-4821-ba77-c65ee512374d-kube-api-access-9rghz\") pod \"test-curl-7748-140387092443184\" (UID: \"a5144c45-7222-4821-ba77-c65ee512374d\") " pod="opendatahub/test-curl-7748-140387092443184"
Jul 17 05:45:03.774004 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.773967    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rghz\" (UniqueName: \"kubernetes.io/projected/a5144c45-7222-4821-ba77-c65ee512374d-kube-api-access-9rghz\") pod \"test-curl-7748-140387092443184\" (UID: \"a5144c45-7222-4821-ba77-c65ee512374d\") " pod="opendatahub/test-curl-7748-140387092443184"
Jul 17 05:45:03.858235 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.858145    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80e69d1f-c6ab-4404-b623-6285505c9916" path="/var/lib/kubelet/pods/80e69d1f-c6ab-4404-b623-6285505c9916/volumes"
Jul 17 05:45:03.887157 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:03.887119    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092443184"
Jul 17 05:45:04.035672 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:04.035642    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140387092443184"]
Jul 17 05:45:04.037386 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:45:04.037358    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5144c45_7222_4821_ba77_c65ee512374d.slice/crio-a8f52a52f129ca2593b18ed9c4b0990c0ba08c50c9ac6482f119b6c0ff7e3f3e WatchSource:0}: Error finding container a8f52a52f129ca2593b18ed9c4b0990c0ba08c50c9ac6482f119b6c0ff7e3f3e: Status 404 returned error can't find the container with id a8f52a52f129ca2593b18ed9c4b0990c0ba08c50c9ac6482f119b6c0ff7e3f3e
Jul 17 05:45:04.257504 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:04.257317    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092528304"
Jul 17 05:45:04.257504 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:04.257356    2564 scope.go:117] "RemoveContainer" containerID="8ec358b47f0aea07c3d74073a31ada50f17ba2363cf42ca16e5c944756e6b73e"
Jul 17 05:45:04.280058 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:04.258794    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140387092443184" event={"ID":"a5144c45-7222-4821-ba77-c65ee512374d","Type":"ContainerStarted","Data":"a8f52a52f129ca2593b18ed9c4b0990c0ba08c50c9ac6482f119b6c0ff7e3f3e"}
Jul 17 05:45:05.267023 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:05.266983    2564 generic.go:356] "Generic (PLEG): container finished" podID="a5144c45-7222-4821-ba77-c65ee512374d" containerID="0a23fe1b73c59d6e236607a19d9424fc8d05865ea1b418280e8684a030363aa3" exitCode=0
Jul 17 05:45:05.267501 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:05.267057    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140387092443184" event={"ID":"a5144c45-7222-4821-ba77-c65ee512374d","Type":"ContainerDied","Data":"0a23fe1b73c59d6e236607a19d9424fc8d05865ea1b418280e8684a030363aa3"}
Jul 17 05:45:05.648441 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:05.648384    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:05.750053 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:05.750012    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:06.425835 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.425799    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092443184"
Jul 17 05:45:06.444319 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.444282    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7748-140387092443184_a5144c45-7222-4821-ba77-c65ee512374d/test-curl-7748-140387092443184/0.log"
Jul 17 05:45:06.465338 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.465306    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7748-140387092443184"]
Jul 17 05:45:06.467870 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.467845    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7748-140387092443184"]
Jul 17 05:45:06.600838 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.600797    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rghz\" (UniqueName: \"kubernetes.io/projected/a5144c45-7222-4821-ba77-c65ee512374d-kube-api-access-9rghz\") pod \"a5144c45-7222-4821-ba77-c65ee512374d\" (UID: \"a5144c45-7222-4821-ba77-c65ee512374d\") "
Jul 17 05:45:06.603107 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.603075    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5144c45-7222-4821-ba77-c65ee512374d-kube-api-access-9rghz" (OuterVolumeSpecName: "kube-api-access-9rghz") pod "a5144c45-7222-4821-ba77-c65ee512374d" (UID: "a5144c45-7222-4821-ba77-c65ee512374d"). InnerVolumeSpecName "kube-api-access-9rghz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:45:06.622072 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.622025    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7748-140387092379664"]
Jul 17 05:45:06.622493 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.622479    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5144c45-7222-4821-ba77-c65ee512374d" containerName="test-curl-7748-140387092443184"
Jul 17 05:45:06.622540 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.622494    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5144c45-7222-4821-ba77-c65ee512374d" containerName="test-curl-7748-140387092443184"
Jul 17 05:45:06.622575 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.622566    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5144c45-7222-4821-ba77-c65ee512374d" containerName="test-curl-7748-140387092443184"
Jul 17 05:45:06.625497 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.625478    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092379664"
Jul 17 05:45:06.629272 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.629249    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140387092379664"]
Jul 17 05:45:06.702198 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.702158    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rghz\" (UniqueName: \"kubernetes.io/projected/a5144c45-7222-4821-ba77-c65ee512374d-kube-api-access-9rghz\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:45:06.803088 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.803043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd2v8\" (UniqueName: \"kubernetes.io/projected/26855064-c586-4bc5-830a-0bf5c0dd5aca-kube-api-access-nd2v8\") pod \"test-curl-7748-140387092379664\" (UID: \"26855064-c586-4bc5-830a-0bf5c0dd5aca\") " pod="opendatahub/test-curl-7748-140387092379664"
Jul 17 05:45:06.903806 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.903698    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd2v8\" (UniqueName: \"kubernetes.io/projected/26855064-c586-4bc5-830a-0bf5c0dd5aca-kube-api-access-nd2v8\") pod \"test-curl-7748-140387092379664\" (UID: \"26855064-c586-4bc5-830a-0bf5c0dd5aca\") " pod="opendatahub/test-curl-7748-140387092379664"
Jul 17 05:45:06.912082 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.912053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd2v8\" (UniqueName: \"kubernetes.io/projected/26855064-c586-4bc5-830a-0bf5c0dd5aca-kube-api-access-nd2v8\") pod \"test-curl-7748-140387092379664\" (UID: \"26855064-c586-4bc5-830a-0bf5c0dd5aca\") " pod="opendatahub/test-curl-7748-140387092379664"
Jul 17 05:45:06.938005 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:06.937965    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092379664"
Jul 17 05:45:07.083859 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:07.083826    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140387092379664"]
Jul 17 05:45:07.086642 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:45:07.086597    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26855064_c586_4bc5_830a_0bf5c0dd5aca.slice/crio-67418db523d83d174ff1bab35fefa9509215cdfe1b9c8ede08b1557f4b114ccd WatchSource:0}: Error finding container 67418db523d83d174ff1bab35fefa9509215cdfe1b9c8ede08b1557f4b114ccd: Status 404 returned error can't find the container with id 67418db523d83d174ff1bab35fefa9509215cdfe1b9c8ede08b1557f4b114ccd
Jul 17 05:45:07.281951 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:07.281858    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140387092379664" event={"ID":"26855064-c586-4bc5-830a-0bf5c0dd5aca","Type":"ContainerStarted","Data":"67418db523d83d174ff1bab35fefa9509215cdfe1b9c8ede08b1557f4b114ccd"}
Jul 17 05:45:07.283283 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:07.283256    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8f52a52f129ca2593b18ed9c4b0990c0ba08c50c9ac6482f119b6c0ff7e3f3e"
Jul 17 05:45:07.283283 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:07.283258    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092443184"
Jul 17 05:45:07.294208 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:45:07.294165    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7748-140387092443184\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="a5144c45-7222-4821-ba77-c65ee512374d" pod="opendatahub/test-curl-7748-140387092443184"
Jul 17 05:45:07.858848 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:07.858817    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5144c45-7222-4821-ba77-c65ee512374d" path="/var/lib/kubelet/pods/a5144c45-7222-4821-ba77-c65ee512374d/volumes"
Jul 17 05:45:08.291813 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:08.291733    2564 generic.go:356] "Generic (PLEG): container finished" podID="26855064-c586-4bc5-830a-0bf5c0dd5aca" containerID="f4348ec7a4bb3f3c454d29eae9c250c9835f86a66f134f6d35abff5d6f3f895c" exitCode=0
Jul 17 05:45:08.291813 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:08.291777    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140387092379664" event={"ID":"26855064-c586-4bc5-830a-0bf5c0dd5aca","Type":"ContainerDied","Data":"f4348ec7a4bb3f3c454d29eae9c250c9835f86a66f134f6d35abff5d6f3f895c"}
Jul 17 05:45:09.442716 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.442680    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092379664"
Jul 17 05:45:09.462108 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.462074    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7748-140387092379664_26855064-c586-4bc5-830a-0bf5c0dd5aca/test-curl-7748-140387092379664/0.log"
Jul 17 05:45:09.485169 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.485134    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7748-140387092379664"]
Jul 17 05:45:09.490230 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.490195    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7748-140387092379664"]
Jul 17 05:45:09.527112 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.527077    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nd2v8\" (UniqueName: \"kubernetes.io/projected/26855064-c586-4bc5-830a-0bf5c0dd5aca-kube-api-access-nd2v8\") pod \"26855064-c586-4bc5-830a-0bf5c0dd5aca\" (UID: \"26855064-c586-4bc5-830a-0bf5c0dd5aca\") "
Jul 17 05:45:09.529412 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.529380    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26855064-c586-4bc5-830a-0bf5c0dd5aca-kube-api-access-nd2v8" (OuterVolumeSpecName: "kube-api-access-nd2v8") pod "26855064-c586-4bc5-830a-0bf5c0dd5aca" (UID: "26855064-c586-4bc5-830a-0bf5c0dd5aca"). InnerVolumeSpecName "kube-api-access-nd2v8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:45:09.605359 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.605317    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7748-140387092379664"]
Jul 17 05:45:09.605791 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.605774    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26855064-c586-4bc5-830a-0bf5c0dd5aca" containerName="test-curl-7748-140387092379664"
Jul 17 05:45:09.605849 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.605795    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="26855064-c586-4bc5-830a-0bf5c0dd5aca" containerName="test-curl-7748-140387092379664"
Jul 17 05:45:09.605910 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.605899    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="26855064-c586-4bc5-830a-0bf5c0dd5aca" containerName="test-curl-7748-140387092379664"
Jul 17 05:45:09.609098 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.609079    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092379664"
Jul 17 05:45:09.614708 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.614681    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140387092379664"]
Jul 17 05:45:09.629012 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.628964    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldvnc\" (UniqueName: \"kubernetes.io/projected/ece5a098-bf27-402e-a7df-5da35b284c82-kube-api-access-ldvnc\") pod \"test-curl-7748-140387092379664\" (UID: \"ece5a098-bf27-402e-a7df-5da35b284c82\") " pod="opendatahub/test-curl-7748-140387092379664"
Jul 17 05:45:09.629446 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.629418    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nd2v8\" (UniqueName: \"kubernetes.io/projected/26855064-c586-4bc5-830a-0bf5c0dd5aca-kube-api-access-nd2v8\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:45:09.712874 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.712797    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:09.730269 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.730229    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldvnc\" (UniqueName: \"kubernetes.io/projected/ece5a098-bf27-402e-a7df-5da35b284c82-kube-api-access-ldvnc\") pod \"test-curl-7748-140387092379664\" (UID: \"ece5a098-bf27-402e-a7df-5da35b284c82\") " pod="opendatahub/test-curl-7748-140387092379664"
Jul 17 05:45:09.738223 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.738187    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldvnc\" (UniqueName: \"kubernetes.io/projected/ece5a098-bf27-402e-a7df-5da35b284c82-kube-api-access-ldvnc\") pod \"test-curl-7748-140387092379664\" (UID: \"ece5a098-bf27-402e-a7df-5da35b284c82\") " pod="opendatahub/test-curl-7748-140387092379664"
Jul 17 05:45:09.817617 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.817583    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:09.858781 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.858687    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26855064-c586-4bc5-830a-0bf5c0dd5aca" path="/var/lib/kubelet/pods/26855064-c586-4bc5-830a-0bf5c0dd5aca/volumes"
Jul 17 05:45:09.920579 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:09.920538    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092379664"
Jul 17 05:45:10.070828 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:10.070797    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140387092379664"]
Jul 17 05:45:10.072575 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:45:10.072544    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podece5a098_bf27_402e_a7df_5da35b284c82.slice/crio-38a46a64d78a5654ac26311ead270191d0356ed7ad80a38f9ae7e9b0d44f57d0 WatchSource:0}: Error finding container 38a46a64d78a5654ac26311ead270191d0356ed7ad80a38f9ae7e9b0d44f57d0: Status 404 returned error can't find the container with id 38a46a64d78a5654ac26311ead270191d0356ed7ad80a38f9ae7e9b0d44f57d0
Jul 17 05:45:10.305436 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:10.305338    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092379664"
Jul 17 05:45:10.305436 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:10.305382    2564 scope.go:117] "RemoveContainer" containerID="f4348ec7a4bb3f3c454d29eae9c250c9835f86a66f134f6d35abff5d6f3f895c"
Jul 17 05:45:10.306799 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:10.306620    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140387092379664" event={"ID":"ece5a098-bf27-402e-a7df-5da35b284c82","Type":"ContainerStarted","Data":"38a46a64d78a5654ac26311ead270191d0356ed7ad80a38f9ae7e9b0d44f57d0"}
Jul 17 05:45:11.315985 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:11.315939    2564 generic.go:356] "Generic (PLEG): container finished" podID="ece5a098-bf27-402e-a7df-5da35b284c82" containerID="a574a1798ff61b9b8ecce8378ae2f7ee20e09caa06a719875efbec2be9e7c14c" exitCode=0
Jul 17 05:45:11.316390 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:11.316021    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140387092379664" event={"ID":"ece5a098-bf27-402e-a7df-5da35b284c82","Type":"ContainerDied","Data":"a574a1798ff61b9b8ecce8378ae2f7ee20e09caa06a719875efbec2be9e7c14c"}
Jul 17 05:45:12.090416 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.090369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:12.478210 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.478179    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092379664"
Jul 17 05:45:12.496726 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.496697    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7748-140387092379664_ece5a098-bf27-402e-a7df-5da35b284c82/test-curl-7748-140387092379664/0.log"
Jul 17 05:45:12.519275 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.519231    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7748-140387092379664"]
Jul 17 05:45:12.521797 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.521770    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7748-140387092379664"]
Jul 17 05:45:12.557107 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.557066    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldvnc\" (UniqueName: \"kubernetes.io/projected/ece5a098-bf27-402e-a7df-5da35b284c82-kube-api-access-ldvnc\") pod \"ece5a098-bf27-402e-a7df-5da35b284c82\" (UID: \"ece5a098-bf27-402e-a7df-5da35b284c82\") "
Jul 17 05:45:12.559424 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.559385    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ece5a098-bf27-402e-a7df-5da35b284c82-kube-api-access-ldvnc" (OuterVolumeSpecName: "kube-api-access-ldvnc") pod "ece5a098-bf27-402e-a7df-5da35b284c82" (UID: "ece5a098-bf27-402e-a7df-5da35b284c82"). InnerVolumeSpecName "kube-api-access-ldvnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:45:12.640720 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.640615    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7748-140387092380672"]
Jul 17 05:45:12.641054 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.641040    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ece5a098-bf27-402e-a7df-5da35b284c82" containerName="test-curl-7748-140387092379664"
Jul 17 05:45:12.641108 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.641055    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ece5a098-bf27-402e-a7df-5da35b284c82" containerName="test-curl-7748-140387092379664"
Jul 17 05:45:12.641143 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.641135    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ece5a098-bf27-402e-a7df-5da35b284c82" containerName="test-curl-7748-140387092379664"
Jul 17 05:45:12.644349 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.644326    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092380672"
Jul 17 05:45:12.651153 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.651117    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140387092380672"]
Jul 17 05:45:12.658436 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.658404    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4sqq\" (UniqueName: \"kubernetes.io/projected/9a8ae9b9-629e-4f1c-b016-aebceeb23588-kube-api-access-s4sqq\") pod \"test-curl-7748-140387092380672\" (UID: \"9a8ae9b9-629e-4f1c-b016-aebceeb23588\") " pod="opendatahub/test-curl-7748-140387092380672"
Jul 17 05:45:12.658605 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.658453    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldvnc\" (UniqueName: \"kubernetes.io/projected/ece5a098-bf27-402e-a7df-5da35b284c82-kube-api-access-ldvnc\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:45:12.759323 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.759277    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4sqq\" (UniqueName: \"kubernetes.io/projected/9a8ae9b9-629e-4f1c-b016-aebceeb23588-kube-api-access-s4sqq\") pod \"test-curl-7748-140387092380672\" (UID: \"9a8ae9b9-629e-4f1c-b016-aebceeb23588\") " pod="opendatahub/test-curl-7748-140387092380672"
Jul 17 05:45:12.768674 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.768622    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4sqq\" (UniqueName: \"kubernetes.io/projected/9a8ae9b9-629e-4f1c-b016-aebceeb23588-kube-api-access-s4sqq\") pod \"test-curl-7748-140387092380672\" (UID: \"9a8ae9b9-629e-4f1c-b016-aebceeb23588\") " pod="opendatahub/test-curl-7748-140387092380672"
Jul 17 05:45:12.956193 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:12.956080    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092380672"
Jul 17 05:45:13.107888 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.107860    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140387092380672"]
Jul 17 05:45:13.110314 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:45:13.110281    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a8ae9b9_629e_4f1c_b016_aebceeb23588.slice/crio-e7955081c5168f4b9555d669222ef96b3de6485e34d7cbf5cadb300b2db240db WatchSource:0}: Error finding container e7955081c5168f4b9555d669222ef96b3de6485e34d7cbf5cadb300b2db240db: Status 404 returned error can't find the container with id e7955081c5168f4b9555d669222ef96b3de6485e34d7cbf5cadb300b2db240db
Jul 17 05:45:13.243763 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.243661    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:45:13.329569 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.329532    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140387092380672" event={"ID":"9a8ae9b9-629e-4f1c-b016-aebceeb23588","Type":"ContainerStarted","Data":"e7955081c5168f4b9555d669222ef96b3de6485e34d7cbf5cadb300b2db240db"}
Jul 17 05:45:13.331027 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.330999    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38a46a64d78a5654ac26311ead270191d0356ed7ad80a38f9ae7e9b0d44f57d0"
Jul 17 05:45:13.331168 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.331046    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092379664"
Jul 17 05:45:13.342262 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:45:13.342221    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7748-140387092379664\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="ece5a098-bf27-402e-a7df-5da35b284c82" pod="opendatahub/test-curl-7748-140387092379664"
Jul 17 05:45:13.388650 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.388585    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q" podUID="74b69bb8-9590-450a-82d0-ef3f388f9ee6" containerName="main" containerID="cri-o://2c946472ff6590738e1407db2cc704dbb6cda718039b0cf5bbc2edcc59dadd48" gracePeriod=45
Jul 17 05:45:13.664263 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.664233    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:45:13.666873 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:45:13.666838    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7748-140387092379664\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="ece5a098-bf27-402e-a7df-5da35b284c82" pod="opendatahub/test-curl-7748-140387092379664"
Jul 17 05:45:13.768178 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.768069    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn6p4\" (UniqueName: \"kubernetes.io/projected/74b69bb8-9590-450a-82d0-ef3f388f9ee6-kube-api-access-qn6p4\") pod \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") "
Jul 17 05:45:13.768178 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.768119    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74b69bb8-9590-450a-82d0-ef3f388f9ee6-tls-certs\") pod \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") "
Jul 17 05:45:13.768178 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.768172    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-model-cache\") pod \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") "
Jul 17 05:45:13.768448 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.768187    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-home\") pod \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") "
Jul 17 05:45:13.768448 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.768298    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-dshm\") pod \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") "
Jul 17 05:45:13.768448 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.768337    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-tmp-dir\") pod \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\" (UID: \"74b69bb8-9590-450a-82d0-ef3f388f9ee6\") "
Jul 17 05:45:13.768617 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.768453    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-home" (OuterVolumeSpecName: "home") pod "74b69bb8-9590-450a-82d0-ef3f388f9ee6" (UID: "74b69bb8-9590-450a-82d0-ef3f388f9ee6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:45:13.768617 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.768462    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-model-cache" (OuterVolumeSpecName: "model-cache") pod "74b69bb8-9590-450a-82d0-ef3f388f9ee6" (UID: "74b69bb8-9590-450a-82d0-ef3f388f9ee6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:45:13.768777 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.768718    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "74b69bb8-9590-450a-82d0-ef3f388f9ee6" (UID: "74b69bb8-9590-450a-82d0-ef3f388f9ee6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:45:13.768777 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.768751    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-model-cache\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:45:13.768777 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.768772    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-home\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:45:13.770740 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.770710    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b69bb8-9590-450a-82d0-ef3f388f9ee6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "74b69bb8-9590-450a-82d0-ef3f388f9ee6" (UID: "74b69bb8-9590-450a-82d0-ef3f388f9ee6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 05:45:13.770740 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.770731    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-dshm" (OuterVolumeSpecName: "dshm") pod "74b69bb8-9590-450a-82d0-ef3f388f9ee6" (UID: "74b69bb8-9590-450a-82d0-ef3f388f9ee6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 05:45:13.770918 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.770735    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74b69bb8-9590-450a-82d0-ef3f388f9ee6-kube-api-access-qn6p4" (OuterVolumeSpecName: "kube-api-access-qn6p4") pod "74b69bb8-9590-450a-82d0-ef3f388f9ee6" (UID: "74b69bb8-9590-450a-82d0-ef3f388f9ee6"). InnerVolumeSpecName "kube-api-access-qn6p4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:45:13.861462 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.861421    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ece5a098-bf27-402e-a7df-5da35b284c82" path="/var/lib/kubelet/pods/ece5a098-bf27-402e-a7df-5da35b284c82/volumes"
Jul 17 05:45:13.869824 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.869590    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn6p4\" (UniqueName: \"kubernetes.io/projected/74b69bb8-9590-450a-82d0-ef3f388f9ee6-kube-api-access-qn6p4\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:45:13.869824 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.869620    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74b69bb8-9590-450a-82d0-ef3f388f9ee6-tls-certs\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:45:13.869824 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.869659    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-dshm\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:45:13.869824 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:13.869667    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74b69bb8-9590-450a-82d0-ef3f388f9ee6-tmp-dir\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:45:14.340034 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:14.339999    2564 generic.go:356] "Generic (PLEG): container finished" podID="74b69bb8-9590-450a-82d0-ef3f388f9ee6" containerID="2c946472ff6590738e1407db2cc704dbb6cda718039b0cf5bbc2edcc59dadd48" exitCode=0
Jul 17 05:45:14.340324 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:14.340044    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"
Jul 17 05:45:14.340324 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:14.340082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q" event={"ID":"74b69bb8-9590-450a-82d0-ef3f388f9ee6","Type":"ContainerDied","Data":"2c946472ff6590738e1407db2cc704dbb6cda718039b0cf5bbc2edcc59dadd48"}
Jul 17 05:45:14.340324 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:14.340126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q" event={"ID":"74b69bb8-9590-450a-82d0-ef3f388f9ee6","Type":"ContainerDied","Data":"4b1cbac367a3699b4221a40b66f58dcd8808edd293409f6fbbfd462b45a75765"}
Jul 17 05:45:14.340324 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:14.340148    2564 scope.go:117] "RemoveContainer" containerID="2c946472ff6590738e1407db2cc704dbb6cda718039b0cf5bbc2edcc59dadd48"
Jul 17 05:45:14.342107 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:14.342075    2564 generic.go:356] "Generic (PLEG): container finished" podID="9a8ae9b9-629e-4f1c-b016-aebceeb23588" containerID="d92c38fb255961419be26184461e0a7cc4901f96c868052694d83422a5925896" exitCode=0
Jul 17 05:45:14.342231 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:14.342144    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140387092380672" event={"ID":"9a8ae9b9-629e-4f1c-b016-aebceeb23588","Type":"ContainerDied","Data":"d92c38fb255961419be26184461e0a7cc4901f96c868052694d83422a5925896"}
Jul 17 05:45:14.352264 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:14.352237    2564 scope.go:117] "RemoveContainer" containerID="2c946472ff6590738e1407db2cc704dbb6cda718039b0cf5bbc2edcc59dadd48"
Jul 17 05:45:14.352696 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:45:14.352674    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c946472ff6590738e1407db2cc704dbb6cda718039b0cf5bbc2edcc59dadd48\": container with ID starting with 2c946472ff6590738e1407db2cc704dbb6cda718039b0cf5bbc2edcc59dadd48 not found: ID does not exist" containerID="2c946472ff6590738e1407db2cc704dbb6cda718039b0cf5bbc2edcc59dadd48"
Jul 17 05:45:14.352761 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:14.352704    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c946472ff6590738e1407db2cc704dbb6cda718039b0cf5bbc2edcc59dadd48"} err="failed to get container status \"2c946472ff6590738e1407db2cc704dbb6cda718039b0cf5bbc2edcc59dadd48\": rpc error: code = NotFound desc = could not find container \"2c946472ff6590738e1407db2cc704dbb6cda718039b0cf5bbc2edcc59dadd48\": container with ID starting with 2c946472ff6590738e1407db2cc704dbb6cda718039b0cf5bbc2edcc59dadd48 not found: ID does not exist"
Jul 17 05:45:14.371582 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:14.371538    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"]
Jul 17 05:45:14.375588 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:14.375555    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-560f5b/rate-test-model-560f5b-kserve-794d6755f-7kc9q"]
Jul 17 05:45:15.517292 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.517259    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092380672"
Jul 17 05:45:15.537848 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.537821    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7748-140387092380672_9a8ae9b9-629e-4f1c-b016-aebceeb23588/test-curl-7748-140387092380672/0.log"
Jul 17 05:45:15.559649 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.559594    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7748-140387092380672"]
Jul 17 05:45:15.563813 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.563782    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7748-140387092380672"]
Jul 17 05:45:15.587130 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.587084    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4sqq\" (UniqueName: \"kubernetes.io/projected/9a8ae9b9-629e-4f1c-b016-aebceeb23588-kube-api-access-s4sqq\") pod \"9a8ae9b9-629e-4f1c-b016-aebceeb23588\" (UID: \"9a8ae9b9-629e-4f1c-b016-aebceeb23588\") "
Jul 17 05:45:15.589455 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.589422    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a8ae9b9-629e-4f1c-b016-aebceeb23588-kube-api-access-s4sqq" (OuterVolumeSpecName: "kube-api-access-s4sqq") pod "9a8ae9b9-629e-4f1c-b016-aebceeb23588" (UID: "9a8ae9b9-629e-4f1c-b016-aebceeb23588"). InnerVolumeSpecName "kube-api-access-s4sqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:45:15.682747 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.682620    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7748-140387092380672"]
Jul 17 05:45:15.683326 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.683303    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b69bb8-9590-450a-82d0-ef3f388f9ee6" containerName="main"
Jul 17 05:45:15.683374 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.683330    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b69bb8-9590-450a-82d0-ef3f388f9ee6" containerName="main"
Jul 17 05:45:15.683374 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.683358    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a8ae9b9-629e-4f1c-b016-aebceeb23588" containerName="test-curl-7748-140387092380672"
Jul 17 05:45:15.683374 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.683369    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a8ae9b9-629e-4f1c-b016-aebceeb23588" containerName="test-curl-7748-140387092380672"
Jul 17 05:45:15.683503 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.683489    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b69bb8-9590-450a-82d0-ef3f388f9ee6" containerName="main"
Jul 17 05:45:15.683540 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.683510    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a8ae9b9-629e-4f1c-b016-aebceeb23588" containerName="test-curl-7748-140387092380672"
Jul 17 05:45:15.687470 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.687431    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092380672"
Jul 17 05:45:15.688902 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.688867    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4sqq\" (UniqueName: \"kubernetes.io/projected/9a8ae9b9-629e-4f1c-b016-aebceeb23588-kube-api-access-s4sqq\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:45:15.692132 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.692091    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140387092380672"]
Jul 17 05:45:15.789770 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.789729    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d92t\" (UniqueName: \"kubernetes.io/projected/cc0b0ee8-ffb4-451d-b538-b2578543ecb5-kube-api-access-9d92t\") pod \"test-curl-7748-140387092380672\" (UID: \"cc0b0ee8-ffb4-451d-b538-b2578543ecb5\") " pod="opendatahub/test-curl-7748-140387092380672"
Jul 17 05:45:15.858910 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.858874    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74b69bb8-9590-450a-82d0-ef3f388f9ee6" path="/var/lib/kubelet/pods/74b69bb8-9590-450a-82d0-ef3f388f9ee6/volumes"
Jul 17 05:45:15.859246 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.859233    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a8ae9b9-629e-4f1c-b016-aebceeb23588" path="/var/lib/kubelet/pods/9a8ae9b9-629e-4f1c-b016-aebceeb23588/volumes"
Jul 17 05:45:15.891103 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.891069    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d92t\" (UniqueName: \"kubernetes.io/projected/cc0b0ee8-ffb4-451d-b538-b2578543ecb5-kube-api-access-9d92t\") pod \"test-curl-7748-140387092380672\" (UID: \"cc0b0ee8-ffb4-451d-b538-b2578543ecb5\") " pod="opendatahub/test-curl-7748-140387092380672"
Jul 17 05:45:15.900664 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:15.900605    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d92t\" (UniqueName: \"kubernetes.io/projected/cc0b0ee8-ffb4-451d-b538-b2578543ecb5-kube-api-access-9d92t\") pod \"test-curl-7748-140387092380672\" (UID: \"cc0b0ee8-ffb4-451d-b538-b2578543ecb5\") " pod="opendatahub/test-curl-7748-140387092380672"
Jul 17 05:45:16.001664 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:16.001538    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092380672"
Jul 17 05:45:16.156465 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:16.156435    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140387092380672"]
Jul 17 05:45:16.157904 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:45:16.157876    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc0b0ee8_ffb4_451d_b538_b2578543ecb5.slice/crio-07031ea4d83e8dda6f19bc5d43c6780d02b0e6e69fe29a83db8705c67e8b3e82 WatchSource:0}: Error finding container 07031ea4d83e8dda6f19bc5d43c6780d02b0e6e69fe29a83db8705c67e8b3e82: Status 404 returned error can't find the container with id 07031ea4d83e8dda6f19bc5d43c6780d02b0e6e69fe29a83db8705c67e8b3e82
Jul 17 05:45:16.356968 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:16.356932    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140387092380672" event={"ID":"cc0b0ee8-ffb4-451d-b538-b2578543ecb5","Type":"ContainerStarted","Data":"07031ea4d83e8dda6f19bc5d43c6780d02b0e6e69fe29a83db8705c67e8b3e82"}
Jul 17 05:45:16.358229 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:16.358208    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092380672"
Jul 17 05:45:16.358381 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:16.358239    2564 scope.go:117] "RemoveContainer" containerID="d92c38fb255961419be26184461e0a7cc4901f96c868052694d83422a5925896"
Jul 17 05:45:17.365303 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:17.365264    2564 generic.go:356] "Generic (PLEG): container finished" podID="cc0b0ee8-ffb4-451d-b538-b2578543ecb5" containerID="e4b53b1eb7ea3733e0ef732e5d76fe0d7d766002131a1a2779e6b63c4b4007b9" exitCode=0
Jul 17 05:45:17.365830 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:17.365357    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140387092380672" event={"ID":"cc0b0ee8-ffb4-451d-b538-b2578543ecb5","Type":"ContainerDied","Data":"e4b53b1eb7ea3733e0ef732e5d76fe0d7d766002131a1a2779e6b63c4b4007b9"}
Jul 17 05:45:18.522975 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.522949    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092380672"
Jul 17 05:45:18.542006 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.541972    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7748-140387092380672_cc0b0ee8-ffb4-451d-b538-b2578543ecb5/test-curl-7748-140387092380672/0.log"
Jul 17 05:45:18.565882 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.565852    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7748-140387092380672"]
Jul 17 05:45:18.570044 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.570016    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7748-140387092380672"]
Jul 17 05:45:18.616920 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.616883    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d92t\" (UniqueName: \"kubernetes.io/projected/cc0b0ee8-ffb4-451d-b538-b2578543ecb5-kube-api-access-9d92t\") pod \"cc0b0ee8-ffb4-451d-b538-b2578543ecb5\" (UID: \"cc0b0ee8-ffb4-451d-b538-b2578543ecb5\") "
Jul 17 05:45:18.619289 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.619259    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc0b0ee8-ffb4-451d-b538-b2578543ecb5-kube-api-access-9d92t" (OuterVolumeSpecName: "kube-api-access-9d92t") pod "cc0b0ee8-ffb4-451d-b538-b2578543ecb5" (UID: "cc0b0ee8-ffb4-451d-b538-b2578543ecb5"). InnerVolumeSpecName "kube-api-access-9d92t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 05:45:18.717810 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.717764    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d92t\" (UniqueName: \"kubernetes.io/projected/cc0b0ee8-ffb4-451d-b538-b2578543ecb5-kube-api-access-9d92t\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:45:18.743459 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.743416    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8"]
Jul 17 05:45:18.743869 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.743854    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc0b0ee8-ffb4-451d-b538-b2578543ecb5" containerName="test-curl-7748-140387092380672"
Jul 17 05:45:18.743909 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.743873    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc0b0ee8-ffb4-451d-b538-b2578543ecb5" containerName="test-curl-7748-140387092380672"
Jul 17 05:45:18.743958 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.743949    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc0b0ee8-ffb4-451d-b538-b2578543ecb5" containerName="test-curl-7748-140387092380672"
Jul 17 05:45:18.747125 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.747106    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8"
Jul 17 05:45:18.749922 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.749869    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 05:45:18.750305 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.750281    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qh8zj\""
Jul 17 05:45:18.753488 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.753462    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8"]
Jul 17 05:45:18.818836 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.818785    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/694ab3d5-06b1-4af8-9ac6-da9e9a1999de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8\" (UID: \"694ab3d5-06b1-4af8-9ac6-da9e9a1999de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8"
Jul 17 05:45:18.920412 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.920320    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/694ab3d5-06b1-4af8-9ac6-da9e9a1999de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8\" (UID: \"694ab3d5-06b1-4af8-9ac6-da9e9a1999de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8"
Jul 17 05:45:18.921078 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:18.921059    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/694ab3d5-06b1-4af8-9ac6-da9e9a1999de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8\" (UID: \"694ab3d5-06b1-4af8-9ac6-da9e9a1999de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8"
Jul 17 05:45:19.060037 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:19.059999    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8"
Jul 17 05:45:19.217941 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:19.217914    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8"]
Jul 17 05:45:19.220040 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:45:19.220009    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694ab3d5_06b1_4af8_9ac6_da9e9a1999de.slice/crio-e39ed4797f7d66acda8441b78fabd1c8a313d7aa991348f72f2a54f48a35db7a WatchSource:0}: Error finding container e39ed4797f7d66acda8441b78fabd1c8a313d7aa991348f72f2a54f48a35db7a: Status 404 returned error can't find the container with id e39ed4797f7d66acda8441b78fabd1c8a313d7aa991348f72f2a54f48a35db7a
Jul 17 05:45:19.318120 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:19.318064    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:19.381588 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:19.381554    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140387092380672"
Jul 17 05:45:19.381801 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:19.381596    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07031ea4d83e8dda6f19bc5d43c6780d02b0e6e69fe29a83db8705c67e8b3e82"
Jul 17 05:45:19.383154 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:19.383128    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8" event={"ID":"694ab3d5-06b1-4af8-9ac6-da9e9a1999de","Type":"ContainerStarted","Data":"e39ed4797f7d66acda8441b78fabd1c8a313d7aa991348f72f2a54f48a35db7a"}
Jul 17 05:45:19.391826 ip-10-0-129-234 kubenswrapper[2564]: E0717 05:45:19.391795    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7748-140387092380672\" is forbidden: User \"system:node:ip-10-0-129-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-234.ec2.internal' and this object" podUID="cc0b0ee8-ffb4-451d-b538-b2578543ecb5" pod="opendatahub/test-curl-7748-140387092380672"
Jul 17 05:45:19.418656 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:19.418601    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:19.857829 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:19.857794    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc0b0ee8-ffb4-451d-b538-b2578543ecb5" path="/var/lib/kubelet/pods/cc0b0ee8-ffb4-451d-b538-b2578543ecb5/volumes"
Jul 17 05:45:20.390801 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:20.390772    2564 generic.go:356] "Generic (PLEG): container finished" podID="694ab3d5-06b1-4af8-9ac6-da9e9a1999de" containerID="098165c5318e9faec7dab9fa0d7263a4613cf3a286058a35ade46fe22338371d" exitCode=0
Jul 17 05:45:20.391007 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:20.390863    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8" event={"ID":"694ab3d5-06b1-4af8-9ac6-da9e9a1999de","Type":"ContainerDied","Data":"098165c5318e9faec7dab9fa0d7263a4613cf3a286058a35ade46fe22338371d"}
Jul 17 05:45:21.558537 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:21.558513    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8"
Jul 17 05:45:21.648589 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:21.648498    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/694ab3d5-06b1-4af8-9ac6-da9e9a1999de-maas-api-service-ca\") pod \"694ab3d5-06b1-4af8-9ac6-da9e9a1999de\" (UID: \"694ab3d5-06b1-4af8-9ac6-da9e9a1999de\") "
Jul 17 05:45:21.648936 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:21.648910    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/694ab3d5-06b1-4af8-9ac6-da9e9a1999de-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "694ab3d5-06b1-4af8-9ac6-da9e9a1999de" (UID: "694ab3d5-06b1-4af8-9ac6-da9e9a1999de"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 05:45:21.749294 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:21.749255    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/694ab3d5-06b1-4af8-9ac6-da9e9a1999de-maas-api-service-ca\") on node \"ip-10-0-129-234.ec2.internal\" DevicePath \"\""
Jul 17 05:45:22.410478 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:22.410440    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8" event={"ID":"694ab3d5-06b1-4af8-9ac6-da9e9a1999de","Type":"ContainerDied","Data":"e39ed4797f7d66acda8441b78fabd1c8a313d7aa991348f72f2a54f48a35db7a"}
Jul 17 05:45:22.410478 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:22.410460    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8"
Jul 17 05:45:22.410735 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:22.410517    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e39ed4797f7d66acda8441b78fabd1c8a313d7aa991348f72f2a54f48a35db7a"
Jul 17 05:45:22.794141 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:22.794029    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:29.257245 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:29.257207    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:32.827643 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:32.827600    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:45:33.840221 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:33.840186    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:39.723195 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:39.723152    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:39.824536 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:39.824500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:44.536995 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:44.536944    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:44.779025 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:44.778982    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:45.544715 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:45.544683    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:45.645251 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:45.645214    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:55.342747 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:55.342694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:45:58.522832 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:58.522794    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gqzpc"]
Jul 17 05:45:59.987744 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:45:59.987707    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:46:05.677338 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:05.677305    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:46:05.731659 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:05.731597    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:46:10.675640 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:10.675582    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:46:10.911537 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:10.911497    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:46:16.842005 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:16.841919    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-sqpxm_b40a61e0-5e08-4672-b57e-52450ab0129b/manager/0.log"
Jul 17 05:46:16.968140 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:16.968102    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7jcdx_8ee17883-7f0b-4375-94ae-2d23ced919e1/manager/0.log"
Jul 17 05:46:17.231153 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:17.231080    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jwzth_548a08cb-f2ee-4702-b2f6-b9950026d9a5/server/0.log"
Jul 17 05:46:17.355145 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:17.355113    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-khxfg_f6fb8750-19d6-4a15-bb1f-9f913f2a2401/manager/0.log"
Jul 17 05:46:17.476605 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:17.476570    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d857c78d5-9js2d_8a936fef-cc34-438a-92ff-7e0a47752ab5/copy-manifests/0.log"
Jul 17 05:46:17.482643 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:17.482569    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d857c78d5-9js2d_8a936fef-cc34-438a-92ff-7e0a47752ab5/manager/0.log"
Jul 17 05:46:19.351483 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:19.351446    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-e73f00c0-m6rrk_5dfebe5f-034f-4327-9069-c17581f632e4/revoke-keys/0.log"
Jul 17 05:46:19.460690 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:19.460648    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-560f5b-vs4t8_694ab3d5-06b1-4af8-9ac6-da9e9a1999de/revoke-keys/0.log"
Jul 17 05:46:20.461562 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:20.461519    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d_652576b9-bff6-4f07-ac33-549f81b60e6e/util/0.log"
Jul 17 05:46:20.467590 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:20.467566    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d_652576b9-bff6-4f07-ac33-549f81b60e6e/pull/0.log"
Jul 17 05:46:20.473282 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:20.473259    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d_652576b9-bff6-4f07-ac33-549f81b60e6e/extract/0.log"
Jul 17 05:46:20.588925 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:20.588895    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl_305d4762-12b2-4176-95a9-513fa9be21ea/util/0.log"
Jul 17 05:46:20.594644 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:20.594599    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl_305d4762-12b2-4176-95a9-513fa9be21ea/pull/0.log"
Jul 17 05:46:20.600525 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:20.600499    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl_305d4762-12b2-4176-95a9-513fa9be21ea/extract/0.log"
Jul 17 05:46:20.715091 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:20.715012    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz_1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3/util/0.log"
Jul 17 05:46:20.720433 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:20.720409    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz_1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3/pull/0.log"
Jul 17 05:46:20.725907 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:20.725883    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz_1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3/extract/0.log"
Jul 17 05:46:20.838701 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:20.838664    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg_2206c2b2-4832-4a8a-94bf-1ba65f6ec917/util/0.log"
Jul 17 05:46:20.845030 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:20.844999    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg_2206c2b2-4832-4a8a-94bf-1ba65f6ec917/pull/0.log"
Jul 17 05:46:20.851107 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:20.851065    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg_2206c2b2-4832-4a8a-94bf-1ba65f6ec917/extract/0.log"
Jul 17 05:46:21.095809 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:21.095764    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-v7nvc_b23af8c8-0ba5-4957-b45d-4cd4420c3c86/manager/0.log"
Jul 17 05:46:21.207360 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:21.207313    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-m2xcg_9d212d3b-5988-49a0-ae25-f3a86336ba3f/manager/0.log"
Jul 17 05:46:21.321073 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:21.321039    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zm7gq_42bcb6e8-91ca-47d1-818e-f664423bba51/kuadrant-console-plugin/0.log"
Jul 17 05:46:21.438026 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:21.437940    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dcb89_db5fdb6b-7eb4-4fd1-b6e1-c46e72497176/registry-server/0.log"
Jul 17 05:46:21.561457 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:21.561418    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-28hw6_72aee62a-7824-4d23-905e-fbbc59a9c2d6/manager/0.log"
Jul 17 05:46:21.688446 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:21.688374    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gqzpc_8cb95a74-9ee6-41e4-9027-837d24c4d4dd/limitador/0.log"
Jul 17 05:46:21.812280 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:21.812243    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-chhjn_2cbf602b-ccb7-4d82-a282-efd4dd0c8ff9/manager/0.log"
Jul 17 05:46:22.170182 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:22.170142    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678lnzm8_c159e604-d698-4dbc-8a34-9dbb21687c4f/istio-proxy/0.log"
Jul 17 05:46:22.409616 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:22.409581    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d686d4c64-7nnrt_0f802622-b57b-4356-8db1-f13d06156a56/kube-auth-proxy/0.log"
Jul 17 05:46:23.015750 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:23.015715    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-679d5646-wtsmz_4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642/router/0.log"
Jul 17 05:46:23.580999 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:23.580970    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-bf7n4_a56bf6b6-368b-46f8-b4c9-67b7b9047fcc/main/0.log"
Jul 17 05:46:23.907163 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:23.907071    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-pkh9p_66be40f8-52db-46a2-a19e-453fd4207026/main/0.log"
Jul 17 05:46:29.467574 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:29.467536    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:46:29.564375 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:29.564333    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log" limit=1024
Jul 17 05:46:32.341688 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:32.341654    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tr4jx_cd3883fe-1e59-474f-aa19-3b3fae77ab85/global-pull-secret-syncer/0.log"
Jul 17 05:46:32.394587 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:32.394549    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cvz5q_cb83c3ec-3edd-47c8-8ac9-c0a227dbbfa6/konnectivity-agent/0.log"
Jul 17 05:46:32.498808 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:32.498772    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-234.ec2.internal_f00b257fb549beca1ce15bbf5a89e032/haproxy/0.log"
Jul 17 05:46:36.729317 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:36.729218    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d_652576b9-bff6-4f07-ac33-549f81b60e6e/extract/0.log"
Jul 17 05:46:36.751478 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:36.751445    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d_652576b9-bff6-4f07-ac33-549f81b60e6e/util/0.log"
Jul 17 05:46:36.773018 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:36.772979    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7j5d_652576b9-bff6-4f07-ac33-549f81b60e6e/pull/0.log"
Jul 17 05:46:36.807380 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:36.807353    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl_305d4762-12b2-4176-95a9-513fa9be21ea/extract/0.log"
Jul 17 05:46:36.828618 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:36.828585    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl_305d4762-12b2-4176-95a9-513fa9be21ea/util/0.log"
Jul 17 05:46:36.852489 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:36.852456    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04swgl_305d4762-12b2-4176-95a9-513fa9be21ea/pull/0.log"
Jul 17 05:46:36.883372 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:36.883346    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz_1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3/extract/0.log"
Jul 17 05:46:36.910169 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:36.910131    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz_1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3/util/0.log"
Jul 17 05:46:36.931815 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:36.931785    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r9blz_1dc2f1d2-2d7e-4684-9de6-da5bbb3bc6d3/pull/0.log"
Jul 17 05:46:36.974577 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:36.974533    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg_2206c2b2-4832-4a8a-94bf-1ba65f6ec917/extract/0.log"
Jul 17 05:46:36.997395 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:36.997313    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg_2206c2b2-4832-4a8a-94bf-1ba65f6ec917/util/0.log"
Jul 17 05:46:37.018848 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:37.018816    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15l6tg_2206c2b2-4832-4a8a-94bf-1ba65f6ec917/pull/0.log"
Jul 17 05:46:37.433237 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:37.433209    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-v7nvc_b23af8c8-0ba5-4957-b45d-4cd4420c3c86/manager/0.log"
Jul 17 05:46:37.467131 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:37.467096    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-m2xcg_9d212d3b-5988-49a0-ae25-f3a86336ba3f/manager/0.log"
Jul 17 05:46:37.493712 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:37.493681    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zm7gq_42bcb6e8-91ca-47d1-818e-f664423bba51/kuadrant-console-plugin/0.log"
Jul 17 05:46:37.542075 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:37.542032    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dcb89_db5fdb6b-7eb4-4fd1-b6e1-c46e72497176/registry-server/0.log"
Jul 17 05:46:37.708107 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:37.708012    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-28hw6_72aee62a-7824-4d23-905e-fbbc59a9c2d6/manager/0.log"
Jul 17 05:46:37.740226 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:37.740195    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gqzpc_8cb95a74-9ee6-41e4-9027-837d24c4d4dd/limitador/0.log"
Jul 17 05:46:37.807008 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:37.806970    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-chhjn_2cbf602b-ccb7-4d82-a282-efd4dd0c8ff9/manager/0.log"
Jul 17 05:46:39.522269 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:39.522225    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-9tn2p_aceeef42-5510-49c6-a843-be129763ac26/cluster-monitoring-operator/0.log"
Jul 17 05:46:39.852842 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:39.852811    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m456p_cc280032-e0dc-48ed-b5a3-cfebbf0a02e7/node-exporter/0.log"
Jul 17 05:46:39.872723 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:39.872691    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m456p_cc280032-e0dc-48ed-b5a3-cfebbf0a02e7/kube-rbac-proxy/0.log"
Jul 17 05:46:39.893708 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:39.893679    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m456p_cc280032-e0dc-48ed-b5a3-cfebbf0a02e7/init-textfile/0.log"
Jul 17 05:46:40.252210 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:40.252128    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-844877ccdd-qj7dw_22b6f2f5-4e52-491b-8340-78ab30c1e791/telemeter-client/0.log"
Jul 17 05:46:40.274248 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:40.274218    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-844877ccdd-qj7dw_22b6f2f5-4e52-491b-8340-78ab30c1e791/reload/0.log"
Jul 17 05:46:40.296004 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:40.295973    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-844877ccdd-qj7dw_22b6f2f5-4e52-491b-8340-78ab30c1e791/kube-rbac-proxy/0.log"
Jul 17 05:46:41.681919 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:41.681888    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-dqwqx_1d3b10ca-d653-46e0-9d9a-4e9ff21f2b22/networking-console-plugin/0.log"
Jul 17 05:46:42.256387 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.256361    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/1.log"
Jul 17 05:46:42.261457 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.261427    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-6g55g_529078b2-2d39-4be8-a551-d6497714270f/console-operator/2.log"
Jul 17 05:46:42.516468 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.516375    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"]
Jul 17 05:46:42.516878 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.516864    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694ab3d5-06b1-4af8-9ac6-da9e9a1999de" containerName="revoke-keys"
Jul 17 05:46:42.516928 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.516880    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="694ab3d5-06b1-4af8-9ac6-da9e9a1999de" containerName="revoke-keys"
Jul 17 05:46:42.516967 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.516948    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="694ab3d5-06b1-4af8-9ac6-da9e9a1999de" containerName="revoke-keys"
Jul 17 05:46:42.520188 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.520168    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.522886 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.522860    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fvgtg\"/\"openshift-service-ca.crt\""
Jul 17 05:46:42.523056 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.522860    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fvgtg\"/\"default-dockercfg-78785\""
Jul 17 05:46:42.524045 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.524027    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fvgtg\"/\"kube-root-ca.crt\""
Jul 17 05:46:42.529428 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.529396    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"]
Jul 17 05:46:42.695817 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.695776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/280d3014-24f1-433b-9f42-4be40384d9b1-sys\") pod \"perf-node-gather-daemonset-8m2sb\" (UID: \"280d3014-24f1-433b-9f42-4be40384d9b1\") " pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.695817 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.695823    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/280d3014-24f1-433b-9f42-4be40384d9b1-proc\") pod \"perf-node-gather-daemonset-8m2sb\" (UID: \"280d3014-24f1-433b-9f42-4be40384d9b1\") " pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.696248 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.695845    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/280d3014-24f1-433b-9f42-4be40384d9b1-podres\") pod \"perf-node-gather-daemonset-8m2sb\" (UID: \"280d3014-24f1-433b-9f42-4be40384d9b1\") " pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.696248 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.695918    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/280d3014-24f1-433b-9f42-4be40384d9b1-lib-modules\") pod \"perf-node-gather-daemonset-8m2sb\" (UID: \"280d3014-24f1-433b-9f42-4be40384d9b1\") " pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.696248 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.695964    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t6g7\" (UniqueName: \"kubernetes.io/projected/280d3014-24f1-433b-9f42-4be40384d9b1-kube-api-access-4t6g7\") pod \"perf-node-gather-daemonset-8m2sb\" (UID: \"280d3014-24f1-433b-9f42-4be40384d9b1\") " pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.796763 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.796663    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/280d3014-24f1-433b-9f42-4be40384d9b1-sys\") pod \"perf-node-gather-daemonset-8m2sb\" (UID: \"280d3014-24f1-433b-9f42-4be40384d9b1\") " pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.796763 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.796711    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/280d3014-24f1-433b-9f42-4be40384d9b1-proc\") pod \"perf-node-gather-daemonset-8m2sb\" (UID: \"280d3014-24f1-433b-9f42-4be40384d9b1\") " pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.796763 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.796731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/280d3014-24f1-433b-9f42-4be40384d9b1-podres\") pod \"perf-node-gather-daemonset-8m2sb\" (UID: \"280d3014-24f1-433b-9f42-4be40384d9b1\") " pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.796763 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.796755    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/280d3014-24f1-433b-9f42-4be40384d9b1-lib-modules\") pod \"perf-node-gather-daemonset-8m2sb\" (UID: \"280d3014-24f1-433b-9f42-4be40384d9b1\") " pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.797020 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.796783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t6g7\" (UniqueName: \"kubernetes.io/projected/280d3014-24f1-433b-9f42-4be40384d9b1-kube-api-access-4t6g7\") pod \"perf-node-gather-daemonset-8m2sb\" (UID: \"280d3014-24f1-433b-9f42-4be40384d9b1\") " pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.797020 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.796788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/280d3014-24f1-433b-9f42-4be40384d9b1-sys\") pod \"perf-node-gather-daemonset-8m2sb\" (UID: \"280d3014-24f1-433b-9f42-4be40384d9b1\") " pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.797020 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.796828    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/280d3014-24f1-433b-9f42-4be40384d9b1-proc\") pod \"perf-node-gather-daemonset-8m2sb\" (UID: \"280d3014-24f1-433b-9f42-4be40384d9b1\") " pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.797020 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.796906    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/280d3014-24f1-433b-9f42-4be40384d9b1-podres\") pod \"perf-node-gather-daemonset-8m2sb\" (UID: \"280d3014-24f1-433b-9f42-4be40384d9b1\") " pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.797020 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.796926    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/280d3014-24f1-433b-9f42-4be40384d9b1-lib-modules\") pod \"perf-node-gather-daemonset-8m2sb\" (UID: \"280d3014-24f1-433b-9f42-4be40384d9b1\") " pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.804473 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.804448    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t6g7\" (UniqueName: \"kubernetes.io/projected/280d3014-24f1-433b-9f42-4be40384d9b1-kube-api-access-4t6g7\") pod \"perf-node-gather-daemonset-8m2sb\" (UID: \"280d3014-24f1-433b-9f42-4be40384d9b1\") " pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.831695 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.831599    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:42.848360 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.848312    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b9cb6c7c7-wgq8l_94fc73fa-b0ee-4010-a3ae-fd6c8e30e647/console/0.log"
Jul 17 05:46:42.886556 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.886512    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-7fbkb_4684caf4-6f80-400e-8c2e-c07bb84e46a8/download-server/0.log"
Jul 17 05:46:42.984549 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:42.984523    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"]
Jul 17 05:46:42.986201 ip-10-0-129-234 kubenswrapper[2564]: W0717 05:46:42.986165    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod280d3014_24f1_433b_9f42_4be40384d9b1.slice/crio-d67ab571cd49f104983ab5576fd3337cbae73d07f4f5b6d21b1248df4044750a WatchSource:0}: Error finding container d67ab571cd49f104983ab5576fd3337cbae73d07f4f5b6d21b1248df4044750a: Status 404 returned error can't find the container with id d67ab571cd49f104983ab5576fd3337cbae73d07f4f5b6d21b1248df4044750a
Jul 17 05:46:43.534686 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:43.534580    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-8hmbn_ea2b2703-55cb-4be9-84eb-262ca6513eb7/volume-data-source-validator/0.log"
Jul 17 05:46:43.896075 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:43.896038    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb" event={"ID":"280d3014-24f1-433b-9f42-4be40384d9b1","Type":"ContainerStarted","Data":"c4458c13b4dfdb84d15201b05a6ce6d7ddfee6f621731f487821fb2d1cb27850"}
Jul 17 05:46:43.896075 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:43.896094    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb" event={"ID":"280d3014-24f1-433b-9f42-4be40384d9b1","Type":"ContainerStarted","Data":"d67ab571cd49f104983ab5576fd3337cbae73d07f4f5b6d21b1248df4044750a"}
Jul 17 05:46:43.896604 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:43.896122    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:43.911850 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:43.911802    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb" podStartSLOduration=1.9117847399999999 podStartE2EDuration="1.91178474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 05:46:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 05:46:43.91065954 +0000 UTC m=+3438.588265877" watchObservedRunningTime="2026-07-17 05:46:43.91178474 +0000 UTC m=+3438.589391076"
Jul 17 05:46:44.641552 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:44.641521    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p5n24_702ad1b9-6061-4808-9fe6-721eee836531/dns/0.log"
Jul 17 05:46:44.662170 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:44.662142    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p5n24_702ad1b9-6061-4808-9fe6-721eee836531/kube-rbac-proxy/0.log"
Jul 17 05:46:44.687075 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:44.687046    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-28dgh_0a1a5036-08c3-4598-8271-0b3e5746e98f/dns-node-resolver/0.log"
Jul 17 05:46:45.321906 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:45.321877    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d4sqb_ba97ada7-a006-40a4-a0ef-513d06d8645a/node-ca/0.log"
Jul 17 05:46:46.249139 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:46.249105    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678lnzm8_c159e604-d698-4dbc-8a34-9dbb21687c4f/istio-proxy/0.log"
Jul 17 05:46:46.488225 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:46.488197    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d686d4c64-7nnrt_0f802622-b57b-4356-8db1-f13d06156a56/kube-auth-proxy/0.log"
Jul 17 05:46:46.694884 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:46.694855    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-679d5646-wtsmz_4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642/router/0.log"
Jul 17 05:46:47.391997 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:47.391962    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dl657_a9591e1b-18f6-4987-9642-e41e6641d6e6/serve-healthcheck-canary/0.log"
Jul 17 05:46:47.865711 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:47.865676    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-665g2_323c73c7-3605-42f0-9ff2-57de004ce286/insights-operator/0.log"
Jul 17 05:46:47.866586 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:47.866566    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-665g2_323c73c7-3605-42f0-9ff2-57de004ce286/insights-operator/1.log"
Jul 17 05:46:47.946234 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:47.946197    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t64kc_8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06/kube-rbac-proxy/0.log"
Jul 17 05:46:47.966728 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:47.966705    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t64kc_8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06/exporter/0.log"
Jul 17 05:46:47.988547 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:47.988508    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t64kc_8a2d4e61-bbf6-4d28-ab45-ffe96e0ada06/extractor/0.log"
Jul 17 05:46:49.912920 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:49.912893    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fvgtg/perf-node-gather-daemonset-8m2sb"
Jul 17 05:46:50.124039 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:50.124005    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-sqpxm_b40a61e0-5e08-4672-b57e-52450ab0129b/manager/0.log"
Jul 17 05:46:50.261721 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:50.261606    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7jcdx_8ee17883-7f0b-4375-94ae-2d23ced919e1/manager/0.log"
Jul 17 05:46:50.471751 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:50.471721    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jwzth_548a08cb-f2ee-4702-b2f6-b9950026d9a5/server/0.log"
Jul 17 05:46:50.538136 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:50.538036    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-khxfg_f6fb8750-19d6-4a15-bb1f-9f913f2a2401/manager/0.log"
Jul 17 05:46:50.562197 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:50.562169    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d857c78d5-9js2d_8a936fef-cc34-438a-92ff-7e0a47752ab5/manager/0.log"
Jul 17 05:46:50.584571 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:50.584541    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d857c78d5-9js2d_8a936fef-cc34-438a-92ff-7e0a47752ab5/copy-manifests/0.log"
Jul 17 05:46:53.048199 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:53.048168    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678lnzm8_c159e604-d698-4dbc-8a34-9dbb21687c4f/istio-proxy/0.log"
Jul 17 05:46:53.278565 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:53.278541    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d686d4c64-7nnrt_0f802622-b57b-4356-8db1-f13d06156a56/kube-auth-proxy/0.log"
Jul 17 05:46:53.467891 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:53.467855    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-679d5646-wtsmz_4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642/router/0.log"
Jul 17 05:46:54.674027 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:54.673989    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678lnzm8_c159e604-d698-4dbc-8a34-9dbb21687c4f/istio-proxy/0.log"
Jul 17 05:46:54.889484 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:54.889435    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d686d4c64-7nnrt_0f802622-b57b-4356-8db1-f13d06156a56/kube-auth-proxy/0.log"
Jul 17 05:46:55.056494 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:55.056469    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-679d5646-wtsmz_4d76c8ce-4a93-4c79-9b8c-8bdeedcbd642/router/0.log"
Jul 17 05:46:57.584875 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:57.584850    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-4xxjk_217df4f8-8a0e-4805-8af7-6e122bfd7497/kube-storage-version-migrator-operator/1.log"
Jul 17 05:46:57.585682 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:57.585663    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-4xxjk_217df4f8-8a0e-4805-8af7-6e122bfd7497/kube-storage-version-migrator-operator/0.log"
Jul 17 05:46:58.650027 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:58.650000    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qntz_043d9bc2-3514-4d10-b995-a2e6783e6939/kube-multus-additional-cni-plugins/0.log"
Jul 17 05:46:58.673652 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:58.673614    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qntz_043d9bc2-3514-4d10-b995-a2e6783e6939/egress-router-binary-copy/0.log"
Jul 17 05:46:58.695167 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:58.695137    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qntz_043d9bc2-3514-4d10-b995-a2e6783e6939/cni-plugins/0.log"
Jul 17 05:46:58.716246 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:58.716218    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qntz_043d9bc2-3514-4d10-b995-a2e6783e6939/bond-cni-plugin/0.log"
Jul 17 05:46:58.746473 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:58.746442    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qntz_043d9bc2-3514-4d10-b995-a2e6783e6939/routeoverride-cni/0.log"
Jul 17 05:46:58.766299 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:58.766262    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qntz_043d9bc2-3514-4d10-b995-a2e6783e6939/whereabouts-cni-bincopy/0.log"
Jul 17 05:46:58.786268 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:58.786241    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qntz_043d9bc2-3514-4d10-b995-a2e6783e6939/whereabouts-cni/0.log"
Jul 17 05:46:59.025814 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:59.025732    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mktcn_f99dd7be-8ce9-480d-a3a7-32da596b6ab3/kube-multus/0.log"
Jul 17 05:46:59.141656 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:59.141595    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hfzzb_17c170e0-f040-42d6-9047-9afaa449d88e/network-metrics-daemon/0.log"
Jul 17 05:46:59.159033 ip-10-0-129-234 kubenswrapper[2564]: I0717 05:46:59.159005    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hfzzb_17c170e0-f040-42d6-9047-9afaa449d88e/kube-rbac-proxy/0.log"