Jul 09 14:20:54.417843 ip-10-0-140-234 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 14:20:54.735186 ip-10-0-140-234 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 14:20:54.735186 ip-10-0-140-234 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 14:20:54.735186 ip-10-0-140-234 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 14:20:54.735186 ip-10-0-140-234 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 14:20:54.735186 ip-10-0-140-234 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 14:20:54.736666 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.736584    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 14:20:54.742727 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742712    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:20:54.742727 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742727    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742731    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742734    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742737    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742739    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742742    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742744    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742747    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742751    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742753    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742755    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742758    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742761    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742779    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742783    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742786    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742789    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742793    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:20:54.742790 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742797    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742801    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742804    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742808    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742811    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742813    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742816    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742818    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742821    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742823    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742826    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742828    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742831    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742833    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742836    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742838    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742840    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742843    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742845    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742848    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:20:54.743210 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742850    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742853    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742855    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742857    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742860    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742862    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742864    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742867    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742869    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742871    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742874    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742876    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742878    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742881    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742884    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742886    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742889    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742892    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742895    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742897    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:20:54.743719 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742900    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742903    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742905    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742907    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742910    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742912    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742914    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742917    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742921    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742924    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742927    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742930    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742934    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742937    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742939    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742942    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742944    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742947    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742949    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:20:54.744225 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742952    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742954    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742958    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742960    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742963    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742965    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742968    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742971    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742975    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742977    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742981    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742985    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742987    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742990    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742992    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742995    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.742997    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743000    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743002    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:20:54.744700 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743005    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743007    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743711    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743719    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743722    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743724    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743727    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743731    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743733    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743736    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743739    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743744    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743748    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743751    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743754    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743757    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743759    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743763    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743765    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743768    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:20:54.745143 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743771    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743774    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743776    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743779    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743781    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743784    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743786    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743789    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743791    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743794    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743797    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743799    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743802    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743804    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743806    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743809    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743812    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743814    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743817    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743819    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:20:54.745644 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743822    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743826    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743829    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743832    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743835    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743837    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743839    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743842    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743844    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743847    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743849    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743851    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743854    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743856    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743858    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743861    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743863    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743866    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743868    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743871    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:20:54.746120 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743873    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743875    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743878    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743880    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743882    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743885    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743887    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743890    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743892    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743895    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743897    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743900    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743902    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743906    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743908    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743911    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743913    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743916    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743919    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:20:54.746613 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743922    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743924    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743927    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743929    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743932    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743934    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743937    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743939    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743941    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743944    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743946    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743948    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743951    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743953    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743956    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743959    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743963    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743966    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743968    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:20:54.747070 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743971    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743974    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.743977    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744330    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744334    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744337    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744342    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744351    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744354    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744356    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744358    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744361    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744364    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744366    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744368    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744371    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744376    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744379    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744382    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:20:54.747521 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744385    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744388    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744391    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744393    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744396    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744399    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744401    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744403    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744406    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744426    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744430    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744433    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744436    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744438    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744441    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744443    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744446    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744448    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744451    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744455    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:20:54.747993 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744457    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744466    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744469    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744472    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744474    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744476    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744479    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744482    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744485    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744488    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744490    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744493    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744496    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744498    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744501    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744503    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744506    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744508    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744511    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:20:54.748466 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744513    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744515    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744518    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744520    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744523    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744525    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744527    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744530    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744532    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744534    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744537    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744539    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744559    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744562    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744566    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744571    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744574    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744577    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744579    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744581    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:20:54.748962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744584    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744586    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744589    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744592    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744595    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744597    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744599    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744603    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744606    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744609    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744611    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744614    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744616    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744618    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744621    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744625    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744628    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744631    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744634    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:20:54.749450 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744636    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744639    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744641    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744644    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.744646    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744715    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744721    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744735    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744755    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744764    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744768    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744774    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744781    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744784    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744787    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744790    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744794    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744796    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744799    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744802    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744805    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744807    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744810    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744814    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 09 14:20:54.749908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744817    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744819    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744823    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744826    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744829    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744832    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744835    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744838    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744841    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744844    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744847    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744850    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744853    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744858    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744860    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744863    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744866    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744869    2563 flags.go:64] FLAG: --enable-server="true"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744872    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744877    2563 flags.go:64] FLAG: --event-burst="100"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744880    2563 flags.go:64] FLAG: --event-qps="50"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744883    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744885    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744888    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 09 14:20:54.750482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744892    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744894    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744898    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744901    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744903    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744906    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744909    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744911    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744914    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744917    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744919    2563 flags.go:64] FLAG: --feature-gates=""
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744923    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744926    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744928    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744931    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744934    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744937    2563 flags.go:64] FLAG: --help="false"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744939    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-140-234.ec2.internal"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744942    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744945    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744948    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744951    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744955    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744958    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 14:20:54.751065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744960    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744963    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744966    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744969    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744973    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744975    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744978    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744980    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744983    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744986    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744988    2563 flags.go:64] FLAG: --lock-file=""
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744991    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744993    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.744996    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745001    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745004    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745006    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745009    2563 flags.go:64] FLAG: --logging-format="text"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745012    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745015    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745018    2563 flags.go:64] FLAG: --manifest-url=""
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745020    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745029    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745032    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745035    2563 flags.go:64] FLAG: --max-pods="110"
Jul 09 14:20:54.751696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745038    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745041    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745044    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745047    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745050    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745053    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745056    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745061    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745064    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745067    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745070    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745073    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745078    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745081    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745084    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745087    2563 flags.go:64] FLAG: --port="10250"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745090    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745093    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02d2b8634d8e1fad0"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745096    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745099    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745102    2563 flags.go:64] FLAG: --register-node="true"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745104    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745108    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745111    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 09 14:20:54.752324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745113    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745116    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745120    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745122    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745125    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745128    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745131    2563 flags.go:64] FLAG: --runonce="false"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745134    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745137    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745139    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745142    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745145    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745148    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745151    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745155    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745158    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745161    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745164    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745166    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745169    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745173    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745175    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745180    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745183    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745186    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 14:20:54.752921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745189    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745192    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745194    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745201    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745204    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745207    2563 flags.go:64] FLAG: --v="2"
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745210    2563 flags.go:64] FLAG: --version="false"
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745214    2563 flags.go:64] FLAG: --vmodule=""
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745217    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.745221    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745334    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745337    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745340    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745343    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745346    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745349    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745351    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745354    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745356    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745358    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745363    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745366    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:20:54.753620 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745369    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745371    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745373    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745376    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745378    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745381    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745384    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745387    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745389    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745391    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745394    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745396    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745399    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745401    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745403    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745406    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745408    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745410    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745413    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745415    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:20:54.754144 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745418    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745420    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745423    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745425    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745427    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745430    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745432    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745434    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745437    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745439    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745443    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745446    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745449    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745452    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745455    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745457    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745460    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745462    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745465    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:20:54.754648 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745468    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745470    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745473    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745475    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745478    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745480    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745483    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745485    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745488    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745490    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745492    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745495    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745497    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745499    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745502    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745504    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745506    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745509    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745511    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745514    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:20:54.755100 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745516    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745519    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745522    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745527    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745531    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745534    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745537    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745539    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745541    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745561    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745565    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745567    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745570    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745573    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745576    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745578    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745581    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745585    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745588    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:20:54.755599 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745591    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:20:54.756061 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745594    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:20:54.756061 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745597    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:20:54.756061 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745599    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:20:54.756061 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745602    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:20:54.756061 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745604    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:20:54.756061 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745607    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:20:54.756061 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745609    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:20:54.756061 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.745612    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:20:54.756061 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.746135    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 14:20:54.756061 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.752997    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 14:20:54.756061 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.753016    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 14:20:54.756061 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.753684    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 14:20:54.756061 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.753697    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 14:20:54.756061 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753769    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:20:54.756061 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753775    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753778    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753781    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753783    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753786    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753789    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753792    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753795    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753800    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753804    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753809    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753813    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753816    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753819    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753822    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753824    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753827    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753829    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753832    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753834    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:20:54.756431 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753837    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753839    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753842    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753845    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753847    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753849    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753852    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753855    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753864    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753867    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753869    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753873    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753877    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753881    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753885    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753890    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753897    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753901    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753905    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:20:54.756987 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753908    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753911    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753913    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753916    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753919    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753921    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753924    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753926    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753929    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753932    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753934    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753936    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753939    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753942    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753944    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753947    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753949    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753951    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753954    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753957    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:20:54.757437 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753961    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753966    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753987    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753991    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753993    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753996    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.753998    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754001    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754003    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754006    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754008    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754010    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754013    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754015    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754018    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754020    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754022    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754025    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754027    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754030    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:20:54.757955 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754032    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754034    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754037    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754039    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754042    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754045    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754050    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754054    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754058    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754062    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754066    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754069    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754072    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754074    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754077    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754086    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754088    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754091    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:20:54.758425 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754093    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:20:54.758873 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.754098    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 14:20:54.758873 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754268    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:20:54.758873 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754273    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:20:54.758873 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754277    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:20:54.758873 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754280    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:20:54.758873 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754282    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:20:54.758873 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754285    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:20:54.758873 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754287    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:20:54.758873 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754290    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:20:54.758873 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754293    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:20:54.758873 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754298    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:20:54.758873 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754302    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:20:54.758873 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754306    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:20:54.758873 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754310    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:20:54.758873 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754314    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754317    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754320    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754322    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754326    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754330    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754333    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754336    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754339    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754341    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754344    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754347    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754349    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754352    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754354    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754363    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754365    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754368    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754370    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754373    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:20:54.759242 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754376    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754380    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754385    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754389    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754393    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754397    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754400    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754402    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754405    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754407    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754409    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754412    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754414    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754416    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754418    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754421    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754424    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754426    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754429    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754431    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:20:54.759739 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754433    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754436    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754438    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754441    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754443    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754445    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754448    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754450    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754460    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754465    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754469    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754473    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754477    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754481    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754484    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754486    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754488    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754491    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754494    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754497    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:20:54.760602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754500    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754503    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754505    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754507    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754510    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754512    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754515    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754517    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754519    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754522    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754524    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754527    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754529    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754531    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754534    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754537    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754539    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754542    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754562    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:20:54.761373 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754566    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:20:54.761995 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754569    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:20:54.761995 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754578    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:20:54.761995 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754581    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:20:54.761995 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754583    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:20:54.761995 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754586    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:20:54.761995 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:54.754588    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:20:54.761995 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.754593    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 14:20:54.761995 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.754716    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 14:20:54.761995 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.756758    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 14:20:54.761995 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.757913    2563 server.go:1019] "Starting client certificate rotation"
Jul 09 14:20:54.761995 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.758021    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 14:20:54.761995 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.758060    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 14:20:54.762773 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.762758    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 14:20:54.763942 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.763927    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 14:20:54.779429 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.779413    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 09 14:20:54.781501 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.781486    2563 log.go:25] "Validated CRI v1 image API"
Jul 09 14:20:54.782406 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.782389    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 14:20:54.787760 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.787736    2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a2f1a817-27c2-41ff-be5c-6f5d2ebbd03b:/dev/nvme0n1p4 d66a4f8b-8666-4437-a330-7ba107d21a02:/dev/nvme0n1p3]
Jul 09 14:20:54.787825 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.787759    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 14:20:54.789328 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.789312    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 14:20:54.793170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.793067    2563 manager.go:216] Machine: {Timestamp:2026-07-09 14:20:54.791844399 +0000 UTC m=+0.277191820 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098126 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2378f7d6fbdc1887cf8f206d6db4ac SystemUUID:ec2378f7-d6fb-dc18-87cf-8f206d6db4ac BootID:2435795c-1117-455d-8d41-d3a4c9008ccd Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8f:bd:b5:fe:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8f:bd:b5:fe:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:15:d2:db:3d:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 14:20:54.793170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.793166    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 14:20:54.793297 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.793259    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 14:20:54.795751 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.795726    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 14:20:54.795884 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.795753    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-234.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 14:20:54.796505 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.796496    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 14:20:54.796537 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.796507    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 14:20:54.796537 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.796514    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 14:20:54.797150 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.797139    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 14:20:54.798310 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.798300    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 14:20:54.802034 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.802022    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 14:20:54.802155 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.802145    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 14:20:54.802185 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.802177    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 14:20:54.802215 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.802198    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 14:20:54.802259 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.802220    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 14:20:54.802259 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.802234    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 09 14:20:54.802259 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.802246    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 14:20:54.802661 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.802640    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 14:20:54.802661 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.802663    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 14:20:54.804441 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.804422    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 14:20:54.807642 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.807614    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 14:20:54.807735 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.807670    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 14:20:54.807883 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.807868    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 14:20:54.807883 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.807891    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 14:20:54.807992 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.807901    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 14:20:54.807992 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.807909    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 14:20:54.807992 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.807921    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 14:20:54.807992 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.807930    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 14:20:54.808394 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.808374    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 14:20:54.808394 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.808394    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 14:20:54.808509 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.808431    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 14:20:54.808509 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.808456    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 14:20:54.808509 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.808484    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 14:20:54.808509 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.808495    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 14:20:54.809338 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.809320    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 14:20:54.809385 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.809347    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 14:20:54.810654 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.810632    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8zj58"
Jul 09 14:20:54.812898 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.812884    2563 server.go:1268] "Started kubelet"
Jul 09 14:20:54.813026 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.812978    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 14:20:54.813308 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.813292    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-234.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 14:20:54.813461 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.813414    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 14:20:54.813535 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.813483    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 14:20:54.813609 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:54.813561    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 14:20:54.813661 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:54.813576    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 14:20:54.813930 ip-10-0-140-234 systemd[1]: Started Kubernetes Kubelet.
Jul 09 14:20:54.814869 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.814787    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 14:20:54.815305 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.815293    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 14:20:54.817891 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:54.817860    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 14:20:54.818060 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.818045    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8zj58"
Jul 09 14:20:54.819496 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.819482    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 14:20:54.819587 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.819500    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 14:20:54.819665 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:54.819641    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-234.ec2.internal\" not found"
Jul 09 14:20:54.820245 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.820225    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 14:20:54.820245 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.820237    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 14:20:54.820245 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.820246    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 14:20:54.820422 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:54.819460    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-234.ec2.internal.18c0a4fc081244dd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-234.ec2.internal,UID:ip-10-0-140-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-234.ec2.internal,},FirstTimestamp:2026-07-09 14:20:54.812845277 +0000 UTC m=+0.298192700,LastTimestamp:2026-07-09 14:20:54.812845277 +0000 UTC m=+0.298192700,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-234.ec2.internal,}"
Jul 09 14:20:54.820422 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.820405    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 14:20:54.820422 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.820412    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 14:20:54.820729 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.820714    2563 factory.go:153] Registering CRI-O factory
Jul 09 14:20:54.820797 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.820744    2563 factory.go:223] Registration of the crio container factory successfully
Jul 09 14:20:54.820848 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.820806    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 14:20:54.820848 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.820820    2563 factory.go:55] Registering systemd factory
Jul 09 14:20:54.820848 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.820829    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 09 14:20:54.820990 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.820849    2563 factory.go:103] Registering Raw factory
Jul 09 14:20:54.820990 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.820862    2563 manager.go:1196] Started watching for new ooms in manager
Jul 09 14:20:54.821267 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.821251    2563 manager.go:349] Starting recovery of all containers
Jul 09 14:20:54.828576 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.828392    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:20:54.831890 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:54.831864    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-234.ec2.internal\" not found" node="ip-10-0-140-234.ec2.internal"
Jul 09 14:20:54.832410 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.832386    2563 manager.go:354] Recovery completed
Jul 09 14:20:54.838396 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.838383    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:20:54.840133 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.840113    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:20:54.840192 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.840151    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:20:54.840192 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.840167    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:20:54.840743 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.840727    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 14:20:54.840743 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.840740    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:20:54.840878 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.840742    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 14:20:54.840878 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.840778    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 14:20:54.841611 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.841591    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:20:54.841702 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.841628    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:20:54.841702 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.841643    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:20:54.842821 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.842808    2563 policy_none.go:49] "None policy: Start"
Jul 09 14:20:54.842864 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.842825    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 14:20:54.842864 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.842835    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 14:20:54.844787 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.844777    2563 policy_none.go:47] "Start"
Jul 09 14:20:54.878094 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.878080    2563 manager.go:337] "Starting Device Plugin manager"
Jul 09 14:20:54.878165 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:54.878114    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 14:20:54.878165 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.878124    2563 server.go:87] "Starting device plugin registration server"
Jul 09 14:20:54.878369 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.878356    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 14:20:54.878447 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.878371    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 14:20:54.878513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.878500    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 14:20:54.878610 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.878594    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 14:20:54.878713 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.878608    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 14:20:54.879089 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:54.879069    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 14:20:54.879165 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:54.879122    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-234.ec2.internal\" not found"
Jul 09 14:20:54.979060 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.979038    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:20:54.981199 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.980115    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:20:54.981199 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.980140    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:20:54.981199 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.980150    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:20:54.981199 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.980176    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-234.ec2.internal"
Jul 09 14:20:54.988001 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.987964    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-234.ec2.internal"
Jul 09 14:20:54.988001 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:54.987986    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-234.ec2.internal\": node \"ip-10-0-140-234.ec2.internal\" not found"
Jul 09 14:20:54.993833 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.993808    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 14:20:54.995167 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.995153    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 14:20:54.995244 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.995191    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 14:20:54.995244 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.995215    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 14:20:54.995337 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:54.995253    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 14:20:54.997960 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:54.997941    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:20:55.001834 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:55.001820    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-234.ec2.internal\" not found"
Jul 09 14:20:55.095542 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.095508    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-234.ec2.internal"]
Jul 09 14:20:55.095655 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.095614    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:20:55.097010 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.096987    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:20:55.097094 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.097020    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:20:55.097094 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.097036    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:20:55.099402 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.099389    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:20:55.099532 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.099497    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.099589 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.099540    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:20:55.100162 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.100147    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:20:55.100162 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.100157    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:20:55.100263 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.100177    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:20:55.100263 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.100181    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:20:55.100263 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.100193    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:20:55.100263 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.100208    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:20:55.102008 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:55.101992    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-234.ec2.internal\" not found"
Jul 09 14:20:55.103079 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.103063    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.103162 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.103089    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:20:55.103893 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.103875    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:20:55.103991 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.103910    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:20:55.103991 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.103923    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:20:55.121491 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.121469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27720bce3ffdbdb8ce1870f3c11220d9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-234.ec2.internal\" (UID: \"27720bce3ffdbdb8ce1870f3c11220d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.121580 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.121490    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46a34aa9fbfdc20a772f622b306ebd77-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal\" (UID: \"46a34aa9fbfdc20a772f622b306ebd77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.121580 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.121508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46a34aa9fbfdc20a772f622b306ebd77-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal\" (UID: \"46a34aa9fbfdc20a772f622b306ebd77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.126065 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:55.126047    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-234.ec2.internal\" not found" node="ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.130243 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:55.130227    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-234.ec2.internal\" not found" node="ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.202440 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:55.202417    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-234.ec2.internal\" not found"
Jul 09 14:20:55.222151 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.222131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27720bce3ffdbdb8ce1870f3c11220d9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-234.ec2.internal\" (UID: \"27720bce3ffdbdb8ce1870f3c11220d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.222219 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.222159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46a34aa9fbfdc20a772f622b306ebd77-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal\" (UID: \"46a34aa9fbfdc20a772f622b306ebd77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.222219 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.222175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46a34aa9fbfdc20a772f622b306ebd77-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal\" (UID: \"46a34aa9fbfdc20a772f622b306ebd77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.222219 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.222214    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46a34aa9fbfdc20a772f622b306ebd77-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal\" (UID: \"46a34aa9fbfdc20a772f622b306ebd77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.222333 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.222237    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27720bce3ffdbdb8ce1870f3c11220d9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-234.ec2.internal\" (UID: \"27720bce3ffdbdb8ce1870f3c11220d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.222333 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.222256    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46a34aa9fbfdc20a772f622b306ebd77-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal\" (UID: \"46a34aa9fbfdc20a772f622b306ebd77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.303475 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:55.303414    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-234.ec2.internal\" not found"
Jul 09 14:20:55.403925 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:55.403892    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-234.ec2.internal\" not found"
Jul 09 14:20:55.428439 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.428407    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.433539 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.433449    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.504219 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:55.504182    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-234.ec2.internal\" not found"
Jul 09 14:20:55.604733 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:55.604661    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-234.ec2.internal\" not found"
Jul 09 14:20:55.683706 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.683678    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:20:55.720634 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.720607    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.731615 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.731597    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 14:20:55.733156 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.733143    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-234.ec2.internal"
Jul 09 14:20:55.740582 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.740569    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 14:20:55.753226 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.753204    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:20:55.758088 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.758070    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 14:20:55.758212 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.758194    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 14:20:55.758271 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.758228    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 14:20:55.758271 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.758241    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 14:20:55.758271 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.758250    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 14:20:55.803391 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.803365    2563 apiserver.go:52] "Watching apiserver"
Jul 09 14:20:55.816850 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.816822    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 14:20:55.818830 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.818809    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-xjl9r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal","openshift-multus/multus-fg6l6","openshift-multus/network-metrics-daemon-b4crp","openshift-network-diagnostics/network-check-target-8jlrc","openshift-network-operator/iptables-alerter-jp6vf","openshift-ovn-kubernetes/ovnkube-node-2dhnz","kube-system/global-pull-secret-syncer-7jk5k","kube-system/konnectivity-agent-hwjfl","kube-system/kube-apiserver-proxy-ip-10-0-140-234.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk","openshift-cluster-node-tuning-operator/tuned-r6c7f","openshift-dns/node-resolver-kqqjk","openshift-image-registry/node-ca-g6w9d"]
Jul 09 14:20:55.820716 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.820694    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 14:20:55.821825 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.821805    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.823961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.823944    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kqqjk"
Jul 09 14:20:55.824053 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.823994    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 14:15:56 +0000 UTC" deadline="2028-03-02 21:07:35.074895924 +0000 UTC"
Jul 09 14:20:55.824053 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.824034    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14454h46m39.250865114s"
Jul 09 14:20:55.824280 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.824258    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 14:20:55.824379 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.824363    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 14:20:55.824439 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.824409    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 14:20:55.825152 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825137    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cncfb\""
Jul 09 14:20:55.825229 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825147    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 14:20:55.825229 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825155    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 14:20:55.825229 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825158    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/09b35b94-8922-4ff4-aa77-c987bd7beacc-ovnkube-config\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825229 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825188    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 14:20:55.825229 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825208    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/09b35b94-8922-4ff4-aa77-c987bd7beacc-ovn-node-metrics-cert\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825411 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825235    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7zdk\" (UniqueName: \"kubernetes.io/projected/09b35b94-8922-4ff4-aa77-c987bd7beacc-kube-api-access-p7zdk\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825411 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825260    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-run-systemd\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825411 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-var-lib-openvswitch\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825411 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825302    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-etc-openvswitch\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825411 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825343    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-kubelet\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825411 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825363    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-run-openvswitch\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825411 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825411 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825679 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/09b35b94-8922-4ff4-aa77-c987bd7beacc-env-overrides\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825679 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/09b35b94-8922-4ff4-aa77-c987bd7beacc-ovnkube-script-lib\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825679 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825461    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-systemd-units\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825679 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825478    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-run-netns\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825679 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825492    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-run-ovn\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825679 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-log-socket\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825679 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-cni-bin\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825679 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825577    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-cni-netd\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825679 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825600    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-slash\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.825679 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.825615    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-node-log\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.826112 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.826096    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:55.826272 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.826177    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x7dwh\""
Jul 09 14:20:55.826835 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.826816    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 14:20:55.826934 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.826876    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 14:20:55.828285 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.828268    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 14:20:55.828360 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.828330    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sx7xw\""
Jul 09 14:20:55.828360 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.828338    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 14:20:55.828360 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.828346    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 14:20:55.828589 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.828572    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 14:20:55.829034 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.829017    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:20:55.829126 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:55.829098    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:20:55.831254 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.831237    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:20:55.831326 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:55.831299    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:20:55.833381 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.833367    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jp6vf"
Jul 09 14:20:55.838628 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.838611    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hwjfl"
Jul 09 14:20:55.841733 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.841274    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:55.843959 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.843942    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g6w9d"
Jul 09 14:20:55.844679 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.844657    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 14:20:55.844778 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.844763    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 14:20:55.844824 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.844787    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wq4mm\""
Jul 09 14:20:55.844866 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.844839    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 14:20:55.845382 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.845365    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nxbjn\""
Jul 09 14:20:55.845473 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.845405    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 14:20:55.845473 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.845416    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qvqrj\""
Jul 09 14:20:55.845710 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.845694    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 14:20:55.845784 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.845712    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 14:20:55.845784 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.845715    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 14:20:55.846708 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.846694    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:20:55.846763 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:55.846748    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:20:55.848448 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.848432    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2q8fs\""
Jul 09 14:20:55.848517 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.848471    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 14:20:55.848584 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.848516    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 14:20:55.848584 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.848568    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 14:20:55.849373 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.849357    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:55.851899 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.851883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:55.855204 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.855160    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 14:20:55.855414 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.855401    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 14:20:55.855480 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.855466    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-85q8v\""
Jul 09 14:20:55.856426 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.856412    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 14:20:55.856855 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.856839    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 14:20:55.857205 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.857190    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 14:20:55.857915 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.857893    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-59z6z\""
Jul 09 14:20:55.859481 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.859467    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 14:20:55.894361 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.894343    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lbzb2"
Jul 09 14:20:55.902118 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.902097    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lbzb2"
Jul 09 14:20:55.921034 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.921017    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 14:20:55.926069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9753f0f7-1409-4552-aaad-995fd401dd48-kubelet-config\") pod \"global-pull-secret-syncer-7jk5k\" (UID: \"9753f0f7-1409-4552-aaad-995fd401dd48\") " pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:20:55.926169 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-run-k8s-cni-cncf-io\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:55.926169 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926103    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fffb39dc-5682-4ec0-9eb0-86bec13ce105-system-cni-dir\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:55.926169 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-run-systemd\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.926169 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926154    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a909f8f0-7545-4d48-96ee-43c5641a5e3d-host\") pod \"node-ca-g6w9d\" (UID: \"a909f8f0-7545-4d48-96ee-43c5641a5e3d\") " pod="openshift-image-registry/node-ca-g6w9d"
Jul 09 14:20:55.926413 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926177    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret\") pod \"global-pull-secret-syncer-7jk5k\" (UID: \"9753f0f7-1409-4552-aaad-995fd401dd48\") " pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:20:55.926413 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:55.926413 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926205    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-run-systemd\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.926413 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926226    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-multus-conf-dir\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:55.926413 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926250    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/556921c6-b157-4c59-a01f-fb4943d1020b-host-slash\") pod \"iptables-alerter-jp6vf\" (UID: \"556921c6-b157-4c59-a01f-fb4943d1020b\") " pod="openshift-network-operator/iptables-alerter-jp6vf"
Jul 09 14:20:55.926413 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-kubernetes\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:55.926413 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926315    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-host\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:55.926413 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-multus-socket-dir-parent\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:55.926413 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/556921c6-b157-4c59-a01f-fb4943d1020b-iptables-alerter-script\") pod \"iptables-alerter-jp6vf\" (UID: \"556921c6-b157-4c59-a01f-fb4943d1020b\") " pod="openshift-network-operator/iptables-alerter-jp6vf"
Jul 09 14:20:55.926413 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-cni-netd\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.926413 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-etc-kubernetes\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:55.926961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs\") pod \"network-metrics-daemon-b4crp\" (UID: \"82480873-c990-49f3-a16b-a961f1d330d9\") " pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:20:55.926961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-device-dir\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:55.926961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926470    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-cni-netd\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.926961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fffb39dc-5682-4ec0-9eb0-86bec13ce105-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:55.926961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926507    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5a824f4-706d-4a1a-b5a1-edd1b60054ac-tmp-dir\") pod \"node-resolver-kqqjk\" (UID: \"a5a824f4-706d-4a1a-b5a1-edd1b60054ac\") " pod="openshift-dns/node-resolver-kqqjk"
Jul 09 14:20:55.926961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926540    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-var-lib-openvswitch\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.926961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926585    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-var-lib-openvswitch\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.926961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.926961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926614    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.926961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-sysctl-conf\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:55.926961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w972t\" (UniqueName: \"kubernetes.io/projected/92f62127-dbbe-4b1c-af6e-3a61c5250cea-kube-api-access-w972t\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:55.926961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926677    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-var-lib-cni-multus\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:55.926961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926701    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4385d404-cc52-49a6-984e-7417a0d63935-agent-certs\") pod \"konnectivity-agent-hwjfl\" (UID: \"4385d404-cc52-49a6-984e-7417a0d63935\") " pod="kube-system/konnectivity-agent-hwjfl"
Jul 09 14:20:55.926961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fffb39dc-5682-4ec0-9eb0-86bec13ce105-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:55.926961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a5a824f4-706d-4a1a-b5a1-edd1b60054ac-hosts-file\") pod \"node-resolver-kqqjk\" (UID: \"a5a824f4-706d-4a1a-b5a1-edd1b60054ac\") " pod="openshift-dns/node-resolver-kqqjk"
Jul 09 14:20:55.926961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926780    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-sysctl-d\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926826    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-systemd\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926853    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-slash\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926902    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-slash\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/09b35b94-8922-4ff4-aa77-c987bd7beacc-ovnkube-config\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926947    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7zdk\" (UniqueName: \"kubernetes.io/projected/09b35b94-8922-4ff4-aa77-c987bd7beacc-kube-api-access-p7zdk\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.926986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ghq2\" (UniqueName: \"kubernetes.io/projected/a909f8f0-7545-4d48-96ee-43c5641a5e3d-kube-api-access-5ghq2\") pod \"node-ca-g6w9d\" (UID: \"a909f8f0-7545-4d48-96ee-43c5641a5e3d\") " pod="openshift-image-registry/node-ca-g6w9d"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-sys-fs\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927024    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-tuned\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927038    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e47b991c-2c73-4bbd-a267-d6a5583a8994-cni-binary-copy\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927055    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-etc-openvswitch\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927070    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbqbp\" (UniqueName: \"kubernetes.io/projected/82480873-c990-49f3-a16b-a961f1d330d9-kube-api-access-vbqbp\") pod \"network-metrics-daemon-b4crp\" (UID: \"82480873-c990-49f3-a16b-a961f1d330d9\") " pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-system-cni-dir\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927124    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-etc-openvswitch\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927172    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-var-lib-cni-bin\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-hostroot\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:55.927513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e47b991c-2c73-4bbd-a267-d6a5583a8994-multus-daemon-config\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh59s\" (UniqueName: \"kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s\") pod \"network-check-target-8jlrc\" (UID: \"30fec348-4428-465d-a900-6a779d9e64e6\") " pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4385d404-cc52-49a6-984e-7417a0d63935-konnectivity-ca\") pod \"konnectivity-agent-hwjfl\" (UID: \"4385d404-cc52-49a6-984e-7417a0d63935\") " pod="kube-system/konnectivity-agent-hwjfl"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-kubelet\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927361    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-run-openvswitch\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927408    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-run-openvswitch\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927431    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-kubelet\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/09b35b94-8922-4ff4-aa77-c987bd7beacc-env-overrides\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927455    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/09b35b94-8922-4ff4-aa77-c987bd7beacc-ovnkube-config\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927485    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-modprobe-d\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqm9n\" (UniqueName: \"kubernetes.io/projected/a5a824f4-706d-4a1a-b5a1-edd1b60054ac-kube-api-access-bqm9n\") pod \"node-resolver-kqqjk\" (UID: \"a5a824f4-706d-4a1a-b5a1-edd1b60054ac\") " pod="openshift-dns/node-resolver-kqqjk"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-cni-bin\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mgmr\" (UniqueName: \"kubernetes.io/projected/e47b991c-2c73-4bbd-a267-d6a5583a8994-kube-api-access-5mgmr\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927629    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6tp8\" (UniqueName: \"kubernetes.io/projected/556921c6-b157-4c59-a01f-fb4943d1020b-kube-api-access-p6tp8\") pod \"iptables-alerter-jp6vf\" (UID: \"556921c6-b157-4c59-a01f-fb4943d1020b\") " pod="openshift-network-operator/iptables-alerter-jp6vf"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927659    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fffb39dc-5682-4ec0-9eb0-86bec13ce105-os-release\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.386546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927670    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-cni-bin\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcxl6\" (UniqueName: \"kubernetes.io/projected/fffb39dc-5682-4ec0-9eb0-86bec13ce105-kube-api-access-fcxl6\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-node-log\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/09b35b94-8922-4ff4-aa77-c987bd7beacc-ovn-node-metrics-cert\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-socket-dir\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-sysconfig\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/09b35b94-8922-4ff4-aa77-c987bd7beacc-env-overrides\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-node-log\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-run\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-sys\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-lib-modules\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927909    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-multus-cni-dir\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-registration-dir\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927967    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92f62127-dbbe-4b1c-af6e-3a61c5250cea-tmp\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.927988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-cnibin\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.928009    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-run-netns\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.928033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-var-lib-kubelet\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.387395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.928055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-run-multus-certs\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.928083    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fffb39dc-5682-4ec0-9eb0-86bec13ce105-cni-binary-copy\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.928111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/09b35b94-8922-4ff4-aa77-c987bd7beacc-ovnkube-script-lib\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.928135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cffj6\" (UniqueName: \"kubernetes.io/projected/415964d8-288a-4bf2-a727-0d6bc50c24a6-kube-api-access-cffj6\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:55.928156    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.386464    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-os-release\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.386494    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-var-lib-kubelet\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.386520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-systemd-units\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.386545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-run-netns\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.386587    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-systemd-units\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.386596    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-host-run-netns\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.386619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-run-ovn\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.386650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-log-socket\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.386668    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9753f0f7-1409-4552-aaad-995fd401dd48-dbus\") pod \"global-pull-secret-syncer-7jk5k\" (UID: \"9753f0f7-1409-4552-aaad-995fd401dd48\") " pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.386703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-run-ovn\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.386708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fffb39dc-5682-4ec0-9eb0-86bec13ce105-cnibin\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.386712    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/09b35b94-8922-4ff4-aa77-c987bd7beacc-log-socket\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.387927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.386726    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fffb39dc-5682-4ec0-9eb0-86bec13ce105-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.388423 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.386756    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a909f8f0-7545-4d48-96ee-43c5641a5e3d-serviceca\") pod \"node-ca-g6w9d\" (UID: \"a909f8f0-7545-4d48-96ee-43c5641a5e3d\") " pod="openshift-image-registry/node-ca-g6w9d"
Jul 09 14:20:57.388423 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.386788    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/09b35b94-8922-4ff4-aa77-c987bd7beacc-ovnkube-script-lib\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.389040 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.389021    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/09b35b94-8922-4ff4-aa77-c987bd7beacc-ovn-node-metrics-cert\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.393261 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.393241    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7zdk\" (UniqueName: \"kubernetes.io/projected/09b35b94-8922-4ff4-aa77-c987bd7beacc-kube-api-access-p7zdk\") pod \"ovnkube-node-2dhnz\" (UID: \"09b35b94-8922-4ff4-aa77-c987bd7beacc\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.448281 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:57.448250    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27720bce3ffdbdb8ce1870f3c11220d9.slice/crio-4c5a0fee1e0cc49f1f14fc280224441db7ad7350fe06ba9c291d4e5fb0dab570 WatchSource:0}: Error finding container 4c5a0fee1e0cc49f1f14fc280224441db7ad7350fe06ba9c291d4e5fb0dab570: Status 404 returned error can't find the container with id 4c5a0fee1e0cc49f1f14fc280224441db7ad7350fe06ba9c291d4e5fb0dab570
Jul 09 14:20:57.452901 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.452885    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 14:20:57.457433 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.457395    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-234.ec2.internal" event={"ID":"27720bce3ffdbdb8ce1870f3c11220d9","Type":"ContainerStarted","Data":"4c5a0fee1e0cc49f1f14fc280224441db7ad7350fe06ba9c291d4e5fb0dab570"}
Jul 09 14:20:57.487013 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.486992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcxl6\" (UniqueName: \"kubernetes.io/projected/fffb39dc-5682-4ec0-9eb0-86bec13ce105-kube-api-access-fcxl6\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.487119 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-socket-dir\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.487119 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-sysconfig\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.487119 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487051    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-run\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.487119 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-sys\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.487119 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487081    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-lib-modules\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.487119 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-multus-cni-dir\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.487362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487126    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-sysconfig\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.487362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-multus-cni-dir\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.487362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487153    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-sys\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.487362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487174    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-run\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.487362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487211    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-socket-dir\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.487362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487242    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-registration-dir\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.487362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487257    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-lib-modules\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.487362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92f62127-dbbe-4b1c-af6e-3a61c5250cea-tmp\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.487362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487293    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-cnibin\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.487362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487306    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-run-netns\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.487362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487306    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-registration-dir\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.487362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487321    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-var-lib-kubelet\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.487362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487340    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-run-multus-certs\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.487362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487351    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-run-netns\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.487362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487361    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-cnibin\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fffb39dc-5682-4ec0-9eb0-86bec13ce105-cni-binary-copy\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-var-lib-kubelet\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487407    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-run-multus-certs\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487410    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cffj6\" (UniqueName: \"kubernetes.io/projected/415964d8-288a-4bf2-a727-0d6bc50c24a6-kube-api-access-cffj6\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-os-release\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487460    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-var-lib-kubelet\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9753f0f7-1409-4552-aaad-995fd401dd48-dbus\") pod \"global-pull-secret-syncer-7jk5k\" (UID: \"9753f0f7-1409-4552-aaad-995fd401dd48\") " pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487505    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fffb39dc-5682-4ec0-9eb0-86bec13ce105-cnibin\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487525    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-os-release\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487530    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fffb39dc-5682-4ec0-9eb0-86bec13ce105-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487543    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-var-lib-kubelet\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487554    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a909f8f0-7545-4d48-96ee-43c5641a5e3d-serviceca\") pod \"node-ca-g6w9d\" (UID: \"a909f8f0-7545-4d48-96ee-43c5641a5e3d\") " pod="openshift-image-registry/node-ca-g6w9d"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487567    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fffb39dc-5682-4ec0-9eb0-86bec13ce105-cnibin\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9753f0f7-1409-4552-aaad-995fd401dd48-kubelet-config\") pod \"global-pull-secret-syncer-7jk5k\" (UID: \"9753f0f7-1409-4552-aaad-995fd401dd48\") " pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-run-k8s-cni-cncf-io\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487622    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9753f0f7-1409-4552-aaad-995fd401dd48-dbus\") pod \"global-pull-secret-syncer-7jk5k\" (UID: \"9753f0f7-1409-4552-aaad-995fd401dd48\") " pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:20:57.488069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487642    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fffb39dc-5682-4ec0-9eb0-86bec13ce105-system-cni-dir\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a909f8f0-7545-4d48-96ee-43c5641a5e3d-host\") pod \"node-ca-g6w9d\" (UID: \"a909f8f0-7545-4d48-96ee-43c5641a5e3d\") " pod="openshift-image-registry/node-ca-g6w9d"
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487699    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9753f0f7-1409-4552-aaad-995fd401dd48-kubelet-config\") pod \"global-pull-secret-syncer-7jk5k\" (UID: \"9753f0f7-1409-4552-aaad-995fd401dd48\") " pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487708    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fffb39dc-5682-4ec0-9eb0-86bec13ce105-system-cni-dir\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487717    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fffb39dc-5682-4ec0-9eb0-86bec13ce105-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret\") pod \"global-pull-secret-syncer-7jk5k\" (UID: \"9753f0f7-1409-4552-aaad-995fd401dd48\") " pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a909f8f0-7545-4d48-96ee-43c5641a5e3d-host\") pod \"node-ca-g6w9d\" (UID: \"a909f8f0-7545-4d48-96ee-43c5641a5e3d\") " pod="openshift-image-registry/node-ca-g6w9d"
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487757    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-run-k8s-cni-cncf-io\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:57.487768    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-multus-conf-dir\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487792    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/556921c6-b157-4c59-a01f-fb4943d1020b-host-slash\") pod \"iptables-alerter-jp6vf\" (UID: \"556921c6-b157-4c59-a01f-fb4943d1020b\") " pod="openshift-network-operator/iptables-alerter-jp6vf"
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487840    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-multus-conf-dir\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:57.487869    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret podName:9753f0f7-1409-4552-aaad-995fd401dd48 nodeName:}" failed. No retries permitted until 2026-07-09 14:20:57.987846103 +0000 UTC m=+2.014940481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret") pod "global-pull-secret-syncer-7jk5k" (UID: "9753f0f7-1409-4552-aaad-995fd401dd48") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/556921c6-b157-4c59-a01f-fb4943d1020b-host-slash\") pod \"iptables-alerter-jp6vf\" (UID: \"556921c6-b157-4c59-a01f-fb4943d1020b\") " pod="openshift-network-operator/iptables-alerter-jp6vf"
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487919    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-kubernetes\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.488768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487933    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fffb39dc-5682-4ec0-9eb0-86bec13ce105-cni-binary-copy\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a909f8f0-7545-4d48-96ee-43c5641a5e3d-serviceca\") pod \"node-ca-g6w9d\" (UID: \"a909f8f0-7545-4d48-96ee-43c5641a5e3d\") " pod="openshift-image-registry/node-ca-g6w9d"
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.487929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-kubernetes\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488079    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-host\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488102    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-multus-socket-dir-parent\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/556921c6-b157-4c59-a01f-fb4943d1020b-iptables-alerter-script\") pod \"iptables-alerter-jp6vf\" (UID: \"556921c6-b157-4c59-a01f-fb4943d1020b\") " pod="openshift-network-operator/iptables-alerter-jp6vf"
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-etc-kubernetes\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488173    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-host\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs\") pod \"network-metrics-daemon-b4crp\" (UID: \"82480873-c990-49f3-a16b-a961f1d330d9\") " pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-multus-socket-dir-parent\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488215    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-etc-kubernetes\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488218    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-device-dir\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:57.488238    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488245    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fffb39dc-5682-4ec0-9eb0-86bec13ce105-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488252    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-device-dir\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5a824f4-706d-4a1a-b5a1-edd1b60054ac-tmp-dir\") pod \"node-resolver-kqqjk\" (UID: \"a5a824f4-706d-4a1a-b5a1-edd1b60054ac\") " pod="openshift-dns/node-resolver-kqqjk"
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:57.488279    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs podName:82480873-c990-49f3-a16b-a961f1d330d9 nodeName:}" failed. No retries permitted until 2026-07-09 14:20:57.988264979 +0000 UTC m=+2.015359355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs") pod "network-metrics-daemon-b4crp" (UID: "82480873-c990-49f3-a16b-a961f1d330d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:20:57.489815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488340    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-sysctl-conf\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488372    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w972t\" (UniqueName: \"kubernetes.io/projected/92f62127-dbbe-4b1c-af6e-3a61c5250cea-kube-api-access-w972t\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-var-lib-cni-multus\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488421    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4385d404-cc52-49a6-984e-7417a0d63935-agent-certs\") pod \"konnectivity-agent-hwjfl\" (UID: \"4385d404-cc52-49a6-984e-7417a0d63935\") " pod="kube-system/konnectivity-agent-hwjfl"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-var-lib-cni-multus\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488498    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-sysctl-conf\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488498    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5a824f4-706d-4a1a-b5a1-edd1b60054ac-tmp-dir\") pod \"node-resolver-kqqjk\" (UID: \"a5a824f4-706d-4a1a-b5a1-edd1b60054ac\") " pod="openshift-dns/node-resolver-kqqjk"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fffb39dc-5682-4ec0-9eb0-86bec13ce105-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a5a824f4-706d-4a1a-b5a1-edd1b60054ac-hosts-file\") pod \"node-resolver-kqqjk\" (UID: \"a5a824f4-706d-4a1a-b5a1-edd1b60054ac\") " pod="openshift-dns/node-resolver-kqqjk"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488559    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-sysctl-d\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-systemd\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ghq2\" (UniqueName: \"kubernetes.io/projected/a909f8f0-7545-4d48-96ee-43c5641a5e3d-kube-api-access-5ghq2\") pod \"node-ca-g6w9d\" (UID: \"a909f8f0-7545-4d48-96ee-43c5641a5e3d\") " pod="openshift-image-registry/node-ca-g6w9d"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-sys-fs\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488659    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-tuned\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488674    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-systemd\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e47b991c-2c73-4bbd-a267-d6a5583a8994-cni-binary-copy\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.490635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbqbp\" (UniqueName: \"kubernetes.io/projected/82480873-c990-49f3-a16b-a961f1d330d9-kube-api-access-vbqbp\") pod \"network-metrics-daemon-b4crp\" (UID: \"82480873-c990-49f3-a16b-a961f1d330d9\") " pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-system-cni-dir\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488737    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/556921c6-b157-4c59-a01f-fb4943d1020b-iptables-alerter-script\") pod \"iptables-alerter-jp6vf\" (UID: \"556921c6-b157-4c59-a01f-fb4943d1020b\") " pod="openshift-network-operator/iptables-alerter-jp6vf"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-var-lib-cni-bin\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488720    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fffb39dc-5682-4ec0-9eb0-86bec13ce105-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488637    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a5a824f4-706d-4a1a-b5a1-edd1b60054ac-hosts-file\") pod \"node-resolver-kqqjk\" (UID: \"a5a824f4-706d-4a1a-b5a1-edd1b60054ac\") " pod="openshift-dns/node-resolver-kqqjk"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-sysctl-d\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488777    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-hostroot\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488821    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e47b991c-2c73-4bbd-a267-d6a5583a8994-multus-daemon-config\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488838    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-sys-fs\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488847    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh59s\" (UniqueName: \"kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s\") pod \"network-check-target-8jlrc\" (UID: \"30fec348-4428-465d-a900-6a779d9e64e6\") " pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488869    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4385d404-cc52-49a6-984e-7417a0d63935-konnectivity-ca\") pod \"konnectivity-agent-hwjfl\" (UID: \"4385d404-cc52-49a6-984e-7417a0d63935\") " pod="kube-system/konnectivity-agent-hwjfl"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488897    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-modprobe-d\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488917    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/415964d8-288a-4bf2-a727-0d6bc50c24a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488928    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-host-var-lib-cni-bin\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488990    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-system-cni-dir\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.488919    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqm9n\" (UniqueName: \"kubernetes.io/projected/a5a824f4-706d-4a1a-b5a1-edd1b60054ac-kube-api-access-bqm9n\") pod \"node-resolver-kqqjk\" (UID: \"a5a824f4-706d-4a1a-b5a1-edd1b60054ac\") " pod="openshift-dns/node-resolver-kqqjk"
Jul 09 14:20:57.491210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.489031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mgmr\" (UniqueName: \"kubernetes.io/projected/e47b991c-2c73-4bbd-a267-d6a5583a8994-kube-api-access-5mgmr\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.491659 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.489056    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6tp8\" (UniqueName: \"kubernetes.io/projected/556921c6-b157-4c59-a01f-fb4943d1020b-kube-api-access-p6tp8\") pod \"iptables-alerter-jp6vf\" (UID: \"556921c6-b157-4c59-a01f-fb4943d1020b\") " pod="openshift-network-operator/iptables-alerter-jp6vf"
Jul 09 14:20:57.491659 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.489219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e47b991c-2c73-4bbd-a267-d6a5583a8994-hostroot\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.491659 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.489337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fffb39dc-5682-4ec0-9eb0-86bec13ce105-os-release\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.491659 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.489420    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-modprobe-d\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.491659 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.489423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fffb39dc-5682-4ec0-9eb0-86bec13ce105-os-release\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.491659 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.489561    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4385d404-cc52-49a6-984e-7417a0d63935-konnectivity-ca\") pod \"konnectivity-agent-hwjfl\" (UID: \"4385d404-cc52-49a6-984e-7417a0d63935\") " pod="kube-system/konnectivity-agent-hwjfl"
Jul 09 14:20:57.491659 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.489657    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fffb39dc-5682-4ec0-9eb0-86bec13ce105-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.491659 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.489945    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e47b991c-2c73-4bbd-a267-d6a5583a8994-cni-binary-copy\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.491659 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.489962    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92f62127-dbbe-4b1c-af6e-3a61c5250cea-tmp\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.491659 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.490583    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e47b991c-2c73-4bbd-a267-d6a5583a8994-multus-daemon-config\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.491659 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.491062    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92f62127-dbbe-4b1c-af6e-3a61c5250cea-etc-tuned\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.491659 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.491096    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4385d404-cc52-49a6-984e-7417a0d63935-agent-certs\") pod \"konnectivity-agent-hwjfl\" (UID: \"4385d404-cc52-49a6-984e-7417a0d63935\") " pod="kube-system/konnectivity-agent-hwjfl"
Jul 09 14:20:57.497473 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:57.497450    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:20:57.497590 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:57.497478    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:20:57.497590 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:57.497491    2563 projected.go:196] Error preparing data for projected volume kube-api-access-xh59s for pod openshift-network-diagnostics/network-check-target-8jlrc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:20:57.497590 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:57.497550    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s podName:30fec348-4428-465d-a900-6a779d9e64e6 nodeName:}" failed. No retries permitted until 2026-07-09 14:20:57.997533941 +0000 UTC m=+2.024628316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xh59s" (UniqueName: "kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s") pod "network-check-target-8jlrc" (UID: "30fec348-4428-465d-a900-6a779d9e64e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:20:57.498917 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.498899    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcxl6\" (UniqueName: \"kubernetes.io/projected/fffb39dc-5682-4ec0-9eb0-86bec13ce105-kube-api-access-fcxl6\") pod \"multus-additional-cni-plugins-xjl9r\" (UID: \"fffb39dc-5682-4ec0-9eb0-86bec13ce105\") " pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.499385 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.499366    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cffj6\" (UniqueName: \"kubernetes.io/projected/415964d8-288a-4bf2-a727-0d6bc50c24a6-kube-api-access-cffj6\") pod \"aws-ebs-csi-driver-node-zd7tk\" (UID: \"415964d8-288a-4bf2-a727-0d6bc50c24a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.499877 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.499860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ghq2\" (UniqueName: \"kubernetes.io/projected/a909f8f0-7545-4d48-96ee-43c5641a5e3d-kube-api-access-5ghq2\") pod \"node-ca-g6w9d\" (UID: \"a909f8f0-7545-4d48-96ee-43c5641a5e3d\") " pod="openshift-image-registry/node-ca-g6w9d"
Jul 09 14:20:57.500170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.500147    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6tp8\" (UniqueName: \"kubernetes.io/projected/556921c6-b157-4c59-a01f-fb4943d1020b-kube-api-access-p6tp8\") pod \"iptables-alerter-jp6vf\" (UID: \"556921c6-b157-4c59-a01f-fb4943d1020b\") " pod="openshift-network-operator/iptables-alerter-jp6vf"
Jul 09 14:20:57.500342 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.500314    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbqbp\" (UniqueName: \"kubernetes.io/projected/82480873-c990-49f3-a16b-a961f1d330d9-kube-api-access-vbqbp\") pod \"network-metrics-daemon-b4crp\" (UID: \"82480873-c990-49f3-a16b-a961f1d330d9\") " pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:20:57.500449 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.500411    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mgmr\" (UniqueName: \"kubernetes.io/projected/e47b991c-2c73-4bbd-a267-d6a5583a8994-kube-api-access-5mgmr\") pod \"multus-fg6l6\" (UID: \"e47b991c-2c73-4bbd-a267-d6a5583a8994\") " pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.500889 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.500870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqm9n\" (UniqueName: \"kubernetes.io/projected/a5a824f4-706d-4a1a-b5a1-edd1b60054ac-kube-api-access-bqm9n\") pod \"node-resolver-kqqjk\" (UID: \"a5a824f4-706d-4a1a-b5a1-edd1b60054ac\") " pod="openshift-dns/node-resolver-kqqjk"
Jul 09 14:20:57.501835 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.501782    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w972t\" (UniqueName: \"kubernetes.io/projected/92f62127-dbbe-4b1c-af6e-3a61c5250cea-kube-api-access-w972t\") pod \"tuned-r6c7f\" (UID: \"92f62127-dbbe-4b1c-af6e-3a61c5250cea\") " pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.603482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.603401    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:20:57.613218 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:57.613195    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b35b94_8922_4ff4_aa77_c987bd7beacc.slice/crio-06580642c9449b9241e2bd9a18edf071eee4fbaf8163414317f1e679dfb94069 WatchSource:0}: Error finding container 06580642c9449b9241e2bd9a18edf071eee4fbaf8163414317f1e679dfb94069: Status 404 returned error can't find the container with id 06580642c9449b9241e2bd9a18edf071eee4fbaf8163414317f1e679dfb94069
Jul 09 14:20:57.635640 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.635604    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kqqjk"
Jul 09 14:20:57.643768 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:57.643746    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a824f4_706d_4a1a_b5a1_edd1b60054ac.slice/crio-85cb76d5b60ecc163dd3a8536577b3ba49c6303d927f99a8b66b2b868f62df10 WatchSource:0}: Error finding container 85cb76d5b60ecc163dd3a8536577b3ba49c6303d927f99a8b66b2b868f62df10: Status 404 returned error can't find the container with id 85cb76d5b60ecc163dd3a8536577b3ba49c6303d927f99a8b66b2b868f62df10
Jul 09 14:20:57.652401 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.652384    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fg6l6"
Jul 09 14:20:57.657124 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.657105    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jp6vf"
Jul 09 14:20:57.660483 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:57.660462    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode47b991c_2c73_4bbd_a267_d6a5583a8994.slice/crio-f1fa3aef727001c158cf9000884b79b482a557966990bc049a09f11815e1a86b WatchSource:0}: Error finding container f1fa3aef727001c158cf9000884b79b482a557966990bc049a09f11815e1a86b: Status 404 returned error can't find the container with id f1fa3aef727001c158cf9000884b79b482a557966990bc049a09f11815e1a86b
Jul 09 14:20:57.666039 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:57.666018    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556921c6_b157_4c59_a01f_fb4943d1020b.slice/crio-3adf5d917750934df304ae2c182c4ec9850a36e6836cf831604c215ee0985a0e WatchSource:0}: Error finding container 3adf5d917750934df304ae2c182c4ec9850a36e6836cf831604c215ee0985a0e: Status 404 returned error can't find the container with id 3adf5d917750934df304ae2c182c4ec9850a36e6836cf831604c215ee0985a0e
Jul 09 14:20:57.677040 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.677024    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hwjfl"
Jul 09 14:20:57.685259 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:57.685242    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4385d404_cc52_49a6_984e_7417a0d63935.slice/crio-42ad50a0419c0f67b3d0c21b320e0b6f44ba0eb808a72cca44cf1cd067aa48e1 WatchSource:0}: Error finding container 42ad50a0419c0f67b3d0c21b320e0b6f44ba0eb808a72cca44cf1cd067aa48e1: Status 404 returned error can't find the container with id 42ad50a0419c0f67b3d0c21b320e0b6f44ba0eb808a72cca44cf1cd067aa48e1
Jul 09 14:20:57.698284 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.698267    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xjl9r"
Jul 09 14:20:57.705728 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:57.705709    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfffb39dc_5682_4ec0_9eb0_86bec13ce105.slice/crio-6bfa62ba43a0b725ec1424334a1d815111b870de4aab8795dfe78e5dd5dd2193 WatchSource:0}: Error finding container 6bfa62ba43a0b725ec1424334a1d815111b870de4aab8795dfe78e5dd5dd2193: Status 404 returned error can't find the container with id 6bfa62ba43a0b725ec1424334a1d815111b870de4aab8795dfe78e5dd5dd2193
Jul 09 14:20:57.716193 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.716179    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g6w9d"
Jul 09 14:20:57.723857 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:57.723837    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda909f8f0_7545_4d48_96ee_43c5641a5e3d.slice/crio-0e45a53e19107dd1d25f70fb879ad5b4e44aa3ba45506f2aa08d03f171d52c77 WatchSource:0}: Error finding container 0e45a53e19107dd1d25f70fb879ad5b4e44aa3ba45506f2aa08d03f171d52c77: Status 404 returned error can't find the container with id 0e45a53e19107dd1d25f70fb879ad5b4e44aa3ba45506f2aa08d03f171d52c77
Jul 09 14:20:57.728709 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.728694    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk"
Jul 09 14:20:57.734049 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.733876    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r6c7f"
Jul 09 14:20:57.737725 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:57.737707    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415964d8_288a_4bf2_a727_0d6bc50c24a6.slice/crio-d971fa3610144d689323745785fd21e3278ebdd1866547a99381e8b0e53d89c2 WatchSource:0}: Error finding container d971fa3610144d689323745785fd21e3278ebdd1866547a99381e8b0e53d89c2: Status 404 returned error can't find the container with id d971fa3610144d689323745785fd21e3278ebdd1866547a99381e8b0e53d89c2
Jul 09 14:20:57.741894 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:57.741871    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f62127_dbbe_4b1c_af6e_3a61c5250cea.slice/crio-9e3d085086b9f3bfa133bd145a545e97c6570d5fded86750eebd9489b6bdfdc1 WatchSource:0}: Error finding container 9e3d085086b9f3bfa133bd145a545e97c6570d5fded86750eebd9489b6bdfdc1: Status 404 returned error can't find the container with id 9e3d085086b9f3bfa133bd145a545e97c6570d5fded86750eebd9489b6bdfdc1
Jul 09 14:20:57.992358 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.992285    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs\") pod \"network-metrics-daemon-b4crp\" (UID: \"82480873-c990-49f3-a16b-a961f1d330d9\") " pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:20:57.992505 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:57.992374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret\") pod \"global-pull-secret-syncer-7jk5k\" (UID: \"9753f0f7-1409-4552-aaad-995fd401dd48\") " pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:20:57.992505 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:57.992451    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:20:57.992505 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:57.992450    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:20:57.992682 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:57.992508    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret podName:9753f0f7-1409-4552-aaad-995fd401dd48 nodeName:}" failed. No retries permitted until 2026-07-09 14:20:58.992489624 +0000 UTC m=+3.019583984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret") pod "global-pull-secret-syncer-7jk5k" (UID: "9753f0f7-1409-4552-aaad-995fd401dd48") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:20:57.992682 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:57.992527    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs podName:82480873-c990-49f3-a16b-a961f1d330d9 nodeName:}" failed. No retries permitted until 2026-07-09 14:20:58.992517487 +0000 UTC m=+3.019611850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs") pod "network-metrics-daemon-b4crp" (UID: "82480873-c990-49f3-a16b-a961f1d330d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:20:58.022759 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:58.022731    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:20:58.093298 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:58.093265    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh59s\" (UniqueName: \"kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s\") pod \"network-check-target-8jlrc\" (UID: \"30fec348-4428-465d-a900-6a779d9e64e6\") " pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:20:58.093515 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:58.093499    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:20:58.093588 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:58.093524    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:20:58.093588 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:58.093536    2563 projected.go:196] Error preparing data for projected volume kube-api-access-xh59s for pod openshift-network-diagnostics/network-check-target-8jlrc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:20:58.093685 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:58.093606    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s podName:30fec348-4428-465d-a900-6a779d9e64e6 nodeName:}" failed. No retries permitted until 2026-07-09 14:20:59.093574048 +0000 UTC m=+3.120668421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xh59s" (UniqueName: "kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s") pod "network-check-target-8jlrc" (UID: "30fec348-4428-465d-a900-6a779d9e64e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:20:58.307602 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:20:58.307570    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46a34aa9fbfdc20a772f622b306ebd77.slice/crio-d4ecd76c5dd3a890f20ed9c756637fdcdaaa1c3349392ee24f7c79693df6166b WatchSource:0}: Error finding container d4ecd76c5dd3a890f20ed9c756637fdcdaaa1c3349392ee24f7c79693df6166b: Status 404 returned error can't find the container with id d4ecd76c5dd3a890f20ed9c756637fdcdaaa1c3349392ee24f7c79693df6166b
Jul 09 14:20:58.363709 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:58.363645    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:15:57 +0000 UTC" deadline="2028-02-20 05:02:33.119299505 +0000 UTC"
Jul 09 14:20:58.363709 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:58.363680    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14174h41m34.755624344s"
Jul 09 14:20:58.471948 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:58.471920    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:20:58.472126 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:58.472044    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:20:58.487384 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:58.487354    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:20:58.490105 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:58.490071    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jp6vf" event={"ID":"556921c6-b157-4c59-a01f-fb4943d1020b","Type":"ContainerStarted","Data":"3adf5d917750934df304ae2c182c4ec9850a36e6836cf831604c215ee0985a0e"}
Jul 09 14:20:58.517779 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:58.517615    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fg6l6" event={"ID":"e47b991c-2c73-4bbd-a267-d6a5583a8994","Type":"ContainerStarted","Data":"f1fa3aef727001c158cf9000884b79b482a557966990bc049a09f11815e1a86b"}
Jul 09 14:20:58.524323 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:58.523997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz" event={"ID":"09b35b94-8922-4ff4-aa77-c987bd7beacc","Type":"ContainerStarted","Data":"06580642c9449b9241e2bd9a18edf071eee4fbaf8163414317f1e679dfb94069"}
Jul 09 14:20:58.548761 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:58.548610    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal" event={"ID":"46a34aa9fbfdc20a772f622b306ebd77","Type":"ContainerStarted","Data":"d4ecd76c5dd3a890f20ed9c756637fdcdaaa1c3349392ee24f7c79693df6166b"}
Jul 09 14:20:58.550415 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:58.550386    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r6c7f" event={"ID":"92f62127-dbbe-4b1c-af6e-3a61c5250cea","Type":"ContainerStarted","Data":"9e3d085086b9f3bfa133bd145a545e97c6570d5fded86750eebd9489b6bdfdc1"}
Jul 09 14:20:58.555640 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:58.553914    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk" event={"ID":"415964d8-288a-4bf2-a727-0d6bc50c24a6","Type":"ContainerStarted","Data":"d971fa3610144d689323745785fd21e3278ebdd1866547a99381e8b0e53d89c2"}
Jul 09 14:20:58.563880 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:58.563857    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g6w9d" event={"ID":"a909f8f0-7545-4d48-96ee-43c5641a5e3d","Type":"ContainerStarted","Data":"0e45a53e19107dd1d25f70fb879ad5b4e44aa3ba45506f2aa08d03f171d52c77"}
Jul 09 14:20:58.578891 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:58.578865    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kqqjk" event={"ID":"a5a824f4-706d-4a1a-b5a1-edd1b60054ac","Type":"ContainerStarted","Data":"85cb76d5b60ecc163dd3a8536577b3ba49c6303d927f99a8b66b2b868f62df10"}
Jul 09 14:20:58.586882 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:58.586785    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjl9r" event={"ID":"fffb39dc-5682-4ec0-9eb0-86bec13ce105","Type":"ContainerStarted","Data":"6bfa62ba43a0b725ec1424334a1d815111b870de4aab8795dfe78e5dd5dd2193"}
Jul 09 14:20:58.594772 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:58.594585    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hwjfl" event={"ID":"4385d404-cc52-49a6-984e-7417a0d63935","Type":"ContainerStarted","Data":"42ad50a0419c0f67b3d0c21b320e0b6f44ba0eb808a72cca44cf1cd067aa48e1"}
Jul 09 14:20:59.002495 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:59.002262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret\") pod \"global-pull-secret-syncer-7jk5k\" (UID: \"9753f0f7-1409-4552-aaad-995fd401dd48\") " pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:20:59.002641 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:59.002520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs\") pod \"network-metrics-daemon-b4crp\" (UID: \"82480873-c990-49f3-a16b-a961f1d330d9\") " pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:20:59.002641 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:59.002563    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:20:59.002758 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:59.002648    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret podName:9753f0f7-1409-4552-aaad-995fd401dd48 nodeName:}" failed. No retries permitted until 2026-07-09 14:21:01.00262732 +0000 UTC m=+5.029721699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret") pod "global-pull-secret-syncer-7jk5k" (UID: "9753f0f7-1409-4552-aaad-995fd401dd48") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:20:59.002758 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:59.002651    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:20:59.002758 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:59.002709    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs podName:82480873-c990-49f3-a16b-a961f1d330d9 nodeName:}" failed. No retries permitted until 2026-07-09 14:21:01.002692282 +0000 UTC m=+5.029786655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs") pod "network-metrics-daemon-b4crp" (UID: "82480873-c990-49f3-a16b-a961f1d330d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:20:59.051651 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:59.051622    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:20:59.103789 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:59.103207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh59s\" (UniqueName: \"kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s\") pod \"network-check-target-8jlrc\" (UID: \"30fec348-4428-465d-a900-6a779d9e64e6\") " pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:20:59.103789 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:59.103377    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:20:59.103789 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:59.103399    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:20:59.103789 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:59.103411    2563 projected.go:196] Error preparing data for projected volume kube-api-access-xh59s for pod openshift-network-diagnostics/network-check-target-8jlrc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:20:59.103789 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:59.103468    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s podName:30fec348-4428-465d-a900-6a779d9e64e6 nodeName:}" failed. No retries permitted until 2026-07-09 14:21:01.103450802 +0000 UTC m=+5.130545175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xh59s" (UniqueName: "kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s") pod "network-check-target-8jlrc" (UID: "30fec348-4428-465d-a900-6a779d9e64e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:20:59.364727 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:59.364614    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:15:57 +0000 UTC" deadline="2028-03-14 20:42:04.132677732 +0000 UTC"
Jul 09 14:20:59.364727 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:59.364680    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14742h21m4.768002023s"
Jul 09 14:20:59.454608 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:59.454568    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:20:59.454785 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:59.454718    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:20:59.455161 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:59.455141    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:20:59.455261 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:20:59.455240    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:20:59.606820 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:20:59.602458    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:21:00.464835 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:00.464785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:00.465252 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:00.464927    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:01.018117 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:01.018079    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs\") pod \"network-metrics-daemon-b4crp\" (UID: \"82480873-c990-49f3-a16b-a961f1d330d9\") " pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:01.018303 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:01.018197    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret\") pod \"global-pull-secret-syncer-7jk5k\" (UID: \"9753f0f7-1409-4552-aaad-995fd401dd48\") " pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:01.018367 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:01.018324    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:21:01.018419 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:01.018386    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret podName:9753f0f7-1409-4552-aaad-995fd401dd48 nodeName:}" failed. No retries permitted until 2026-07-09 14:21:05.018368145 +0000 UTC m=+9.045462527 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret") pod "global-pull-secret-syncer-7jk5k" (UID: "9753f0f7-1409-4552-aaad-995fd401dd48") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:21:01.018783 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:01.018763    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:21:01.018907 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:01.018894    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs podName:82480873-c990-49f3-a16b-a961f1d330d9 nodeName:}" failed. No retries permitted until 2026-07-09 14:21:05.018877016 +0000 UTC m=+9.045971377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs") pod "network-metrics-daemon-b4crp" (UID: "82480873-c990-49f3-a16b-a961f1d330d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:21:01.119247 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:01.119216    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh59s\" (UniqueName: \"kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s\") pod \"network-check-target-8jlrc\" (UID: \"30fec348-4428-465d-a900-6a779d9e64e6\") " pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:01.119420 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:01.119351    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:21:01.119420 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:01.119366    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:21:01.119420 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:01.119375    2563 projected.go:196] Error preparing data for projected volume kube-api-access-xh59s for pod openshift-network-diagnostics/network-check-target-8jlrc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:21:01.119420 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:01.119418    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s podName:30fec348-4428-465d-a900-6a779d9e64e6 nodeName:}" failed. No retries permitted until 2026-07-09 14:21:05.119405422 +0000 UTC m=+9.146499794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xh59s" (UniqueName: "kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s") pod "network-check-target-8jlrc" (UID: "30fec348-4428-465d-a900-6a779d9e64e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:21:01.455338 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:01.454608    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:01.455338 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:01.454753    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:01.455338 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:01.455148    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:01.455338 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:01.455238    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:02.456129 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:02.456097    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:02.456583 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:02.456213    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:03.454528 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:03.453870    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:03.454528 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:03.454003    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:03.454528 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:03.453866    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:03.454528 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:03.454481    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:04.453955 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:04.453926    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:04.454334 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:04.454061    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:05.051695 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:05.051662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret\") pod \"global-pull-secret-syncer-7jk5k\" (UID: \"9753f0f7-1409-4552-aaad-995fd401dd48\") " pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:05.051895 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:05.051712    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs\") pod \"network-metrics-daemon-b4crp\" (UID: \"82480873-c990-49f3-a16b-a961f1d330d9\") " pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:05.051895 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:05.051865    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:21:05.052012 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:05.051914    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs podName:82480873-c990-49f3-a16b-a961f1d330d9 nodeName:}" failed. No retries permitted until 2026-07-09 14:21:13.051898928 +0000 UTC m=+17.078993290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs") pod "network-metrics-daemon-b4crp" (UID: "82480873-c990-49f3-a16b-a961f1d330d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:21:05.052379 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:05.052292    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:21:05.052379 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:05.052351    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret podName:9753f0f7-1409-4552-aaad-995fd401dd48 nodeName:}" failed. No retries permitted until 2026-07-09 14:21:13.052333088 +0000 UTC m=+17.079427449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret") pod "global-pull-secret-syncer-7jk5k" (UID: "9753f0f7-1409-4552-aaad-995fd401dd48") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:21:05.152520 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:05.152486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh59s\" (UniqueName: \"kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s\") pod \"network-check-target-8jlrc\" (UID: \"30fec348-4428-465d-a900-6a779d9e64e6\") " pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:05.152700 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:05.152631    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:21:05.152700 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:05.152648    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:21:05.152700 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:05.152657    2563 projected.go:196] Error preparing data for projected volume kube-api-access-xh59s for pod openshift-network-diagnostics/network-check-target-8jlrc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:21:05.152860 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:05.152715    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s podName:30fec348-4428-465d-a900-6a779d9e64e6 nodeName:}" failed. No retries permitted until 2026-07-09 14:21:13.152697074 +0000 UTC m=+17.179791453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xh59s" (UniqueName: "kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s") pod "network-check-target-8jlrc" (UID: "30fec348-4428-465d-a900-6a779d9e64e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:21:05.454749 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:05.454662    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:05.455190 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:05.454674    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:05.455190 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:05.454815    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:05.455190 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:05.454881    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:06.457106 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:06.457071    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:06.457504 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:06.457182    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:07.454396 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:07.454362    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:07.454579 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:07.454488    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:07.454926 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:07.454901    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:07.455047 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:07.455010    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:08.453819 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:08.453771    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:08.454253 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:08.453995    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:09.454899 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:09.454542    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:09.454899 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:09.454542    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:09.454899 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:09.454718    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:09.454899 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:09.454756    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:10.453741 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:10.453705    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:10.453907 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:10.453860    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:11.454460 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:11.454420    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:11.454460 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:11.454458    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:11.454915 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:11.454564    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:11.454915 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:11.454669    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:12.454156 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:12.454088    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:12.454333 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:12.454247    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:13.120625 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:13.120588    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs\") pod \"network-metrics-daemon-b4crp\" (UID: \"82480873-c990-49f3-a16b-a961f1d330d9\") " pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:13.121040 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:13.120663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret\") pod \"global-pull-secret-syncer-7jk5k\" (UID: \"9753f0f7-1409-4552-aaad-995fd401dd48\") " pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:13.121040 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:13.120753    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:21:13.121040 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:13.120831    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs podName:82480873-c990-49f3-a16b-a961f1d330d9 nodeName:}" failed. No retries permitted until 2026-07-09 14:21:29.120812248 +0000 UTC m=+33.147906619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs") pod "network-metrics-daemon-b4crp" (UID: "82480873-c990-49f3-a16b-a961f1d330d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:21:13.121040 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:13.120753    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:21:13.121040 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:13.120873    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret podName:9753f0f7-1409-4552-aaad-995fd401dd48 nodeName:}" failed. No retries permitted until 2026-07-09 14:21:29.120862447 +0000 UTC m=+33.147956819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret") pod "global-pull-secret-syncer-7jk5k" (UID: "9753f0f7-1409-4552-aaad-995fd401dd48") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:21:13.221451 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:13.221411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh59s\" (UniqueName: \"kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s\") pod \"network-check-target-8jlrc\" (UID: \"30fec348-4428-465d-a900-6a779d9e64e6\") " pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:13.221604 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:13.221578    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:21:13.221604 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:13.221601    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:21:13.221674 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:13.221610    2563 projected.go:196] Error preparing data for projected volume kube-api-access-xh59s for pod openshift-network-diagnostics/network-check-target-8jlrc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:21:13.221674 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:13.221663    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s podName:30fec348-4428-465d-a900-6a779d9e64e6 nodeName:}" failed. No retries permitted until 2026-07-09 14:21:29.221648664 +0000 UTC m=+33.248743023 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xh59s" (UniqueName: "kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s") pod "network-check-target-8jlrc" (UID: "30fec348-4428-465d-a900-6a779d9e64e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:21:13.453851 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:13.453769    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:13.453851 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:13.453813    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:13.454033 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:13.453919    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:13.454069 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:13.454041    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:14.453905 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:14.453866    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:14.454340 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:14.454022    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:15.454112 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:15.454078    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:15.454511 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:15.454078    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:15.454511 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:15.454193    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:15.454511 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:15.454311    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:16.457191 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:16.455332    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:16.457191 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:16.455481    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:17.454338 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:17.454302    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:17.454491 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:17.454351    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:17.454491 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:17.454424    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:17.454569 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:17.454539    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:18.454508 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:18.454231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:18.454965 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:18.454580    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:18.650455 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:18.650060    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r6c7f" event={"ID":"92f62127-dbbe-4b1c-af6e-3a61c5250cea","Type":"ContainerStarted","Data":"2e84a84d7a97ea78a6106a9c0b90760968bf6781ff10f608e28254b14915e87c"}
Jul 09 14:21:18.651830 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:18.651669    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fg6l6" event={"ID":"e47b991c-2c73-4bbd-a267-d6a5583a8994","Type":"ContainerStarted","Data":"152ad60034deeadfe006572c7851281f55b2e7a489d865adb9adc0ca0f5ece76"}
Jul 09 14:21:18.653134 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:18.653119    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-234.ec2.internal" event={"ID":"27720bce3ffdbdb8ce1870f3c11220d9","Type":"ContainerStarted","Data":"077dba86276bb4eb532729aa02d8f7eeabb6788830c20025e42ccc7296c37269"}
Jul 09 14:21:18.673386 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:18.670250    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r6c7f" podStartSLOduration=2.566255518 podStartE2EDuration="22.670232309s" totalImagesPullingTime="20.103976791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:21:18.670145594 +0000 UTC m=+22.697239988" watchObservedRunningTime="2026-07-09 14:21:18.670232309 +0000 UTC m=+22.697326690"
Jul 09 14:21:18.707914 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:18.707428    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-234.ec2.internal" podStartSLOduration=21.707405984 podStartE2EDuration="21.707405984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:20:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:21:18.685859583 +0000 UTC m=+22.712953964" watchObservedRunningTime="2026-07-09 14:21:18.707405984 +0000 UTC m=+22.734500362"
Jul 09 14:21:18.708034 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:18.707974    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fg6l6" podStartSLOduration=2.276175682 podStartE2EDuration="22.707961572s" totalImagesPullingTime="20.43178589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:21:18.707765524 +0000 UTC m=+22.734859906" watchObservedRunningTime="2026-07-09 14:21:18.707961572 +0000 UTC m=+22.735055955"
Jul 09 14:21:19.454320 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.454145    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:19.454472 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.454163    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:19.454472 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:19.454426    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:19.454472 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:19.454450    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:19.660270 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.660190    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kqqjk" event={"ID":"a5a824f4-706d-4a1a-b5a1-edd1b60054ac","Type":"ContainerStarted","Data":"d9c9a0fba737d48a9c66f1e73fef7edac9d2efbbecfb504932c2a97f124932c7"}
Jul 09 14:21:19.661620 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.661597    2563 generic.go:356] "Generic (PLEG): container finished" podID="fffb39dc-5682-4ec0-9eb0-86bec13ce105" containerID="6f021666c9df8645df4d79122a405bc22201f4d1199d63f398c3876ab9dd055a" exitCode=0
Jul 09 14:21:19.661752 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.661661    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjl9r" event={"ID":"fffb39dc-5682-4ec0-9eb0-86bec13ce105","Type":"ContainerDied","Data":"6f021666c9df8645df4d79122a405bc22201f4d1199d63f398c3876ab9dd055a"}
Jul 09 14:21:19.663032 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.662999    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hwjfl" event={"ID":"4385d404-cc52-49a6-984e-7417a0d63935","Type":"ContainerStarted","Data":"5679ebdf9934995f8b97bbccd87648697b9db045deefe376b273d909a1f3c3df"}
Jul 09 14:21:19.664359 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.664335    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jp6vf" event={"ID":"556921c6-b157-4c59-a01f-fb4943d1020b","Type":"ContainerStarted","Data":"2e4e70eb91a588243da4f852e27ef2edd115a835aa8552e89b01955b70442b86"}
Jul 09 14:21:19.667131 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.667115    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:21:19.667448 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.667429    2563 generic.go:356] "Generic (PLEG): container finished" podID="09b35b94-8922-4ff4-aa77-c987bd7beacc" containerID="d502cc282c467678ad42c96b28db98ca9da8a3605f197372b40d0b9d2a6cb8d1" exitCode=1
Jul 09 14:21:19.667525 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.667499    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz" event={"ID":"09b35b94-8922-4ff4-aa77-c987bd7beacc","Type":"ContainerStarted","Data":"77e97de3b645f39c1f92f37ba0252704fed85105e9753e142b6f0dd8e74fb2d8"}
Jul 09 14:21:19.667582 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.667562    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz" event={"ID":"09b35b94-8922-4ff4-aa77-c987bd7beacc","Type":"ContainerStarted","Data":"026cdb37178a7b39a8b1c3629aa10383abbd483c7fddfd9f338231fcb093742d"}
Jul 09 14:21:19.667622 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.667607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz" event={"ID":"09b35b94-8922-4ff4-aa77-c987bd7beacc","Type":"ContainerStarted","Data":"897ab7149e3c37389b9e606b58aeb70ae8767e5d60597ba03c32751adfeffb23"}
Jul 09 14:21:19.667655 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.667638    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz" event={"ID":"09b35b94-8922-4ff4-aa77-c987bd7beacc","Type":"ContainerStarted","Data":"f6a562b679b5f5e4fa74df1958b0170ca1b48c5a218f85cc3c99c919d6755590"}
Jul 09 14:21:19.667703 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.667673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz" event={"ID":"09b35b94-8922-4ff4-aa77-c987bd7beacc","Type":"ContainerDied","Data":"d502cc282c467678ad42c96b28db98ca9da8a3605f197372b40d0b9d2a6cb8d1"}
Jul 09 14:21:19.667753 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.667721    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz" event={"ID":"09b35b94-8922-4ff4-aa77-c987bd7beacc","Type":"ContainerStarted","Data":"154ff7165a16753749527187d175589ff461b08e2ccfc62485ebb725c527d49e"}
Jul 09 14:21:19.669204 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.669186    2563 generic.go:356] "Generic (PLEG): container finished" podID="46a34aa9fbfdc20a772f622b306ebd77" containerID="d01ec3a5b31ab076ec52b4efd92093cc2eb3c5336e6bda3ab721a3dbee5d25b8" exitCode=0
Jul 09 14:21:19.669300 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.669242    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal" event={"ID":"46a34aa9fbfdc20a772f622b306ebd77","Type":"ContainerDied","Data":"d01ec3a5b31ab076ec52b4efd92093cc2eb3c5336e6bda3ab721a3dbee5d25b8"}
Jul 09 14:21:19.670605 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.670588    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk" event={"ID":"415964d8-288a-4bf2-a727-0d6bc50c24a6","Type":"ContainerStarted","Data":"b1e814e41d8c2105cfd668a43e1258bb3a4256e701dc840eb0aab8d73a8352fb"}
Jul 09 14:21:19.671982 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.671961    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g6w9d" event={"ID":"a909f8f0-7545-4d48-96ee-43c5641a5e3d","Type":"ContainerStarted","Data":"77a026207c3c2342fdf16d8dba78f838fc06c953384d83679aeec2698c283894"}
Jul 09 14:21:19.676502 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.676464    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kqqjk" podStartSLOduration=3.515358762 podStartE2EDuration="23.676452663s" totalImagesPullingTime="20.161093901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:21:19.676047842 +0000 UTC m=+23.703142222" watchObservedRunningTime="2026-07-09 14:21:19.676452663 +0000 UTC m=+23.703547044"
Jul 09 14:21:19.692553 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.692522    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hwjfl"
Jul 09 14:21:19.693031 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.693018    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hwjfl"
Jul 09 14:21:19.727613 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.727563    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jp6vf" podStartSLOduration=3.548434194 podStartE2EDuration="23.727549824s" totalImagesPullingTime="20.17911563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:21:19.72701399 +0000 UTC m=+23.754108373" watchObservedRunningTime="2026-07-09 14:21:19.727549824 +0000 UTC m=+23.754644208"
Jul 09 14:21:19.743485 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.743443    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hwjfl" podStartSLOduration=12.230301733 podStartE2EDuration="23.743432008s" totalImagesPullingTime="11.513130275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:21:19.742816867 +0000 UTC m=+23.769911274" watchObservedRunningTime="2026-07-09 14:21:19.743432008 +0000 UTC m=+23.770526443"
Jul 09 14:21:19.780115 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.780072    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g6w9d" podStartSLOduration=3.657980104 podStartE2EDuration="23.780057915s" totalImagesPullingTime="20.122077811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:21:19.758036274 +0000 UTC m=+23.785130654" watchObservedRunningTime="2026-07-09 14:21:19.780057915 +0000 UTC m=+23.807152295"
Jul 09 14:21:19.842309 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.842273    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:19.926694 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:19.926672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:20.130842 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:20.130794    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 14:21:20.349173 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:20.349032    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T14:21:20.130836061Z","UUID":"1933b5b5-f810-4f5b-a269-59c439d3bacb","Handler":null,"Name":"","Endpoint":""}
Jul 09 14:21:20.351544 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:20.351522    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 14:21:20.351652 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:20.351558    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 14:21:20.453889 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:20.453854    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:20.454109 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:20.453975    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:20.676446 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:20.676362    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk" event={"ID":"415964d8-288a-4bf2-a727-0d6bc50c24a6","Type":"ContainerStarted","Data":"b02f48b78d1287ec2c7f6414b936427f9edde0722e8de30553c430c572f83c74"}
Jul 09 14:21:20.677969 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:20.677939    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal" event={"ID":"46a34aa9fbfdc20a772f622b306ebd77","Type":"ContainerStarted","Data":"4794f8a7c2165a749728b4cd2dcb43fb96c8a2276c120c9a35df4bb11adca1dc"}
Jul 09 14:21:20.678233 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:20.678215    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hwjfl"
Jul 09 14:21:20.678717 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:20.678701    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hwjfl"
Jul 09 14:21:20.692937 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:20.692895    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-234.ec2.internal" podStartSLOduration=23.692883666 podStartE2EDuration="23.692883666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:20:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:21:20.692558005 +0000 UTC m=+24.719652385" watchObservedRunningTime="2026-07-09 14:21:20.692883666 +0000 UTC m=+24.719978047"
Jul 09 14:21:20.754916 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:20.754885    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:21.454415 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:21.454260    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:21.454669 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:21.454322    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:21.454669 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:21.454491    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:21.454669 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:21.454569    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:21.683294 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:21.683266    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:21:21.683813 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:21.683596    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz" event={"ID":"09b35b94-8922-4ff4-aa77-c987bd7beacc","Type":"ContainerStarted","Data":"5e223f267c5519542fa8cd35821ee41751d938b2a83543f5366462c13a0db4e9"}
Jul 09 14:21:21.685650 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:21.685617    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk" event={"ID":"415964d8-288a-4bf2-a727-0d6bc50c24a6","Type":"ContainerStarted","Data":"f76afb20700ece89263e32cf13981b8cc7f567cce93b84bb65b276cf7784f04a"}
Jul 09 14:21:21.705304 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:21.705260    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd7tk" podStartSLOduration=3.232807938 podStartE2EDuration="25.705247663s" totalImagesPullingTime="22.472439725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:20:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:21:21.705154999 +0000 UTC m=+25.732249392" watchObservedRunningTime="2026-07-09 14:21:21.705247663 +0000 UTC m=+25.732342043"
Jul 09 14:21:22.454135 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:22.454105    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:22.454312 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:22.454222    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:22.923937 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:22.923851    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:22.998405 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:22.998363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:23.267827 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:23.267718    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:23.357694 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:23.357658    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:23.454219 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:23.454185    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:23.454219 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:23.454202    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:23.454414 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:23.454311    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:23.454460 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:23.454445    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:23.458612 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:23.458537    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:23.833517 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:23.833440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:23.875872 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:23.875685    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kqqjk_a5a824f4-706d-4a1a-b5a1-edd1b60054ac/dns-node-resolver/0.log"
Jul 09 14:21:23.937232 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:23.937191    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:24.036199 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:24.036157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:24.454585 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:24.454551    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:24.454715 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:24.454669    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:24.495266 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:24.495236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:24.587205 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:24.587125    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:24.696314 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:24.696290    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:21:24.696710 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:24.696665    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz" event={"ID":"09b35b94-8922-4ff4-aa77-c987bd7beacc","Type":"ContainerStarted","Data":"4d54855e9098822b7370e93761e1b3b7b584681bbf4e9618ee09ff954a3ff2aa"}
Jul 09 14:21:24.697029 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:24.697006    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:21:24.697182 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:24.697166    2563 scope.go:117] "RemoveContainer" containerID="d502cc282c467678ad42c96b28db98ca9da8a3605f197372b40d0b9d2a6cb8d1"
Jul 09 14:21:24.716186 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:24.716167    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:21:24.738012 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:24.737743    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:24.811353 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:24.811318    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:25.275332 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:25.275301    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g6w9d_a909f8f0-7545-4d48-96ee-43c5641a5e3d/node-ca/0.log"
Jul 09 14:21:25.453881 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:25.453848    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:25.453881 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:25.453872    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:25.454114 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:25.453992    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:25.454114 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:25.454102    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:25.703585 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:25.703558    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:21:25.704005 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:25.703971    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz" event={"ID":"09b35b94-8922-4ff4-aa77-c987bd7beacc","Type":"ContainerStarted","Data":"b644b5d67a2f6d326f0c3abb7426c9ef65c0dc4442a212012c8ee9020fb3fea8"}
Jul 09 14:21:25.704193 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:25.704176    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:21:25.704388 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:25.704375    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:21:25.722178 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:25.722155    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:21:25.735134 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:25.735092    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz" podStartSLOduration=8.745832089 podStartE2EDuration="29.735077947s" totalImagesPullingTime="20.989245858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:21:25.734924528 +0000 UTC m=+29.762018909" watchObservedRunningTime="2026-07-09 14:21:25.735077947 +0000 UTC m=+29.762172326"
Jul 09 14:21:25.840599 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:25.840568    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8jlrc"]
Jul 09 14:21:25.840780 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:25.840690    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:25.840888 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:25.840824    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:25.845383 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:25.845035    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7jk5k"]
Jul 09 14:21:25.845383 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:25.845086    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b4crp"]
Jul 09 14:21:25.845383 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:25.845145    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:25.845383 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:25.845233    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:25.845383 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:25.845289    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:25.845383 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:25.845356    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:26.406539 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:26.406330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:26.476795 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:26.476759    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:26.978507 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:26.978474    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:27.080089 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:27.080065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:27.454638 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:27.454557    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:27.455117 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:27.454651    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:27.455117 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:27.454656    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:27.455117 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:27.454665    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:27.455117 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:27.454742    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:27.455117 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:27.454819    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:27.523842 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:27.523813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:27.709381 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:27.709303    2563 generic.go:356] "Generic (PLEG): container finished" podID="fffb39dc-5682-4ec0-9eb0-86bec13ce105" containerID="f15e404a39c46bbca8ba1d1a84daa9514573402709074c4ef51d077cf5b0f841" exitCode=0
Jul 09 14:21:27.709513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:27.709398    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjl9r" event={"ID":"fffb39dc-5682-4ec0-9eb0-86bec13ce105","Type":"ContainerDied","Data":"f15e404a39c46bbca8ba1d1a84daa9514573402709074c4ef51d077cf5b0f841"}
Jul 09 14:21:28.218143 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:28.218103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:28.319276 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:28.319191    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:29.143583 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:29.143519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret\") pod \"global-pull-secret-syncer-7jk5k\" (UID: \"9753f0f7-1409-4552-aaad-995fd401dd48\") " pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:29.143583 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:29.143553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs\") pod \"network-metrics-daemon-b4crp\" (UID: \"82480873-c990-49f3-a16b-a961f1d330d9\") " pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:29.144172 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:29.143656    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:21:29.144172 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:29.143668    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:21:29.144172 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:29.143702    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs podName:82480873-c990-49f3-a16b-a961f1d330d9 nodeName:}" failed. No retries permitted until 2026-07-09 14:22:01.143688957 +0000 UTC m=+65.170783316 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs") pod "network-metrics-daemon-b4crp" (UID: "82480873-c990-49f3-a16b-a961f1d330d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:21:29.144172 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:29.143714    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret podName:9753f0f7-1409-4552-aaad-995fd401dd48 nodeName:}" failed. No retries permitted until 2026-07-09 14:22:01.143708264 +0000 UTC m=+65.170802622 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret") pod "global-pull-secret-syncer-7jk5k" (UID: "9753f0f7-1409-4552-aaad-995fd401dd48") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:21:29.243984 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:29.243958    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh59s\" (UniqueName: \"kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s\") pod \"network-check-target-8jlrc\" (UID: \"30fec348-4428-465d-a900-6a779d9e64e6\") " pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:29.244127 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:29.244080    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:21:29.244127 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:29.244092    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:21:29.244127 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:29.244100    2563 projected.go:196] Error preparing data for projected volume kube-api-access-xh59s for pod openshift-network-diagnostics/network-check-target-8jlrc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:21:29.244233 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:29.244142    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s podName:30fec348-4428-465d-a900-6a779d9e64e6 nodeName:}" failed. No retries permitted until 2026-07-09 14:22:01.244130341 +0000 UTC m=+65.271224713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xh59s" (UniqueName: "kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s") pod "network-check-target-8jlrc" (UID: "30fec348-4428-465d-a900-6a779d9e64e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:21:29.453927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:29.453844    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:29.454069 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:29.453940    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:29.454069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:29.453852    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:29.454069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:29.453844    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:29.454069 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:29.454029    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:29.454205 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:29.454103    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:29.716367 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:29.716280    2563 generic.go:356] "Generic (PLEG): container finished" podID="fffb39dc-5682-4ec0-9eb0-86bec13ce105" containerID="838c5818662ec7cec89af78ad7387bda4e543da28caf277ab816d67f3135ec19" exitCode=0
Jul 09 14:21:29.716367 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:29.716348    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjl9r" event={"ID":"fffb39dc-5682-4ec0-9eb0-86bec13ce105","Type":"ContainerDied","Data":"838c5818662ec7cec89af78ad7387bda4e543da28caf277ab816d67f3135ec19"}
Jul 09 14:21:30.661872 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:30.661840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:30.760159 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:30.760123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:31.205999 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:31.205915    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:31.454571 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:31.454542    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:31.454736 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:31.454542    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:31.454736 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:31.454542    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:31.454898 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:31.454747    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:31.454898 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:31.454790    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:31.454898 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:31.454637    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:31.499389 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:31.499318    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:31.578486 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:31.578460    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:31.657051 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:31.657022    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:31.722297 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:31.722267    2563 generic.go:356] "Generic (PLEG): container finished" podID="fffb39dc-5682-4ec0-9eb0-86bec13ce105" containerID="af8d437d0153d021fab29312b367341716ec2ca08e5e6ac8e19edde9f24ff02b" exitCode=0
Jul 09 14:21:31.722637 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:31.722302    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjl9r" event={"ID":"fffb39dc-5682-4ec0-9eb0-86bec13ce105","Type":"ContainerDied","Data":"af8d437d0153d021fab29312b367341716ec2ca08e5e6ac8e19edde9f24ff02b"}
Jul 09 14:21:32.221634 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:32.221605    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:32.833388 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:32.833352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:33.420185 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:33.419984    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:33.453859 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:33.453836    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:33.453986 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:33.453835    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:33.453986 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:33.453956    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:33.454058 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:33.453841    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:33.454058 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:33.454010    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:33.454120 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:33.454072    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:33.639566 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:33.639526    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:33.816465 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:33.816404    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:34.225889 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:34.225862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:34.878293 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:34.878250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:34.981292 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:34.981259    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:35.079755 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:35.079718    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:35.454128 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:35.454094    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:35.454501 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:35.454100    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:35.454501 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:35.454229    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:35.454501 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:35.454314    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:35.454501 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:35.454105    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:35.454501 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:35.454402    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:35.683291 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:35.683206    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:35.747281 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:35.747248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:35.822926 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:35.822891    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:35.949288 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:35.949204    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:36.049676 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:36.049633    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:36.403706 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:36.403674    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:36.500515 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:36.500461    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:36.828984 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:36.828951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:36.954682 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:36.954644    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:37.417609 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:37.417537    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:37.454304 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:37.454284    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:37.454409 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:37.454285    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:37.454409 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:37.454392    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:37.454479 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:37.454284    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:37.454531 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:37.454443    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:37.454563 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:37.454529    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:37.618531 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:37.618500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:37.738790 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:37.738760    2563 generic.go:356] "Generic (PLEG): container finished" podID="fffb39dc-5682-4ec0-9eb0-86bec13ce105" containerID="3f6a4b011db7c2bd062af814cc5eb6ac63a588ce2d0dec453f24b6952aecf5a1" exitCode=0
Jul 09 14:21:37.739004 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:37.738837    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjl9r" event={"ID":"fffb39dc-5682-4ec0-9eb0-86bec13ce105","Type":"ContainerDied","Data":"3f6a4b011db7c2bd062af814cc5eb6ac63a588ce2d0dec453f24b6952aecf5a1"}
Jul 09 14:21:38.031778 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:38.031690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:38.217832 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:38.217787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:38.744127 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:38.744094    2563 generic.go:356] "Generic (PLEG): container finished" podID="fffb39dc-5682-4ec0-9eb0-86bec13ce105" containerID="74cf045ee58fd408ab13d223974f68f97d811411332e6063908fbe5de6acdcde" exitCode=0
Jul 09 14:21:38.744488 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:38.744153    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjl9r" event={"ID":"fffb39dc-5682-4ec0-9eb0-86bec13ce105","Type":"ContainerDied","Data":"74cf045ee58fd408ab13d223974f68f97d811411332e6063908fbe5de6acdcde"}
Jul 09 14:21:38.777312 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:38.777271    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:38.843078 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:38.843050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:39.423566 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:39.423526    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:39.454617 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:39.454591    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:39.454712 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:39.454681    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:39.454712 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:39.454690    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:39.454712 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:39.454686    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:39.454828 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:39.454769    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:39.454922 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:39.454839    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:39.649822 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:39.649767    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:39.749510 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:39.749476    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjl9r" event={"ID":"fffb39dc-5682-4ec0-9eb0-86bec13ce105","Type":"ContainerStarted","Data":"37021cc34cf284cdab27edda9d0709d76fabe61daf04987c6ec44be6839dc80b"}
Jul 09 14:21:39.775186 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:39.775139    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xjl9r" podStartSLOduration=8.527950124 podStartE2EDuration="43.77512326s" totalImagesPullingTime="35.247173136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:20:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:21:39.774853132 +0000 UTC m=+43.801947517" watchObservedRunningTime="2026-07-09 14:21:39.77512326 +0000 UTC m=+43.802217764"
Jul 09 14:21:40.019343 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:40.019268    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:40.222624 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:40.222590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:40.619046 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:40.619015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:41.080117 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:41.080074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:41.419152 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:41.419068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:41.454012 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:41.453987    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:41.454168 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:41.453987    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:41.454168 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:41.454107    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:41.454272 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:41.453992    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:41.454272 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:41.454194    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:41.454272 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:41.454245    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:41.621334 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:41.621298    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:43.197085 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:43.197050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:43.257420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:43.257389    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:43.454082 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:43.453991    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:43.454249 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:43.454097    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:43.454249 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:43.454108    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:43.454249 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:43.454127    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:43.454249 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:43.454214    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:43.454459 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:43.454286    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:45.453986 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:45.453948    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:45.453986 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:45.453984    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:45.454396 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:45.453958    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:45.454396 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:45.454068    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:45.454396 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:45.454132    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:45.454396 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:45.454205    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:47.454158 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:47.454120    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:47.454158 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:47.454135    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:47.454668 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:47.454239    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlrc" podUID="30fec348-4428-465d-a900-6a779d9e64e6"
Jul 09 14:21:47.454668 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:47.454278    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:47.454668 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:47.454361    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7jk5k" podUID="9753f0f7-1409-4552-aaad-995fd401dd48"
Jul 09 14:21:47.454668 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:47.454446    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4crp" podUID="82480873-c990-49f3-a16b-a961f1d330d9"
Jul 09 14:21:47.593381 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:47.593352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:48.186299 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.186222    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:48.291617 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.291584    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:48.325101 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.325081    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-234.ec2.internal" event="NodeReady"
Jul 09 14:21:48.325205 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.325194    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 14:21:48.372744 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.372715    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lhc8l"]
Jul 09 14:21:48.375336 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.375321    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.378985 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.378944    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 14:21:48.379218 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.379187    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 14:21:48.379218 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.379207    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 14:21:48.379315 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.379196    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 14:21:48.379357 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.379346    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m7gnx"]
Jul 09 14:21:48.379574 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.379557    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lsg92\""
Jul 09 14:21:48.382164 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.382104    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m7gnx"
Jul 09 14:21:48.384608 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.384589    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 14:21:48.384706 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.384629    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xxvxp\""
Jul 09 14:21:48.384706 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.384639    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 14:21:48.390330 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.390309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ab41c18-0f1e-43de-aadc-2a2995247e18-data-volume\") pod \"insights-runtime-extractor-lhc8l\" (UID: \"3ab41c18-0f1e-43de-aadc-2a2995247e18\") " pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.390418 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.390342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2xpm\" (UniqueName: \"kubernetes.io/projected/3ab41c18-0f1e-43de-aadc-2a2995247e18-kube-api-access-c2xpm\") pod \"insights-runtime-extractor-lhc8l\" (UID: \"3ab41c18-0f1e-43de-aadc-2a2995247e18\") " pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.390471 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.390421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3ab41c18-0f1e-43de-aadc-2a2995247e18-crio-socket\") pod \"insights-runtime-extractor-lhc8l\" (UID: \"3ab41c18-0f1e-43de-aadc-2a2995247e18\") " pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.390507 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.390475    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ab41c18-0f1e-43de-aadc-2a2995247e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhc8l\" (UID: \"3ab41c18-0f1e-43de-aadc-2a2995247e18\") " pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.390507 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.390504    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ab41c18-0f1e-43de-aadc-2a2995247e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhc8l\" (UID: \"3ab41c18-0f1e-43de-aadc-2a2995247e18\") " pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.391256 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.391240    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lhc8l"]
Jul 09 14:21:48.402893 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.402871    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m7gnx"]
Jul 09 14:21:48.479340 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.478061    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nlk2n"]
Jul 09 14:21:48.481614 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.481595    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nlk2n"
Jul 09 14:21:48.484997 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.484972    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 14:21:48.485089 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.485013    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 14:21:48.485089 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.485033    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 14:21:48.485089 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.485033    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n5vbv\""
Jul 09 14:21:48.488268 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.488246    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nlk2n"]
Jul 09 14:21:48.491357 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.491340    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3ab41c18-0f1e-43de-aadc-2a2995247e18-crio-socket\") pod \"insights-runtime-extractor-lhc8l\" (UID: \"3ab41c18-0f1e-43de-aadc-2a2995247e18\") " pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.491459 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.491373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffd14b51-df34-4e09-95e0-44e398a6d76c-config-volume\") pod \"dns-default-m7gnx\" (UID: \"ffd14b51-df34-4e09-95e0-44e398a6d76c\") " pod="openshift-dns/dns-default-m7gnx"
Jul 09 14:21:48.491459 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.491397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffd14b51-df34-4e09-95e0-44e398a6d76c-tmp-dir\") pod \"dns-default-m7gnx\" (UID: \"ffd14b51-df34-4e09-95e0-44e398a6d76c\") " pod="openshift-dns/dns-default-m7gnx"
Jul 09 14:21:48.491459 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.491454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ab41c18-0f1e-43de-aadc-2a2995247e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhc8l\" (UID: \"3ab41c18-0f1e-43de-aadc-2a2995247e18\") " pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.491604 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.491497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxks2\" (UniqueName: \"kubernetes.io/projected/ffd14b51-df34-4e09-95e0-44e398a6d76c-kube-api-access-xxks2\") pod \"dns-default-m7gnx\" (UID: \"ffd14b51-df34-4e09-95e0-44e398a6d76c\") " pod="openshift-dns/dns-default-m7gnx"
Jul 09 14:21:48.491604 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.491578    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3ab41c18-0f1e-43de-aadc-2a2995247e18-crio-socket\") pod \"insights-runtime-extractor-lhc8l\" (UID: \"3ab41c18-0f1e-43de-aadc-2a2995247e18\") " pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.491604 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.491593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ab41c18-0f1e-43de-aadc-2a2995247e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhc8l\" (UID: \"3ab41c18-0f1e-43de-aadc-2a2995247e18\") " pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.491748 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.491623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ab41c18-0f1e-43de-aadc-2a2995247e18-data-volume\") pod \"insights-runtime-extractor-lhc8l\" (UID: \"3ab41c18-0f1e-43de-aadc-2a2995247e18\") " pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.491748 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.491648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2xpm\" (UniqueName: \"kubernetes.io/projected/3ab41c18-0f1e-43de-aadc-2a2995247e18-kube-api-access-c2xpm\") pod \"insights-runtime-extractor-lhc8l\" (UID: \"3ab41c18-0f1e-43de-aadc-2a2995247e18\") " pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.491748 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.491666    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffd14b51-df34-4e09-95e0-44e398a6d76c-metrics-tls\") pod \"dns-default-m7gnx\" (UID: \"ffd14b51-df34-4e09-95e0-44e398a6d76c\") " pod="openshift-dns/dns-default-m7gnx"
Jul 09 14:21:48.492024 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.492001    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ab41c18-0f1e-43de-aadc-2a2995247e18-data-volume\") pod \"insights-runtime-extractor-lhc8l\" (UID: \"3ab41c18-0f1e-43de-aadc-2a2995247e18\") " pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.492197 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.492177    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ab41c18-0f1e-43de-aadc-2a2995247e18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhc8l\" (UID: \"3ab41c18-0f1e-43de-aadc-2a2995247e18\") " pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.495740 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.495722    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ab41c18-0f1e-43de-aadc-2a2995247e18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhc8l\" (UID: \"3ab41c18-0f1e-43de-aadc-2a2995247e18\") " pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.500177 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.500155    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2xpm\" (UniqueName: \"kubernetes.io/projected/3ab41c18-0f1e-43de-aadc-2a2995247e18-kube-api-access-c2xpm\") pod \"insights-runtime-extractor-lhc8l\" (UID: \"3ab41c18-0f1e-43de-aadc-2a2995247e18\") " pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.504247 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.504222    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:48.567016 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.566992    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:48.592572 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.592550    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b949d69-8e9e-4973-b66e-08caf0dee278-cert\") pod \"ingress-canary-nlk2n\" (UID: \"1b949d69-8e9e-4973-b66e-08caf0dee278\") " pod="openshift-ingress-canary/ingress-canary-nlk2n"
Jul 09 14:21:48.592649 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.592588    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvps8\" (UniqueName: \"kubernetes.io/projected/1b949d69-8e9e-4973-b66e-08caf0dee278-kube-api-access-qvps8\") pod \"ingress-canary-nlk2n\" (UID: \"1b949d69-8e9e-4973-b66e-08caf0dee278\") " pod="openshift-ingress-canary/ingress-canary-nlk2n"
Jul 09 14:21:48.592649 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.592610    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxks2\" (UniqueName: \"kubernetes.io/projected/ffd14b51-df34-4e09-95e0-44e398a6d76c-kube-api-access-xxks2\") pod \"dns-default-m7gnx\" (UID: \"ffd14b51-df34-4e09-95e0-44e398a6d76c\") " pod="openshift-dns/dns-default-m7gnx"
Jul 09 14:21:48.592726 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.592661    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffd14b51-df34-4e09-95e0-44e398a6d76c-metrics-tls\") pod \"dns-default-m7gnx\" (UID: \"ffd14b51-df34-4e09-95e0-44e398a6d76c\") " pod="openshift-dns/dns-default-m7gnx"
Jul 09 14:21:48.592776 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.592758    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffd14b51-df34-4e09-95e0-44e398a6d76c-config-volume\") pod \"dns-default-m7gnx\" (UID: \"ffd14b51-df34-4e09-95e0-44e398a6d76c\") " pod="openshift-dns/dns-default-m7gnx"
Jul 09 14:21:48.592855 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.592787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffd14b51-df34-4e09-95e0-44e398a6d76c-tmp-dir\") pod \"dns-default-m7gnx\" (UID: \"ffd14b51-df34-4e09-95e0-44e398a6d76c\") " pod="openshift-dns/dns-default-m7gnx"
Jul 09 14:21:48.593140 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.593123    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffd14b51-df34-4e09-95e0-44e398a6d76c-tmp-dir\") pod \"dns-default-m7gnx\" (UID: \"ffd14b51-df34-4e09-95e0-44e398a6d76c\") " pod="openshift-dns/dns-default-m7gnx"
Jul 09 14:21:48.593370 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.593353    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffd14b51-df34-4e09-95e0-44e398a6d76c-config-volume\") pod \"dns-default-m7gnx\" (UID: \"ffd14b51-df34-4e09-95e0-44e398a6d76c\") " pod="openshift-dns/dns-default-m7gnx"
Jul 09 14:21:48.595037 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.595022    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffd14b51-df34-4e09-95e0-44e398a6d76c-metrics-tls\") pod \"dns-default-m7gnx\" (UID: \"ffd14b51-df34-4e09-95e0-44e398a6d76c\") " pod="openshift-dns/dns-default-m7gnx"
Jul 09 14:21:48.602013 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.601997    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxks2\" (UniqueName: \"kubernetes.io/projected/ffd14b51-df34-4e09-95e0-44e398a6d76c-kube-api-access-xxks2\") pod \"dns-default-m7gnx\" (UID: \"ffd14b51-df34-4e09-95e0-44e398a6d76c\") " pod="openshift-dns/dns-default-m7gnx"
Jul 09 14:21:48.685616 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.685593    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lhc8l"
Jul 09 14:21:48.691490 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.691470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m7gnx"
Jul 09 14:21:48.693796 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.693767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b949d69-8e9e-4973-b66e-08caf0dee278-cert\") pod \"ingress-canary-nlk2n\" (UID: \"1b949d69-8e9e-4973-b66e-08caf0dee278\") " pod="openshift-ingress-canary/ingress-canary-nlk2n"
Jul 09 14:21:48.693930 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.693911    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvps8\" (UniqueName: \"kubernetes.io/projected/1b949d69-8e9e-4973-b66e-08caf0dee278-kube-api-access-qvps8\") pod \"ingress-canary-nlk2n\" (UID: \"1b949d69-8e9e-4973-b66e-08caf0dee278\") " pod="openshift-ingress-canary/ingress-canary-nlk2n"
Jul 09 14:21:48.696814 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.696777    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b949d69-8e9e-4973-b66e-08caf0dee278-cert\") pod \"ingress-canary-nlk2n\" (UID: \"1b949d69-8e9e-4973-b66e-08caf0dee278\") " pod="openshift-ingress-canary/ingress-canary-nlk2n"
Jul 09 14:21:48.706648 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.706625    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvps8\" (UniqueName: \"kubernetes.io/projected/1b949d69-8e9e-4973-b66e-08caf0dee278-kube-api-access-qvps8\") pod \"ingress-canary-nlk2n\" (UID: \"1b949d69-8e9e-4973-b66e-08caf0dee278\") " pod="openshift-ingress-canary/ingress-canary-nlk2n"
Jul 09 14:21:48.790354 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.790329    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nlk2n"
Jul 09 14:21:48.830903 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.830863    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m7gnx"]
Jul 09 14:21:48.834990 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:21:48.834961    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd14b51_df34_4e09_95e0_44e398a6d76c.slice/crio-b6a20186bdc606467d32483c7ad04ba715b50c6c6cbe38bb584c20d42e6da97a WatchSource:0}: Error finding container b6a20186bdc606467d32483c7ad04ba715b50c6c6cbe38bb584c20d42e6da97a: Status 404 returned error can't find the container with id b6a20186bdc606467d32483c7ad04ba715b50c6c6cbe38bb584c20d42e6da97a
Jul 09 14:21:48.848130 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.847875    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lhc8l"]
Jul 09 14:21:48.852943 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:21:48.852911    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ab41c18_0f1e_43de_aadc_2a2995247e18.slice/crio-95d831978b0f37be9210470980a23eb94959f95a6afa666809c346323f7db22f WatchSource:0}: Error finding container 95d831978b0f37be9210470980a23eb94959f95a6afa666809c346323f7db22f: Status 404 returned error can't find the container with id 95d831978b0f37be9210470980a23eb94959f95a6afa666809c346323f7db22f
Jul 09 14:21:48.920966 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:48.920937    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nlk2n"]
Jul 09 14:21:48.923962 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:21:48.923936    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b949d69_8e9e_4973_b66e_08caf0dee278.slice/crio-14e8a04b3bde59b36027bceff3768bfcd92308b5a20223606911feaba5d984e3 WatchSource:0}: Error finding container 14e8a04b3bde59b36027bceff3768bfcd92308b5a20223606911feaba5d984e3: Status 404 returned error can't find the container with id 14e8a04b3bde59b36027bceff3768bfcd92308b5a20223606911feaba5d984e3
Jul 09 14:21:49.454581 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:49.454545    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:21:49.454766 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:49.454586    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:21:49.454766 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:49.454587    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:21:49.458508 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:49.458483    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 14:21:49.458677 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:49.458655    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 14:21:49.458750 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:49.458681    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d4gsp\""
Jul 09 14:21:49.458825 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:49.458769    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 14:21:49.458915 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:49.458899    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 14:21:49.458973 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:49.458917    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bcf26\""
Jul 09 14:21:49.774151 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:49.774106    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lhc8l" event={"ID":"3ab41c18-0f1e-43de-aadc-2a2995247e18","Type":"ContainerStarted","Data":"95d831978b0f37be9210470980a23eb94959f95a6afa666809c346323f7db22f"}
Jul 09 14:21:49.775943 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:49.775911    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nlk2n" event={"ID":"1b949d69-8e9e-4973-b66e-08caf0dee278","Type":"ContainerStarted","Data":"14e8a04b3bde59b36027bceff3768bfcd92308b5a20223606911feaba5d984e3"}
Jul 09 14:21:49.777219 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:49.777111    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7gnx" event={"ID":"ffd14b51-df34-4e09-95e0-44e398a6d76c","Type":"ContainerStarted","Data":"b6a20186bdc606467d32483c7ad04ba715b50c6c6cbe38bb584c20d42e6da97a"}
Jul 09 14:21:49.822590 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:49.822554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:49.921182 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:49.921149    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:49.998461 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:49.998415    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:50.001759 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:50.001738    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dqpls"]
Jul 09 14:21:50.005280 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:50.005258    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dqpls"
Jul 09 14:21:50.007699 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:50.007676    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 09 14:21:50.007816 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:50.007680    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7nrrt\""
Jul 09 14:21:50.013388 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:50.013341    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dqpls"]
Jul 09 14:21:50.100407 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:50.100316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:50.105083 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:50.105056    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1959c0e8-7101-40bc-bdf9-fcd7b748320d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-dqpls\" (UID: \"1959c0e8-7101-40bc-bdf9-fcd7b748320d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dqpls"
Jul 09 14:21:50.170502 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:50.170415    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:50.206122 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:50.206089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1959c0e8-7101-40bc-bdf9-fcd7b748320d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-dqpls\" (UID: \"1959c0e8-7101-40bc-bdf9-fcd7b748320d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dqpls"
Jul 09 14:21:50.209780 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:50.209749    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1959c0e8-7101-40bc-bdf9-fcd7b748320d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-dqpls\" (UID: \"1959c0e8-7101-40bc-bdf9-fcd7b748320d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dqpls"
Jul 09 14:21:50.316194 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:50.316153    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dqpls"
Jul 09 14:21:50.535708 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:50.535676    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:50.607331 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:50.607085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:54.280784 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:54.280722    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dqpls"]
Jul 09 14:21:54.286679 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:21:54.286640    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1959c0e8_7101_40bc_bdf9_fcd7b748320d.slice/crio-bd111fc80deaa7364f621dd4d73febb566e3c1c7493e05859091e95d714b36d6 WatchSource:0}: Error finding container bd111fc80deaa7364f621dd4d73febb566e3c1c7493e05859091e95d714b36d6: Status 404 returned error can't find the container with id bd111fc80deaa7364f621dd4d73febb566e3c1c7493e05859091e95d714b36d6
Jul 09 14:21:54.795088 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:54.795047    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nlk2n" event={"ID":"1b949d69-8e9e-4973-b66e-08caf0dee278","Type":"ContainerStarted","Data":"3fa1e608049b38a6022d35a2fb44c096a3ac1f9341d878ee2c789598394fc981"}
Jul 09 14:21:54.796883 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:54.796854    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lhc8l" event={"ID":"3ab41c18-0f1e-43de-aadc-2a2995247e18","Type":"ContainerStarted","Data":"045d4dabc6337488daf3f5f022412d914d0fe20034e479eaf9b884b06620a9b0"}
Jul 09 14:21:54.798057 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:54.798028    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dqpls" event={"ID":"1959c0e8-7101-40bc-bdf9-fcd7b748320d","Type":"ContainerStarted","Data":"bd111fc80deaa7364f621dd4d73febb566e3c1c7493e05859091e95d714b36d6"}
Jul 09 14:21:54.799882 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:54.799861    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7gnx" event={"ID":"ffd14b51-df34-4e09-95e0-44e398a6d76c","Type":"ContainerStarted","Data":"e38834bd284cf153be77787b0e88e46aa7319743584e628b3b8ba5bfdda7f348"}
Jul 09 14:21:54.799960 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:54.799906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7gnx" event={"ID":"ffd14b51-df34-4e09-95e0-44e398a6d76c","Type":"ContainerStarted","Data":"c94d0bafe5122d1bcfe3a8c5b5f2b34a3ef331a93a1a082da898f46ff499eb16"}
Jul 09 14:21:54.800040 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:54.800018    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m7gnx"
Jul 09 14:21:54.812406 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:54.812367    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nlk2n" podStartSLOduration=1.6010563549999999 podStartE2EDuration="6.812353317s" totalImagesPullingTime="5.211296962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:21:54.811436168 +0000 UTC m=+58.838530564" watchObservedRunningTime="2026-07-09 14:21:54.812353317 +0000 UTC m=+58.839447677"
Jul 09 14:21:54.831247 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:54.831199    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m7gnx" podStartSLOduration=1.530562498 podStartE2EDuration="6.83117697s" totalImagesPullingTime="5.300614472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:21:54.830182936 +0000 UTC m=+58.857277334" watchObservedRunningTime="2026-07-09 14:21:54.83117697 +0000 UTC m=+58.858271352"
Jul 09 14:21:55.808245 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:55.808205    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lhc8l" event={"ID":"3ab41c18-0f1e-43de-aadc-2a2995247e18","Type":"ContainerStarted","Data":"a6dcd7edb9904547fee8a2e88c13e118dab869384ba99b781079c310db5297e5"}
Jul 09 14:21:55.809930 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:55.809902    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dqpls" event={"ID":"1959c0e8-7101-40bc-bdf9-fcd7b748320d","Type":"ContainerStarted","Data":"ddec13cc38345f0747a6aedb125b9e4d757c5a2d01f6b63c98ec213c48501392"}
Jul 09 14:21:55.810166 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:55.810142    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dqpls"
Jul 09 14:21:55.814301 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:55.814283    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dqpls"
Jul 09 14:21:55.825553 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:55.825510    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-dqpls" podStartSLOduration=5.516464142 podStartE2EDuration="6.825496074s" totalImagesPullingTime="1.309031932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:21:55.824942023 +0000 UTC m=+59.852036427" watchObservedRunningTime="2026-07-09 14:21:55.825496074 +0000 UTC m=+59.852590481"
Jul 09 14:21:56.032794 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.032740    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:56.071384 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.071355    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-57c4w"]
Jul 09 14:21:56.074525 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.074501    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w"
Jul 09 14:21:56.078626 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.078198    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 09 14:21:56.078626 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.078237    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 09 14:21:56.078626 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.078262    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5pvfb\""
Jul 09 14:21:56.078626 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.078287    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 14:21:56.078626 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.078458    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 14:21:56.078626 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.078482    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 14:21:56.083854 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.083828    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-57c4w"]
Jul 09 14:21:56.107927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.107901    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:56.153102 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.153070    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/31d73e06-2694-497b-a269-80126723727e-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-57c4w\" (UID: \"31d73e06-2694-497b-a269-80126723727e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w"
Jul 09 14:21:56.153262 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.153113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvdfq\" (UniqueName: \"kubernetes.io/projected/31d73e06-2694-497b-a269-80126723727e-kube-api-access-pvdfq\") pod \"prometheus-operator-64785b6675-57c4w\" (UID: \"31d73e06-2694-497b-a269-80126723727e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w"
Jul 09 14:21:56.153262 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.153173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31d73e06-2694-497b-a269-80126723727e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-57c4w\" (UID: \"31d73e06-2694-497b-a269-80126723727e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w"
Jul 09 14:21:56.153262 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.153199    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31d73e06-2694-497b-a269-80126723727e-metrics-client-ca\") pod \"prometheus-operator-64785b6675-57c4w\" (UID: \"31d73e06-2694-497b-a269-80126723727e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w"
Jul 09 14:21:56.253880 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.253844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31d73e06-2694-497b-a269-80126723727e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-57c4w\" (UID: \"31d73e06-2694-497b-a269-80126723727e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w"
Jul 09 14:21:56.253880 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.253879    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31d73e06-2694-497b-a269-80126723727e-metrics-client-ca\") pod \"prometheus-operator-64785b6675-57c4w\" (UID: \"31d73e06-2694-497b-a269-80126723727e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w"
Jul 09 14:21:56.254113 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.253942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/31d73e06-2694-497b-a269-80126723727e-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-57c4w\" (UID: \"31d73e06-2694-497b-a269-80126723727e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w"
Jul 09 14:21:56.254113 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.253960    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvdfq\" (UniqueName: \"kubernetes.io/projected/31d73e06-2694-497b-a269-80126723727e-kube-api-access-pvdfq\") pod \"prometheus-operator-64785b6675-57c4w\" (UID: \"31d73e06-2694-497b-a269-80126723727e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w"
Jul 09 14:21:56.254113 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:56.254082    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 09 14:21:56.254258 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:21:56.254150    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d73e06-2694-497b-a269-80126723727e-prometheus-operator-tls podName:31d73e06-2694-497b-a269-80126723727e nodeName:}" failed. No retries permitted until 2026-07-09 14:21:56.754130716 +0000 UTC m=+60.781225074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/31d73e06-2694-497b-a269-80126723727e-prometheus-operator-tls") pod "prometheus-operator-64785b6675-57c4w" (UID: "31d73e06-2694-497b-a269-80126723727e") : secret "prometheus-operator-tls" not found
Jul 09 14:21:56.254612 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.254592    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31d73e06-2694-497b-a269-80126723727e-metrics-client-ca\") pod \"prometheus-operator-64785b6675-57c4w\" (UID: \"31d73e06-2694-497b-a269-80126723727e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w"
Jul 09 14:21:56.256375 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.256354    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31d73e06-2694-497b-a269-80126723727e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-57c4w\" (UID: \"31d73e06-2694-497b-a269-80126723727e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w"
Jul 09 14:21:56.263374 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.263348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvdfq\" (UniqueName: \"kubernetes.io/projected/31d73e06-2694-497b-a269-80126723727e-kube-api-access-pvdfq\") pod \"prometheus-operator-64785b6675-57c4w\" (UID: \"31d73e06-2694-497b-a269-80126723727e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w"
Jul 09 14:21:56.390048 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.389976    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:56.757578 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.757537    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/31d73e06-2694-497b-a269-80126723727e-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-57c4w\" (UID: \"31d73e06-2694-497b-a269-80126723727e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w"
Jul 09 14:21:56.760110 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.760082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/31d73e06-2694-497b-a269-80126723727e-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-57c4w\" (UID: \"31d73e06-2694-497b-a269-80126723727e\") " pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w"
Jul 09 14:21:56.987961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.987932    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5pvfb\""
Jul 09 14:21:56.996177 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:56.996152    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w"
Jul 09 14:21:57.130849 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:57.130794    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-57c4w"]
Jul 09 14:21:57.134224 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:21:57.134196    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31d73e06_2694_497b_a269_80126723727e.slice/crio-f36cf29d0688b4ee8a41e3721daefdb8dc58bf0346e3ea4d20ae2ab88185d0e8 WatchSource:0}: Error finding container f36cf29d0688b4ee8a41e3721daefdb8dc58bf0346e3ea4d20ae2ab88185d0e8: Status 404 returned error can't find the container with id f36cf29d0688b4ee8a41e3721daefdb8dc58bf0346e3ea4d20ae2ab88185d0e8
Jul 09 14:21:57.731059 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:57.731032    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dhnz"
Jul 09 14:21:57.818866 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:57.818832    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w" event={"ID":"31d73e06-2694-497b-a269-80126723727e","Type":"ContainerStarted","Data":"f36cf29d0688b4ee8a41e3721daefdb8dc58bf0346e3ea4d20ae2ab88185d0e8"}
Jul 09 14:21:57.847998 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:57.847962    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:57.949266 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:57.949217    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:58.049704 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:58.049626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:58.485168 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:58.485139    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:58.548716 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:58.548690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:21:58.824071 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:58.823993    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lhc8l" event={"ID":"3ab41c18-0f1e-43de-aadc-2a2995247e18","Type":"ContainerStarted","Data":"0da4b2726d64a2036c58f09a87ff31769c458bf71a55c07bb210c938ebbd5c13"}
Jul 09 14:21:58.841932 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:58.841877    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lhc8l" podStartSLOduration=1.2154159039999999 podStartE2EDuration="10.841860054s" totalImagesPullingTime="9.62644415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:21:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:21:58.841505809 +0000 UTC m=+62.868600191" watchObservedRunningTime="2026-07-09 14:21:58.841860054 +0000 UTC m=+62.868954434"
Jul 09 14:21:59.829764 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:59.829732    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w" event={"ID":"31d73e06-2694-497b-a269-80126723727e","Type":"ContainerStarted","Data":"91cd50864fa68f385c337864973ff42509049bfc9f3421a5c7b27a3c71d5be2a"}
Jul 09 14:21:59.830224 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:59.829811    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w" event={"ID":"31d73e06-2694-497b-a269-80126723727e","Type":"ContainerStarted","Data":"93205090a88fc86fe55461dd06ed229f7ad1efa0ec4c56ffbf4807264135649d"}
Jul 09 14:21:59.854546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:59.854498    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-57c4w" podStartSLOduration=1.297408497 podStartE2EDuration="3.854482001s" totalImagesPullingTime="2.557073504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:21:59.850395163 +0000 UTC m=+63.877489543" watchObservedRunningTime="2026-07-09 14:21:59.854482001 +0000 UTC m=+63.881576386"
Jul 09 14:21:59.966993 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:21:59.966943    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:01.190628 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.190594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret\") pod \"global-pull-secret-syncer-7jk5k\" (UID: \"9753f0f7-1409-4552-aaad-995fd401dd48\") " pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:22:01.191111 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.190638    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs\") pod \"network-metrics-daemon-b4crp\" (UID: \"82480873-c990-49f3-a16b-a961f1d330d9\") " pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:22:01.193692 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.193671    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 14:22:01.193756 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.193675    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 14:22:01.203614 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.203581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9753f0f7-1409-4552-aaad-995fd401dd48-original-pull-secret\") pod \"global-pull-secret-syncer-7jk5k\" (UID: \"9753f0f7-1409-4552-aaad-995fd401dd48\") " pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:22:01.203614 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.203608    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82480873-c990-49f3-a16b-a961f1d330d9-metrics-certs\") pod \"network-metrics-daemon-b4crp\" (UID: \"82480873-c990-49f3-a16b-a961f1d330d9\") " pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:22:01.206822 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.206777    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:01.291878 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.291846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh59s\" (UniqueName: \"kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s\") pod \"network-check-target-8jlrc\" (UID: \"30fec348-4428-465d-a900-6a779d9e64e6\") " pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:22:01.294427 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.294410    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 14:22:01.304478 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.304460    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 14:22:01.314946 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.314927    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh59s\" (UniqueName: \"kubernetes.io/projected/30fec348-4428-465d-a900-6a779d9e64e6-kube-api-access-xh59s\") pod \"network-check-target-8jlrc\" (UID: \"30fec348-4428-465d-a900-6a779d9e64e6\") " pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:22:01.434732 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.434701    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"]
Jul 09 14:22:01.436632 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.436616    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"
Jul 09 14:22:01.439051 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.439030    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 09 14:22:01.439184 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.439085    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 09 14:22:01.439184 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.439085    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pt876\""
Jul 09 14:22:01.440621 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.440602    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-v77lv"]
Jul 09 14:22:01.442391 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.442332    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.444555 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.444539    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 09 14:22:01.444963 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.444946    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 09 14:22:01.445060 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.445015    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 09 14:22:01.445284 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.445269    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jhkvx\""
Jul 09 14:22:01.448212 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.448194    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"]
Jul 09 14:22:01.454046 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.454028    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-v77lv"]
Jul 09 14:22:01.467473 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.467451    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f49d7"]
Jul 09 14:22:01.468008 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.467987    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d4gsp\""
Jul 09 14:22:01.469490 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.469473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.471969 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.471940    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 14:22:01.471969 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.471963    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5nhnb\""
Jul 09 14:22:01.472116 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.471963    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 14:22:01.472116 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.471962    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 14:22:01.474922 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.474905    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bcf26\""
Jul 09 14:22:01.475885 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.475866    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4crp"
Jul 09 14:22:01.479444 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.479430    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7jk5k"
Jul 09 14:22:01.483010 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.482991    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:22:01.488107 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.488083    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:01.493128 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.493102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb80d955-2bd8-412f-91dd-9e7d76ae0dc0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-w7rg4\" (UID: \"fb80d955-2bd8-412f-91dd-9e7d76ae0dc0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"
Jul 09 14:22:01.493239 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.493147    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aae19e5-0c9c-472d-951f-988c66993c8c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.493239 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.493181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7aae19e5-0c9c-472d-951f-988c66993c8c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.493239 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.493218    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q68lw\" (UniqueName: \"kubernetes.io/projected/fb80d955-2bd8-412f-91dd-9e7d76ae0dc0-kube-api-access-q68lw\") pod \"openshift-state-metrics-84bd68b896-w7rg4\" (UID: \"fb80d955-2bd8-412f-91dd-9e7d76ae0dc0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"
Jul 09 14:22:01.493413 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.493246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7aae19e5-0c9c-472d-951f-988c66993c8c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.493413 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.493272    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aae19e5-0c9c-472d-951f-988c66993c8c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.493413 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.493328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb80d955-2bd8-412f-91dd-9e7d76ae0dc0-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-w7rg4\" (UID: \"fb80d955-2bd8-412f-91dd-9e7d76ae0dc0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"
Jul 09 14:22:01.493413 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.493355    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aae19e5-0c9c-472d-951f-988c66993c8c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.493413 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.493377    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxv7r\" (UniqueName: \"kubernetes.io/projected/7aae19e5-0c9c-472d-951f-988c66993c8c-kube-api-access-wxv7r\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.493652 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.493415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb80d955-2bd8-412f-91dd-9e7d76ae0dc0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-w7rg4\" (UID: \"fb80d955-2bd8-412f-91dd-9e7d76ae0dc0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"
Jul 09 14:22:01.577272 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.577181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:01.597170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.596694    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/592b9d09-4aec-4a6f-aac6-de38c842f029-root\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.597170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.596755    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/592b9d09-4aec-4a6f-aac6-de38c842f029-sys\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.597170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.596823    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/592b9d09-4aec-4a6f-aac6-de38c842f029-node-exporter-wtmp\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.597170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.596866    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxv7r\" (UniqueName: \"kubernetes.io/projected/7aae19e5-0c9c-472d-951f-988c66993c8c-kube-api-access-wxv7r\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.597170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.596906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7aae19e5-0c9c-472d-951f-988c66993c8c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.597170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.596943    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aae19e5-0c9c-472d-951f-988c66993c8c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.597170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.596974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/592b9d09-4aec-4a6f-aac6-de38c842f029-node-exporter-accelerators-collector-config\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.597170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.597004    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/592b9d09-4aec-4a6f-aac6-de38c842f029-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.597170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.597031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb80d955-2bd8-412f-91dd-9e7d76ae0dc0-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-w7rg4\" (UID: \"fb80d955-2bd8-412f-91dd-9e7d76ae0dc0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"
Jul 09 14:22:01.597170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.597104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/592b9d09-4aec-4a6f-aac6-de38c842f029-node-exporter-textfile\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.597170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.597143    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7aae19e5-0c9c-472d-951f-988c66993c8c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.597170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.597173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aae19e5-0c9c-472d-951f-988c66993c8c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.598085 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.597203    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q68lw\" (UniqueName: \"kubernetes.io/projected/fb80d955-2bd8-412f-91dd-9e7d76ae0dc0-kube-api-access-q68lw\") pod \"openshift-state-metrics-84bd68b896-w7rg4\" (UID: \"fb80d955-2bd8-412f-91dd-9e7d76ae0dc0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"
Jul 09 14:22:01.598085 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.597233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/592b9d09-4aec-4a6f-aac6-de38c842f029-metrics-client-ca\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.598085 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.597258    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl5np\" (UniqueName: \"kubernetes.io/projected/592b9d09-4aec-4a6f-aac6-de38c842f029-kube-api-access-bl5np\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.598085 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.597286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb80d955-2bd8-412f-91dd-9e7d76ae0dc0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-w7rg4\" (UID: \"fb80d955-2bd8-412f-91dd-9e7d76ae0dc0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"
Jul 09 14:22:01.598085 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.597318    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aae19e5-0c9c-472d-951f-988c66993c8c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.598085 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.597346    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/592b9d09-4aec-4a6f-aac6-de38c842f029-node-exporter-tls\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.598085 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.597375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb80d955-2bd8-412f-91dd-9e7d76ae0dc0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-w7rg4\" (UID: \"fb80d955-2bd8-412f-91dd-9e7d76ae0dc0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"
Jul 09 14:22:01.598720 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.598574    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb80d955-2bd8-412f-91dd-9e7d76ae0dc0-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-w7rg4\" (UID: \"fb80d955-2bd8-412f-91dd-9e7d76ae0dc0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"
Jul 09 14:22:01.598720 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.598578    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7aae19e5-0c9c-472d-951f-988c66993c8c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.598720 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:22:01.598663    2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 09 14:22:01.598987 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:22:01.598935    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aae19e5-0c9c-472d-951f-988c66993c8c-kube-state-metrics-tls podName:7aae19e5-0c9c-472d-951f-988c66993c8c nodeName:}" failed. No retries permitted until 2026-07-09 14:22:02.098913054 +0000 UTC m=+66.126007413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7aae19e5-0c9c-472d-951f-988c66993c8c-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-v77lv" (UID: "7aae19e5-0c9c-472d-951f-988c66993c8c") : secret "kube-state-metrics-tls" not found
Jul 09 14:22:01.599835 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.599739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7aae19e5-0c9c-472d-951f-988c66993c8c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.599932 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.599893    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aae19e5-0c9c-472d-951f-988c66993c8c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.600514 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.600443    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb80d955-2bd8-412f-91dd-9e7d76ae0dc0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-w7rg4\" (UID: \"fb80d955-2bd8-412f-91dd-9e7d76ae0dc0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"
Jul 09 14:22:01.602350 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.602294    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb80d955-2bd8-412f-91dd-9e7d76ae0dc0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-w7rg4\" (UID: \"fb80d955-2bd8-412f-91dd-9e7d76ae0dc0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"
Jul 09 14:22:01.602661 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.602626    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aae19e5-0c9c-472d-951f-988c66993c8c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.607578 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.607543    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxv7r\" (UniqueName: \"kubernetes.io/projected/7aae19e5-0c9c-472d-951f-988c66993c8c-kube-api-access-wxv7r\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:01.607662 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.607552    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q68lw\" (UniqueName: \"kubernetes.io/projected/fb80d955-2bd8-412f-91dd-9e7d76ae0dc0-kube-api-access-q68lw\") pod \"openshift-state-metrics-84bd68b896-w7rg4\" (UID: \"fb80d955-2bd8-412f-91dd-9e7d76ae0dc0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"
Jul 09 14:22:01.620937 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.620910    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b4crp"]
Jul 09 14:22:01.623508 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:22:01.623483    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82480873_c990_49f3_a16b_a961f1d330d9.slice/crio-ac7a8c3991b612da6746b1a2c0a67105e80e5f69dfd847082a96247baf5b9755 WatchSource:0}: Error finding container ac7a8c3991b612da6746b1a2c0a67105e80e5f69dfd847082a96247baf5b9755: Status 404 returned error can't find the container with id ac7a8c3991b612da6746b1a2c0a67105e80e5f69dfd847082a96247baf5b9755
Jul 09 14:22:01.648323 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.648281    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:01.697737 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.697681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/592b9d09-4aec-4a6f-aac6-de38c842f029-node-exporter-wtmp\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.697737 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.697729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/592b9d09-4aec-4a6f-aac6-de38c842f029-node-exporter-accelerators-collector-config\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.697900 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.697759    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/592b9d09-4aec-4a6f-aac6-de38c842f029-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.697900 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.697787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/592b9d09-4aec-4a6f-aac6-de38c842f029-node-exporter-textfile\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.697900 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.697876    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/592b9d09-4aec-4a6f-aac6-de38c842f029-node-exporter-wtmp\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.698047 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.697951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/592b9d09-4aec-4a6f-aac6-de38c842f029-metrics-client-ca\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.698047 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.697991    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl5np\" (UniqueName: \"kubernetes.io/projected/592b9d09-4aec-4a6f-aac6-de38c842f029-kube-api-access-bl5np\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.698047 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.698029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/592b9d09-4aec-4a6f-aac6-de38c842f029-node-exporter-tls\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.698187 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.698064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/592b9d09-4aec-4a6f-aac6-de38c842f029-root\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.698187 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.698093    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/592b9d09-4aec-4a6f-aac6-de38c842f029-sys\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.698187 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.698140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/592b9d09-4aec-4a6f-aac6-de38c842f029-node-exporter-textfile\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.698187 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.698177    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/592b9d09-4aec-4a6f-aac6-de38c842f029-sys\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.698331 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.698209    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/592b9d09-4aec-4a6f-aac6-de38c842f029-root\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.698378 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.698321    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/592b9d09-4aec-4a6f-aac6-de38c842f029-node-exporter-accelerators-collector-config\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.698473 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.698456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/592b9d09-4aec-4a6f-aac6-de38c842f029-metrics-client-ca\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.700208 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.700191    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/592b9d09-4aec-4a6f-aac6-de38c842f029-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.700674 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.700652    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/592b9d09-4aec-4a6f-aac6-de38c842f029-node-exporter-tls\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.706772 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.706753    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl5np\" (UniqueName: \"kubernetes.io/projected/592b9d09-4aec-4a6f-aac6-de38c842f029-kube-api-access-bl5np\") pod \"node-exporter-f49d7\" (UID: \"592b9d09-4aec-4a6f-aac6-de38c842f029\") " pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.745373 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.745344    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"
Jul 09 14:22:01.778601 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.778568    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f49d7"
Jul 09 14:22:01.789018 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:22:01.788994    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592b9d09_4aec_4a6f_aac6_de38c842f029.slice/crio-5ba6d4840e318127f780547db6799c91113c1ce1259924941509071a2c835fad WatchSource:0}: Error finding container 5ba6d4840e318127f780547db6799c91113c1ce1259924941509071a2c835fad: Status 404 returned error can't find the container with id 5ba6d4840e318127f780547db6799c91113c1ce1259924941509071a2c835fad
Jul 09 14:22:01.811696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.811572    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:01.837391 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.837356    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f49d7" event={"ID":"592b9d09-4aec-4a6f-aac6-de38c842f029","Type":"ContainerStarted","Data":"5ba6d4840e318127f780547db6799c91113c1ce1259924941509071a2c835fad"}
Jul 09 14:22:01.838748 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.838721    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b4crp" event={"ID":"82480873-c990-49f3-a16b-a961f1d330d9","Type":"ContainerStarted","Data":"ac7a8c3991b612da6746b1a2c0a67105e80e5f69dfd847082a96247baf5b9755"}
Jul 09 14:22:01.863632 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.863607    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7jk5k"]
Jul 09 14:22:01.864866 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:22:01.864839    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9753f0f7_1409_4552_aaad_995fd401dd48.slice/crio-0fc4161ec721ab0bbfc4d37ad8c597f3291ba8251c833fa6b872baa6b9ab3c26 WatchSource:0}: Error finding container 0fc4161ec721ab0bbfc4d37ad8c597f3291ba8251c833fa6b872baa6b9ab3c26: Status 404 returned error can't find the container with id 0fc4161ec721ab0bbfc4d37ad8c597f3291ba8251c833fa6b872baa6b9ab3c26
Jul 09 14:22:01.867295 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.867262    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8jlrc"]
Jul 09 14:22:01.870369 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:22:01.870350    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30fec348_4428_465d_a900_6a779d9e64e6.slice/crio-f9c60364f0995caac5680abf632f8c5366b107a9ebd43ae2412eac93c68cdfbd WatchSource:0}: Error finding container f9c60364f0995caac5680abf632f8c5366b107a9ebd43ae2412eac93c68cdfbd: Status 404 returned error can't find the container with id f9c60364f0995caac5680abf632f8c5366b107a9ebd43ae2412eac93c68cdfbd
Jul 09 14:22:01.911340 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.911312    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4"]
Jul 09 14:22:01.915065 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:22:01.915046    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb80d955_2bd8_412f_91dd_9e7d76ae0dc0.slice/crio-bc9d5d7a69f43acad98c7c74fde43d34ee391bb8cfad602550f83bf3cb6cca56 WatchSource:0}: Error finding container bc9d5d7a69f43acad98c7c74fde43d34ee391bb8cfad602550f83bf3cb6cca56: Status 404 returned error can't find the container with id bc9d5d7a69f43acad98c7c74fde43d34ee391bb8cfad602550f83bf3cb6cca56
Jul 09 14:22:01.931459 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:01.931422    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:02.027690 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.027662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:02.102460 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.102414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aae19e5-0c9c-472d-951f-988c66993c8c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:02.104927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.104894    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aae19e5-0c9c-472d-951f-988c66993c8c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-v77lv\" (UID: \"7aae19e5-0c9c-472d-951f-988c66993c8c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:02.352541 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.352498    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv"
Jul 09 14:22:02.430519 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.430171    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:02.521786 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.521275    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-v77lv"]
Jul 09 14:22:02.545777 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.543125    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 14:22:02.545777 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.543678    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:02.547664 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.547632    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.551863 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.551842    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lqr4f\""
Jul 09 14:22:02.551984 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.551873    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 14:22:02.552046 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.551982    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 14:22:02.552113 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.552095    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 14:22:02.552166 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.552096    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 14:22:02.552241 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.552217    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 14:22:02.552365 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.552330    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 14:22:02.552478 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.552457    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 14:22:02.552551 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.552496    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 14:22:02.552823 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.552785    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 14:22:02.563634 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.563614    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 14:22:02.608133 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.608048    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.608133 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.608101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/56438044-2c01-434d-9aba-3bd20ff106ae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.608359 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.608179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.608359 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.608224    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56438044-2c01-434d-9aba-3bd20ff106ae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.608359 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.608252    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.608359 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.608286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56438044-2c01-434d-9aba-3bd20ff106ae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.608359 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.608340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-web-config\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.608591 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.608366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56438044-2c01-434d-9aba-3bd20ff106ae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.608591 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.608394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.608591 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.608428    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56438044-2c01-434d-9aba-3bd20ff106ae-config-out\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.608591 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.608473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.608591 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.608528    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-config-volume\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.608591 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.608554    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ql4r\" (UniqueName: \"kubernetes.io/projected/56438044-2c01-434d-9aba-3bd20ff106ae-kube-api-access-9ql4r\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.657160 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.657119    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:02.709124 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.709087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.709306 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.709137    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/56438044-2c01-434d-9aba-3bd20ff106ae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.709306 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.709175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.709306 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.709205    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56438044-2c01-434d-9aba-3bd20ff106ae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.709306 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.709232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.709306 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.709263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56438044-2c01-434d-9aba-3bd20ff106ae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.709306 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.709301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-web-config\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.709610 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.709325    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56438044-2c01-434d-9aba-3bd20ff106ae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.709610 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.709351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.709610 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.709385    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56438044-2c01-434d-9aba-3bd20ff106ae-config-out\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.709610 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.709424    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.709610 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.709459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-config-volume\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.709610 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.709481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ql4r\" (UniqueName: \"kubernetes.io/projected/56438044-2c01-434d-9aba-3bd20ff106ae-kube-api-access-9ql4r\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.711139 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:22:02.711113    2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 09 14:22:02.711249 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:22:02.711187    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-main-tls podName:56438044-2c01-434d-9aba-3bd20ff106ae nodeName:}" failed. No retries permitted until 2026-07-09 14:22:03.211167689 +0000 UTC m=+67.238262073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "56438044-2c01-434d-9aba-3bd20ff106ae") : secret "alertmanager-main-tls" not found
Jul 09 14:22:02.712241 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.711607    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56438044-2c01-434d-9aba-3bd20ff106ae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.712241 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.711884    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/56438044-2c01-434d-9aba-3bd20ff106ae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.713290 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.713077    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56438044-2c01-434d-9aba-3bd20ff106ae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.715876 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.715848    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-config-volume\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.717595 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.717552    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.720052 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.719991    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.722017 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.721348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.722017 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.721521    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.722017 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.721954    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ql4r\" (UniqueName: \"kubernetes.io/projected/56438044-2c01-434d-9aba-3bd20ff106ae-kube-api-access-9ql4r\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.723002 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.722962    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56438044-2c01-434d-9aba-3bd20ff106ae-config-out\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.723454 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.723413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56438044-2c01-434d-9aba-3bd20ff106ae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.723454 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.723436    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-web-config\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:02.756893 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.756780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:02.856079 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.856036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4" event={"ID":"fb80d955-2bd8-412f-91dd-9e7d76ae0dc0","Type":"ContainerStarted","Data":"65f60df88be258bc9afb0b020ad4a66d541deeb2d19a180286babe49f27dcf82"}
Jul 09 14:22:02.856265 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.856111    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4" event={"ID":"fb80d955-2bd8-412f-91dd-9e7d76ae0dc0","Type":"ContainerStarted","Data":"8b42e8b359df0ab4c2c307a07ab2f3f911a48638554a183f777b2c16ce8afe68"}
Jul 09 14:22:02.856265 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.856153    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4" event={"ID":"fb80d955-2bd8-412f-91dd-9e7d76ae0dc0","Type":"ContainerStarted","Data":"bc9d5d7a69f43acad98c7c74fde43d34ee391bb8cfad602550f83bf3cb6cca56"}
Jul 09 14:22:02.859447 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.859374    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7jk5k" event={"ID":"9753f0f7-1409-4552-aaad-995fd401dd48","Type":"ContainerStarted","Data":"0fc4161ec721ab0bbfc4d37ad8c597f3291ba8251c833fa6b872baa6b9ab3c26"}
Jul 09 14:22:02.860984 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.860956    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv" event={"ID":"7aae19e5-0c9c-472d-951f-988c66993c8c","Type":"ContainerStarted","Data":"baa4b7024cf361f974febbc982605cb28508b6fe6611b4e60952e96f72861b5b"}
Jul 09 14:22:02.863784 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:02.863760    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8jlrc" event={"ID":"30fec348-4428-465d-a900-6a779d9e64e6","Type":"ContainerStarted","Data":"f9c60364f0995caac5680abf632f8c5366b107a9ebd43ae2412eac93c68cdfbd"}
Jul 09 14:22:03.101238 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.101197    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:03.213518 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.213452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:03.219089 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.219056    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:03.465955 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.465685    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:22:03.530364 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.530329    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-544f5d846b-kcd4v"]
Jul 09 14:22:03.534504 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.534480    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.537126 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.537104    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 09 14:22:03.537250 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.537127    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kzjs7\""
Jul 09 14:22:03.537355 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.537336    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 09 14:22:03.537529 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.537513    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 09 14:22:03.537606 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.537589    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f45d93urunu5l\""
Jul 09 14:22:03.537678 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.537515    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 09 14:22:03.537817 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.537786    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 09 14:22:03.547975 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.547946    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-544f5d846b-kcd4v"]
Jul 09 14:22:03.617789 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.617755    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88hwz\" (UniqueName: \"kubernetes.io/projected/319ef20b-efae-4f45-abd8-346dc7fe5f5f-kube-api-access-88hwz\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.617992 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.617837    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-thanos-querier-tls\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.617992 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.617864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/319ef20b-efae-4f45-abd8-346dc7fe5f5f-metrics-client-ca\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.617992 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.617891    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.617992 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.617970    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-grpc-tls\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.617992 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.617990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.618252 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.618064    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.618252 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.618137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.719299 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.719217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.719299 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.719280    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88hwz\" (UniqueName: \"kubernetes.io/projected/319ef20b-efae-4f45-abd8-346dc7fe5f5f-kube-api-access-88hwz\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.719492 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.719331    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-thanos-querier-tls\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.719492 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.719356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/319ef20b-efae-4f45-abd8-346dc7fe5f5f-metrics-client-ca\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.719492 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.719387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.719492 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.719423    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-grpc-tls\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.719492 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.719445    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.719492 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.719466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.720319 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.720189    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/319ef20b-efae-4f45-abd8-346dc7fe5f5f-metrics-client-ca\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.725202 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.724774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.725202 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.724782    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.725202 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.724875    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.725202 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.724924    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.725412 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.725269    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-thanos-querier-tls\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.727553 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.727521    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/319ef20b-efae-4f45-abd8-346dc7fe5f5f-secret-grpc-tls\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.728596 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.728553    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88hwz\" (UniqueName: \"kubernetes.io/projected/319ef20b-efae-4f45-abd8-346dc7fe5f5f-kube-api-access-88hwz\") pod \"thanos-querier-544f5d846b-kcd4v\" (UID: \"319ef20b-efae-4f45-abd8-346dc7fe5f5f\") " pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:03.852153 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:03.851989    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:04.047392 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:04.046103    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 14:22:04.053356 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:22:04.052015    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56438044_2c01_434d_9aba_3bd20ff106ae.slice/crio-bf6a736573089a52091cd2d5fff7125e0653b6db7a082d48e1e3b0c35f163c74 WatchSource:0}: Error finding container bf6a736573089a52091cd2d5fff7125e0653b6db7a082d48e1e3b0c35f163c74: Status 404 returned error can't find the container with id bf6a736573089a52091cd2d5fff7125e0653b6db7a082d48e1e3b0c35f163c74
Jul 09 14:22:04.064233 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:04.064006    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-544f5d846b-kcd4v"]
Jul 09 14:22:04.070791 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:22:04.070749    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod319ef20b_efae_4f45_abd8_346dc7fe5f5f.slice/crio-235fad928ce110ff7f72df0784350f808d53d79fcb26e34b34b1bdf6dd08a2b0 WatchSource:0}: Error finding container 235fad928ce110ff7f72df0784350f808d53d79fcb26e34b34b1bdf6dd08a2b0: Status 404 returned error can't find the container with id 235fad928ce110ff7f72df0784350f808d53d79fcb26e34b34b1bdf6dd08a2b0
Jul 09 14:22:04.384730 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:04.384507    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:04.458014 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:04.457949    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:04.585360 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:04.585319    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:04.739821 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:04.739256    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:04.812533 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:04.812501    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m7gnx"
Jul 09 14:22:04.881195 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:04.880882    2563 generic.go:356] "Generic (PLEG): container finished" podID="592b9d09-4aec-4a6f-aac6-de38c842f029" containerID="0981b51effadbdcd448a3f65fa7d25e431142e990fbdbf3614ba75ed97ab6339" exitCode=0
Jul 09 14:22:04.881762 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:04.881609    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f49d7" event={"ID":"592b9d09-4aec-4a6f-aac6-de38c842f029","Type":"ContainerDied","Data":"0981b51effadbdcd448a3f65fa7d25e431142e990fbdbf3614ba75ed97ab6339"}
Jul 09 14:22:04.885553 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:04.885444    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b4crp" event={"ID":"82480873-c990-49f3-a16b-a961f1d330d9","Type":"ContainerStarted","Data":"cb4ea32af08981498e1be7a58bb7193cf17aba824ea2623730dbd7573eb7d746"}
Jul 09 14:22:04.885553 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:04.885518    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b4crp" event={"ID":"82480873-c990-49f3-a16b-a961f1d330d9","Type":"ContainerStarted","Data":"c80fd54aab241ae27622dfbd246704c0e8481cdba73e7e17fff054ef9c3e68d6"}
Jul 09 14:22:04.895262 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:04.888594    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4" event={"ID":"fb80d955-2bd8-412f-91dd-9e7d76ae0dc0","Type":"ContainerStarted","Data":"558f64e5b5840875265e2f497d4b64fa4170d290044df0cbe8d15ebdcd19c61e"}
Jul 09 14:22:04.895262 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:04.890325    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v" event={"ID":"319ef20b-efae-4f45-abd8-346dc7fe5f5f","Type":"ContainerStarted","Data":"235fad928ce110ff7f72df0784350f808d53d79fcb26e34b34b1bdf6dd08a2b0"}
Jul 09 14:22:04.895262 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:04.892356    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56438044-2c01-434d-9aba-3bd20ff106ae","Type":"ContainerStarted","Data":"bf6a736573089a52091cd2d5fff7125e0653b6db7a082d48e1e3b0c35f163c74"}
Jul 09 14:22:04.916991 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:04.916936    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b4crp" podStartSLOduration=66.700368525 podStartE2EDuration="1m8.916917623s" totalImagesPullingTime="2.216549098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:22:04.916340023 +0000 UTC m=+68.943434404" watchObservedRunningTime="2026-07-09 14:22:04.916917623 +0000 UTC m=+68.944012007"
Jul 09 14:22:04.936090 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:04.935343    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-w7rg4" podStartSLOduration=2.111388964 podStartE2EDuration="3.935324538s" totalImagesPullingTime="1.823935574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:22:04.934390808 +0000 UTC m=+68.961485196" watchObservedRunningTime="2026-07-09 14:22:04.935324538 +0000 UTC m=+68.962418922"
Jul 09 14:22:05.016361 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.016261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:05.117089 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.117050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:05.849345 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.849310    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"]
Jul 09 14:22:05.852733 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.852709    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:05.858778 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.858759    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 14:22:05.859271 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.859249    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 14:22:05.859570 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.859551    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 14:22:05.859739 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.859705    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6ncnetfknf5oe\""
Jul 09 14:22:05.859739 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.859727    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jwwtk\""
Jul 09 14:22:05.859888 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.859878    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 14:22:05.866282 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.866244    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"]
Jul 09 14:22:05.939158 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.939121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/869b12f3-6f25-4c1a-aa88-1d3674d98128-audit-log\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:05.939317 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.939181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/869b12f3-6f25-4c1a-aa88-1d3674d98128-secret-metrics-server-client-certs\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:05.939317 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.939219    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/869b12f3-6f25-4c1a-aa88-1d3674d98128-secret-metrics-server-tls\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:05.939317 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.939255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/869b12f3-6f25-4c1a-aa88-1d3674d98128-metrics-server-audit-profiles\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:05.939489 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.939333    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/869b12f3-6f25-4c1a-aa88-1d3674d98128-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:05.939489 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.939390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/869b12f3-6f25-4c1a-aa88-1d3674d98128-client-ca-bundle\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:05.939489 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:05.939420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sgqp\" (UniqueName: \"kubernetes.io/projected/869b12f3-6f25-4c1a-aa88-1d3674d98128-kube-api-access-8sgqp\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:06.040449 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.040396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/869b12f3-6f25-4c1a-aa88-1d3674d98128-client-ca-bundle\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:06.040625 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.040462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sgqp\" (UniqueName: \"kubernetes.io/projected/869b12f3-6f25-4c1a-aa88-1d3674d98128-kube-api-access-8sgqp\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:06.040625 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.040564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/869b12f3-6f25-4c1a-aa88-1d3674d98128-audit-log\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:06.040625 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.040598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/869b12f3-6f25-4c1a-aa88-1d3674d98128-secret-metrics-server-client-certs\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:06.040625 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.040625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/869b12f3-6f25-4c1a-aa88-1d3674d98128-secret-metrics-server-tls\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:06.040843 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.040653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/869b12f3-6f25-4c1a-aa88-1d3674d98128-metrics-server-audit-profiles\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:06.040843 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.040690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/869b12f3-6f25-4c1a-aa88-1d3674d98128-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:06.041408 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.041177    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/869b12f3-6f25-4c1a-aa88-1d3674d98128-audit-log\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:06.041988 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.041942    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/869b12f3-6f25-4c1a-aa88-1d3674d98128-metrics-server-audit-profiles\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:06.041988 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.041965    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/869b12f3-6f25-4c1a-aa88-1d3674d98128-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:06.043738 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.043709    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/869b12f3-6f25-4c1a-aa88-1d3674d98128-client-ca-bundle\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:06.043860 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.043768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/869b12f3-6f25-4c1a-aa88-1d3674d98128-secret-metrics-server-tls\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:06.044255 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.044227    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/869b12f3-6f25-4c1a-aa88-1d3674d98128-secret-metrics-server-client-certs\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:06.050168 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.050143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sgqp\" (UniqueName: \"kubernetes.io/projected/869b12f3-6f25-4c1a-aa88-1d3674d98128-kube-api-access-8sgqp\") pod \"metrics-server-6959b9ffdf-8fmqt\" (UID: \"869b12f3-6f25-4c1a-aa88-1d3674d98128\") " pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:06.171297 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.171200    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:06.211355 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.211317    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt"]
Jul 09 14:22:06.211500 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.211313    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:06.214636 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.214617    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt"
Jul 09 14:22:06.219622 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.217320    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 09 14:22:06.219622 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.217923    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vdmwq\""
Jul 09 14:22:06.222927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.222903    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt"]
Jul 09 14:22:06.343153 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.343109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55a4e26d-6533-4c88-80b6-2ee579f3fc8f-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-gqwvt\" (UID: \"55a4e26d-6533-4c88-80b6-2ee579f3fc8f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt"
Jul 09 14:22:06.343364 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.343177    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd7c8\" (UniqueName: \"kubernetes.io/projected/55a4e26d-6533-4c88-80b6-2ee579f3fc8f-kube-api-access-jd7c8\") pod \"monitoring-plugin-5f68df7f58-gqwvt\" (UID: \"55a4e26d-6533-4c88-80b6-2ee579f3fc8f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt"
Jul 09 14:22:06.444127 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.443731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55a4e26d-6533-4c88-80b6-2ee579f3fc8f-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-gqwvt\" (UID: \"55a4e26d-6533-4c88-80b6-2ee579f3fc8f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt"
Jul 09 14:22:06.444127 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.443818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd7c8\" (UniqueName: \"kubernetes.io/projected/55a4e26d-6533-4c88-80b6-2ee579f3fc8f-kube-api-access-jd7c8\") pod \"monitoring-plugin-5f68df7f58-gqwvt\" (UID: \"55a4e26d-6533-4c88-80b6-2ee579f3fc8f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt"
Jul 09 14:22:06.444127 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:22:06.443943    2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 09 14:22:06.444127 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:22:06.444018    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a4e26d-6533-4c88-80b6-2ee579f3fc8f-monitoring-plugin-cert podName:55a4e26d-6533-4c88-80b6-2ee579f3fc8f nodeName:}" failed. No retries permitted until 2026-07-09 14:22:06.943995693 +0000 UTC m=+70.971090065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/55a4e26d-6533-4c88-80b6-2ee579f3fc8f-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-gqwvt" (UID: "55a4e26d-6533-4c88-80b6-2ee579f3fc8f") : secret "monitoring-plugin-cert" not found
Jul 09 14:22:06.456897 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.456863    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd7c8\" (UniqueName: \"kubernetes.io/projected/55a4e26d-6533-4c88-80b6-2ee579f3fc8f-kube-api-access-jd7c8\") pod \"monitoring-plugin-5f68df7f58-gqwvt\" (UID: \"55a4e26d-6533-4c88-80b6-2ee579f3fc8f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt"
Jul 09 14:22:06.765914 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.765847    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:06.949458 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.949421    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55a4e26d-6533-4c88-80b6-2ee579f3fc8f-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-gqwvt\" (UID: \"55a4e26d-6533-4c88-80b6-2ee579f3fc8f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt"
Jul 09 14:22:06.952243 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:06.952204    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55a4e26d-6533-4c88-80b6-2ee579f3fc8f-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-gqwvt\" (UID: \"55a4e26d-6533-4c88-80b6-2ee579f3fc8f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt"
Jul 09 14:22:07.126928 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.126839    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt"
Jul 09 14:22:07.645299 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.645264    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:22:07.650247 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.650217    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.652987 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.652958    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 14:22:07.653118 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.653026    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 14:22:07.653118 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.653077    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 14:22:07.653235 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.653133    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 14:22:07.653290 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.653236    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7z7s8\""
Jul 09 14:22:07.653361 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.653338    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 14:22:07.653422 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.653394    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 14:22:07.653630 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.653609    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 14:22:07.653754 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.653661    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 14:22:07.653955 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.653934    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 14:22:07.654078 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.654010    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 14:22:07.654269 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.654251    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 14:22:07.654761 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.654738    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 14:22:07.654932 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.654912    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 14:22:07.655075 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.655024    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-etn4ompkk4mj9\""
Jul 09 14:22:07.663956 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.663931    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 14:22:07.668784 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.668760    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:22:07.689408 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.689362    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:07.762537 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.762720 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.762720 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/680e4740-9071-46c1-b59d-fbfebacfb397-config-out\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.762720 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-config\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.762720 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762623    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.762720 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762643    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.762720 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdnx8\" (UniqueName: \"kubernetes.io/projected/680e4740-9071-46c1-b59d-fbfebacfb397-kube-api-access-bdnx8\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.762720 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762680    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-web-config\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.763070 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.763070 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.763070 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762792    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.763070 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.763070 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/680e4740-9071-46c1-b59d-fbfebacfb397-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.763070 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.763070 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762913    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.763070 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.763070 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.763070 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.763070 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.762997    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.763070 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.763022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.863694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.863767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.863796    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.863852    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/680e4740-9071-46c1-b59d-fbfebacfb397-config-out\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.863877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-config\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.863906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.863931    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.863954    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdnx8\" (UniqueName: \"kubernetes.io/projected/680e4740-9071-46c1-b59d-fbfebacfb397-kube-api-access-bdnx8\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.863977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-web-config\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.864006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.864029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.864053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.864083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.864106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/680e4740-9071-46c1-b59d-fbfebacfb397-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.864130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.864156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.864420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.864183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.865366 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.864214    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.865366 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.864242    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.865366 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.864266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.865366 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.865043    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.865366 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.865339    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.865606 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.865443    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.865606 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.865513    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.866528 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.866104    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.866648 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.866562    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.867760 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.867736    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.869573 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.869502    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.869711 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.869687    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.870339 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.870312    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/680e4740-9071-46c1-b59d-fbfebacfb397-config-out\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.870560 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.870535    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.871034 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.870991    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.871768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.871726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/680e4740-9071-46c1-b59d-fbfebacfb397-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.871768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.871756    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.872466 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.872435    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.872680 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.872659    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.873277 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.873198    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-web-config\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.873540 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.873518    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.874743 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.874715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-config\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.878246 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.878226    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdnx8\" (UniqueName: \"kubernetes.io/projected/680e4740-9071-46c1-b59d-fbfebacfb397-kube-api-access-bdnx8\") pod \"prometheus-k8s-0\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:07.914180 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.914073    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:07.968095 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:07.968061    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:08.009577 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:08.009546    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:08.109767 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:08.109740    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:08.210052 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:08.209961    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:08.502892 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:08.502782    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:08.606589 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:08.606555    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:08.710746 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:08.710676    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:08.910052 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:08.909970    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"]
Jul 09 14:22:08.917583 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:22:08.917495    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869b12f3_6f25_4c1a_aa88_1d3674d98128.slice/crio-7f61d685867fb6ee281742d24d17c17fa7221fbb12ed1ba299d24ff0225686f9 WatchSource:0}: Error finding container 7f61d685867fb6ee281742d24d17c17fa7221fbb12ed1ba299d24ff0225686f9: Status 404 returned error can't find the container with id 7f61d685867fb6ee281742d24d17c17fa7221fbb12ed1ba299d24ff0225686f9
Jul 09 14:22:08.919779 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:08.919710    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f49d7" event={"ID":"592b9d09-4aec-4a6f-aac6-de38c842f029","Type":"ContainerStarted","Data":"241286e7bd5adcaba7ba7fe542771f6091919500a717077135d047c10b2b76f0"}
Jul 09 14:22:08.924131 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:08.923219    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56438044-2c01-434d-9aba-3bd20ff106ae","Type":"ContainerStarted","Data":"7c6d375ec84960a1f580e4f7a5d1695c7e3ab57304585dbe36fe5464f1c61cc3"}
Jul 09 14:22:08.928727 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:08.928635    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv" event={"ID":"7aae19e5-0c9c-472d-951f-988c66993c8c","Type":"ContainerStarted","Data":"b3258c6fbd11b3d0de146644165680aee56b8bc6d3a2f18c931337ca7a8fc630"}
Jul 09 14:22:08.950607 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:08.943285    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:22:08.950607 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:08.945238    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt"]
Jul 09 14:22:08.950607 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:08.946698    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8jlrc" event={"ID":"30fec348-4428-465d-a900-6a779d9e64e6","Type":"ContainerStarted","Data":"ef976139b26e8daa1ac808e45ad8fc5b767a8be5b04bafa6008de44da95db774"}
Jul 09 14:22:08.953170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:08.953115    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:22:08.956008 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:22:08.955728    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod680e4740_9071_46c1_b59d_fbfebacfb397.slice/crio-d2d424cf429e709dad88ce2f82c01fa5d73293d7a049a9fc406339bd8f9cf2e2 WatchSource:0}: Error finding container d2d424cf429e709dad88ce2f82c01fa5d73293d7a049a9fc406339bd8f9cf2e2: Status 404 returned error can't find the container with id d2d424cf429e709dad88ce2f82c01fa5d73293d7a049a9fc406339bd8f9cf2e2
Jul 09 14:22:08.980391 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:08.980033    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8jlrc" podStartSLOduration=66.191339041 podStartE2EDuration="1m12.980011764s" totalImagesPullingTime="6.788672723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:22:08.978722644 +0000 UTC m=+73.005817027" watchObservedRunningTime="2026-07-09 14:22:08.980011764 +0000 UTC m=+73.007106146"
Jul 09 14:22:09.003153 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.003074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:09.200219 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.200169    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:09.300254 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.300131    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:09.578974 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.578892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:09.679695 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.679654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:09.800076 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.800024    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:09.958793 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.958322    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7jk5k" event={"ID":"9753f0f7-1409-4552-aaad-995fd401dd48","Type":"ContainerStarted","Data":"e8bcc285ee5151aa1eabc018d8880b88322304c8aad8ceb9dedfcd8a93769c33"}
Jul 09 14:22:09.961322 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.961293    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v" event={"ID":"319ef20b-efae-4f45-abd8-346dc7fe5f5f","Type":"ContainerStarted","Data":"9376e41ac2d508804372529876e65aac3316afcf0f8a300b48cbbeee00642c0e"}
Jul 09 14:22:09.961452 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.961371    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v" event={"ID":"319ef20b-efae-4f45-abd8-346dc7fe5f5f","Type":"ContainerStarted","Data":"0abc207536a0d3d470480e254483bd60fcf4e2581f636e54b57ed4be390e2946"}
Jul 09 14:22:09.961452 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.961410    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v" event={"ID":"319ef20b-efae-4f45-abd8-346dc7fe5f5f","Type":"ContainerStarted","Data":"176b1fd9c4737a0277a45d68324b8f62b7fe0b04ab6df24efa12b96eefc9d65d"}
Jul 09 14:22:09.963401 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.963370    2563 generic.go:356] "Generic (PLEG): container finished" podID="56438044-2c01-434d-9aba-3bd20ff106ae" containerID="7c6d375ec84960a1f580e4f7a5d1695c7e3ab57304585dbe36fe5464f1c61cc3" exitCode=0
Jul 09 14:22:09.963501 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.963465    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56438044-2c01-434d-9aba-3bd20ff106ae","Type":"ContainerDied","Data":"7c6d375ec84960a1f580e4f7a5d1695c7e3ab57304585dbe36fe5464f1c61cc3"}
Jul 09 14:22:09.965059 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.965036    2563 generic.go:356] "Generic (PLEG): container finished" podID="680e4740-9071-46c1-b59d-fbfebacfb397" containerID="bd738dcd913562978e9ea13e32d01503f60ea69763de14a92654309a00a1262a" exitCode=0
Jul 09 14:22:09.965157 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.965108    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"680e4740-9071-46c1-b59d-fbfebacfb397","Type":"ContainerDied","Data":"bd738dcd913562978e9ea13e32d01503f60ea69763de14a92654309a00a1262a"}
Jul 09 14:22:09.965218 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.965169    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"680e4740-9071-46c1-b59d-fbfebacfb397","Type":"ContainerStarted","Data":"d2d424cf429e709dad88ce2f82c01fa5d73293d7a049a9fc406339bd8f9cf2e2"}
Jul 09 14:22:09.966333 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.966313    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt" event={"ID":"55a4e26d-6533-4c88-80b6-2ee579f3fc8f","Type":"ContainerStarted","Data":"38ea3de9443d27e0aa77d781845184412a8712060961723d67b18977df6ff5dd"}
Jul 09 14:22:09.969304 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.969273    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv" event={"ID":"7aae19e5-0c9c-472d-951f-988c66993c8c","Type":"ContainerStarted","Data":"1f78d85e3e576123f10208c73e7c0f8f59a0cece3681d881d8c9e198ea2afc4b"}
Jul 09 14:22:09.969377 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.969326    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv" event={"ID":"7aae19e5-0c9c-472d-951f-988c66993c8c","Type":"ContainerStarted","Data":"4e8ee7d15d53be1691f0951892db11a88d8dfacaa7cffcb13a9b86aa4bf8d0d0"}
Jul 09 14:22:09.970729 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.970704    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt" event={"ID":"869b12f3-6f25-4c1a-aa88-1d3674d98128","Type":"ContainerStarted","Data":"7f61d685867fb6ee281742d24d17c17fa7221fbb12ed1ba299d24ff0225686f9"}
Jul 09 14:22:09.973100 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.973074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f49d7" event={"ID":"592b9d09-4aec-4a6f-aac6-de38c842f029","Type":"ContainerStarted","Data":"f972147f4f7f39d586470a1dc20143e6a5ad0160d789bd11ca9c2de62f028174"}
Jul 09 14:22:09.976252 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.976192    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7jk5k" podStartSLOduration=67.178349185 podStartE2EDuration="1m13.976179527s" totalImagesPullingTime="6.797830342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:22:09.974895762 +0000 UTC m=+74.001990143" watchObservedRunningTime="2026-07-09 14:22:09.976179527 +0000 UTC m=+74.003273900"
Jul 09 14:22:09.994264 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:09.994213    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f49d7" podStartSLOduration=6.821942235 podStartE2EDuration="8.994195782s" totalImagesPullingTime="2.049449213s" totalInitContainerRuntime="122.804334ms" isStatefulPod=true podCreationTimestamp="2026-07-09 14:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:22:09.993657178 +0000 UTC m=+74.020751561" watchObservedRunningTime="2026-07-09 14:22:09.994195782 +0000 UTC m=+74.021290165"
Jul 09 14:22:10.037133 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:10.037086    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-v77lv" podStartSLOduration=2.911119127 podStartE2EDuration="9.037068429s" totalImagesPullingTime="6.125949302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:22:10.035938682 +0000 UTC m=+74.063033062" watchObservedRunningTime="2026-07-09 14:22:10.037068429 +0000 UTC m=+74.064162810"
Jul 09 14:22:10.836758 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:10.836675    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:11.412301 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:11.412265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:11.469467 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:11.469417    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:11.988146 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:11.986830    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt" event={"ID":"55a4e26d-6533-4c88-80b6-2ee579f3fc8f","Type":"ContainerStarted","Data":"ce97e318de39d354f7487725a0f32091f7043af962a3aacfe097e7345e680546"}
Jul 09 14:22:11.990110 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:11.987680    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt"
Jul 09 14:22:11.990578 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:11.990550    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt" event={"ID":"869b12f3-6f25-4c1a-aa88-1d3674d98128","Type":"ContainerStarted","Data":"a3623c61175589d293328dfd33d906fec3454d77eb37417bbb852d824d091155"}
Jul 09 14:22:11.994233 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:11.994210    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt"
Jul 09 14:22:12.006128 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:12.006045    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gqwvt" podStartSLOduration=3.504195346 podStartE2EDuration="6.005977645s" totalImagesPullingTime="2.501782299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:22:12.004490038 +0000 UTC m=+76.031584422" watchObservedRunningTime="2026-07-09 14:22:12.005977645 +0000 UTC m=+76.033072026"
Jul 09 14:22:12.025848 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:12.025749    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt" podStartSLOduration=4.46555857 podStartE2EDuration="7.025733121s" totalImagesPullingTime="2.560174551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:22:12.025005551 +0000 UTC m=+76.052099929" watchObservedRunningTime="2026-07-09 14:22:12.025733121 +0000 UTC m=+76.052827479"
Jul 09 14:22:12.449051 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:12.448838    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:12.551233 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:12.551152    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:12.999935 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:12.999900    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v" event={"ID":"319ef20b-efae-4f45-abd8-346dc7fe5f5f","Type":"ContainerStarted","Data":"094319614fafbab8d214b4536151b0280347ca89f037197c87b1e8c6e389baa6"}
Jul 09 14:22:13.000124 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:12.999984    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v" event={"ID":"319ef20b-efae-4f45-abd8-346dc7fe5f5f","Type":"ContainerStarted","Data":"49545476a2c11d33c569a867684d4875a6729d57374b88cd62041d8ec05d1c5f"}
Jul 09 14:22:13.000124 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:13.000027    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v" event={"ID":"319ef20b-efae-4f45-abd8-346dc7fe5f5f","Type":"ContainerStarted","Data":"92967eaf8ab03d44813066d4bb9209b05816683dff0eb6296b8c6952fcf09ffc"}
Jul 09 14:22:13.000124 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:13.000074    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:13.004449 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:13.003841    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56438044-2c01-434d-9aba-3bd20ff106ae","Type":"ContainerStarted","Data":"da18d1fe28521cf398328d440f094592c3f4e1f32226b22149ee99e52e5a2f58"}
Jul 09 14:22:13.004449 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:13.003921    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56438044-2c01-434d-9aba-3bd20ff106ae","Type":"ContainerStarted","Data":"0d3267979ef8003d59a31fb2ba5f0fe25cade7c297bcb9de5fd972d7d0b0019d"}
Jul 09 14:22:13.004449 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:13.003953    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56438044-2c01-434d-9aba-3bd20ff106ae","Type":"ContainerStarted","Data":"4e3988a82b583c0ed098ff167652b0c1947a702c770d34692c83146a7cbcbd6c"}
Jul 09 14:22:13.004449 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:13.003981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56438044-2c01-434d-9aba-3bd20ff106ae","Type":"ContainerStarted","Data":"c511d18621691611763959ebcce32a147083feba812eb40f39e9d12a664a33d1"}
Jul 09 14:22:13.004449 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:13.004016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56438044-2c01-434d-9aba-3bd20ff106ae","Type":"ContainerStarted","Data":"732861bb26a463eed269e499aee2aeae15502521fa4b0c6fb2a08f4530aa3dab"}
Jul 09 14:22:13.004449 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:13.004039    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56438044-2c01-434d-9aba-3bd20ff106ae","Type":"ContainerStarted","Data":"e59c506e8a3536e71eba6110df419daa4e79da1cc77de82aea9e04483b21a0ba"}
Jul 09 14:22:13.023962 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:13.023914    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v" podStartSLOduration=2.097479721 podStartE2EDuration="10.023894978s" totalImagesPullingTime="7.926415257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:22:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:22:13.022175335 +0000 UTC m=+77.049269735" watchObservedRunningTime="2026-07-09 14:22:13.023894978 +0000 UTC m=+77.050989360"
Jul 09 14:22:13.052555 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:13.052493    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.926632287 podStartE2EDuration="11.052470952s" totalImagesPullingTime="7.090030867s" totalInitContainerRuntime="35.807798ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:22:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:22:13.050966191 +0000 UTC m=+77.078060574" watchObservedRunningTime="2026-07-09 14:22:13.052470952 +0000 UTC m=+77.079565339"
Jul 09 14:22:13.579653 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:13.579610    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:13.680144 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:13.680093    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:14.015956 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:14.015925    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-544f5d846b-kcd4v"
Jul 09 14:22:15.017783 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:15.017688    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"680e4740-9071-46c1-b59d-fbfebacfb397","Type":"ContainerStarted","Data":"389e3f0514cd4be0b460246a35aea6cf6e987bcc887b7300bab36cf430d39bd9"}
Jul 09 14:22:15.017783 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:15.017773    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"680e4740-9071-46c1-b59d-fbfebacfb397","Type":"ContainerStarted","Data":"daff7ee74aa53739810f80cec75069f8a42085d5feb9d2bd629f5fa66643d3e3"}
Jul 09 14:22:15.018331 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:15.017840    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"680e4740-9071-46c1-b59d-fbfebacfb397","Type":"ContainerStarted","Data":"01a2dd42474e2f91d192fb403987c6909fdcfb46d7a6e8bb33fac609abb80a83"}
Jul 09 14:22:15.018331 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:15.017877    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"680e4740-9071-46c1-b59d-fbfebacfb397","Type":"ContainerStarted","Data":"21acd445c2f005607f2e2f6c5dee2eb27783b7b4006103ac1c400af122fc10a7"}
Jul 09 14:22:15.018331 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:15.018129    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"680e4740-9071-46c1-b59d-fbfebacfb397","Type":"ContainerStarted","Data":"5daa2317f761ca0e23dd1afb0078ca10de02f4b1cb72f74a6417c3397343670a"}
Jul 09 14:22:15.018331 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:15.018209    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"680e4740-9071-46c1-b59d-fbfebacfb397","Type":"ContainerStarted","Data":"297ca35ca74fb53becae29552790cb6e0aefbbcc56ec0db8f893e4cf6662378d"}
Jul 09 14:22:15.049406 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:15.049266    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.494378161 podStartE2EDuration="8.049244368s" totalImagesPullingTime="4.502491869s" totalInitContainerRuntime="52.374338ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:22:15.04849336 +0000 UTC m=+79.075587772" watchObservedRunningTime="2026-07-09 14:22:15.049244368 +0000 UTC m=+79.076338750"
Jul 09 14:22:17.968307 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:17.968197    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:22:18.155052 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:18.155017    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:18.255475 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:18.255392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:18.744186 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:18.744149    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:21.450099 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:21.450062    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:21.753137 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:21.753099    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:22.707826 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:22.707781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:23.125271 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:23.125195    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:24.216943 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:24.216910    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:24.317350 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:24.317316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:26.172066 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:26.172026    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:26.172481 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:26.172091    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:26.421972 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:26.421931    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:26.489362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:26.489326    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:28.216418 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:28.216386    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:28.317164 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:28.317118    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:30.835364 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:30.835322    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:30.888928 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:30.888893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:36.599391 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:36.599358    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:36.700252 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:36.700209    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:36.800987 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:36.800950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:38.446272 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:38.446240    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:38.550121 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:38.550080    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:39.896115 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:39.896081    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:39.960234 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:39.960193    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:39.975698 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:39.975670    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8jlrc"
Jul 09 14:22:43.204812 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:43.204781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:43.304326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:43.304287    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:46.177424 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:46.177396    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:46.181177 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:46.181150    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6959b9ffdf-8fmqt"
Jul 09 14:22:58.206127 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:58.206091    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:22:58.465586 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:22:58.465534    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:23:07.968761 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:07.968718    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:07.988115 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:07.988093    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:08.255862 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:08.255757    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:20.711272 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:20.711231    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:23:21.014461 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:21.014372    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:23:21.781396 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:21.781353    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 14:23:21.781938 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:21.781751    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="alertmanager" containerID="cri-o://e59c506e8a3536e71eba6110df419daa4e79da1cc77de82aea9e04483b21a0ba" gracePeriod=120
Jul 09 14:23:21.781938 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:21.781818    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="kube-rbac-proxy-metric" containerID="cri-o://0d3267979ef8003d59a31fb2ba5f0fe25cade7c297bcb9de5fd972d7d0b0019d" gracePeriod=120
Jul 09 14:23:21.781938 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:21.781838    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="config-reloader" containerID="cri-o://732861bb26a463eed269e499aee2aeae15502521fa4b0c6fb2a08f4530aa3dab" gracePeriod=120
Jul 09 14:23:21.781938 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:21.781845    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="kube-rbac-proxy-web" containerID="cri-o://c511d18621691611763959ebcce32a147083feba812eb40f39e9d12a664a33d1" gracePeriod=120
Jul 09 14:23:21.781938 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:21.781858    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="prom-label-proxy" containerID="cri-o://da18d1fe28521cf398328d440f094592c3f4e1f32226b22149ee99e52e5a2f58" gracePeriod=120
Jul 09 14:23:21.781938 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:21.781896    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="kube-rbac-proxy" containerID="cri-o://4e3988a82b583c0ed098ff167652b0c1947a702c770d34692c83146a7cbcbd6c" gracePeriod=120
Jul 09 14:23:22.296848 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:22.296791    2563 generic.go:356] "Generic (PLEG): container finished" podID="56438044-2c01-434d-9aba-3bd20ff106ae" containerID="da18d1fe28521cf398328d440f094592c3f4e1f32226b22149ee99e52e5a2f58" exitCode=0
Jul 09 14:23:22.296848 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:22.296829    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56438044-2c01-434d-9aba-3bd20ff106ae","Type":"ContainerDied","Data":"da18d1fe28521cf398328d440f094592c3f4e1f32226b22149ee99e52e5a2f58"}
Jul 09 14:23:22.296848 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:22.296843    2563 generic.go:356] "Generic (PLEG): container finished" podID="56438044-2c01-434d-9aba-3bd20ff106ae" containerID="0d3267979ef8003d59a31fb2ba5f0fe25cade7c297bcb9de5fd972d7d0b0019d" exitCode=0
Jul 09 14:23:22.296848 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:22.296850    2563 generic.go:356] "Generic (PLEG): container finished" podID="56438044-2c01-434d-9aba-3bd20ff106ae" containerID="4e3988a82b583c0ed098ff167652b0c1947a702c770d34692c83146a7cbcbd6c" exitCode=0
Jul 09 14:23:22.296848 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:22.296856    2563 generic.go:356] "Generic (PLEG): container finished" podID="56438044-2c01-434d-9aba-3bd20ff106ae" containerID="732861bb26a463eed269e499aee2aeae15502521fa4b0c6fb2a08f4530aa3dab" exitCode=0
Jul 09 14:23:22.297147 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:22.296863    2563 generic.go:356] "Generic (PLEG): container finished" podID="56438044-2c01-434d-9aba-3bd20ff106ae" containerID="e59c506e8a3536e71eba6110df419daa4e79da1cc77de82aea9e04483b21a0ba" exitCode=0
Jul 09 14:23:22.297147 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:22.296893    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56438044-2c01-434d-9aba-3bd20ff106ae","Type":"ContainerDied","Data":"0d3267979ef8003d59a31fb2ba5f0fe25cade7c297bcb9de5fd972d7d0b0019d"}
Jul 09 14:23:22.297147 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:22.296918    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56438044-2c01-434d-9aba-3bd20ff106ae","Type":"ContainerDied","Data":"4e3988a82b583c0ed098ff167652b0c1947a702c770d34692c83146a7cbcbd6c"}
Jul 09 14:23:22.297147 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:22.296943    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56438044-2c01-434d-9aba-3bd20ff106ae","Type":"ContainerDied","Data":"732861bb26a463eed269e499aee2aeae15502521fa4b0c6fb2a08f4530aa3dab"}
Jul 09 14:23:22.297147 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:22.296968    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56438044-2c01-434d-9aba-3bd20ff106ae","Type":"ContainerDied","Data":"e59c506e8a3536e71eba6110df419daa4e79da1cc77de82aea9e04483b21a0ba"}
Jul 09 14:23:23.028198 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.028173    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.034157 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.034140    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy-web\") pod \"56438044-2c01-434d-9aba-3bd20ff106ae\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") "
Jul 09 14:23:23.034214 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.034193    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-cluster-tls-config\") pod \"56438044-2c01-434d-9aba-3bd20ff106ae\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") "
Jul 09 14:23:23.034249 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.034216    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56438044-2c01-434d-9aba-3bd20ff106ae-metrics-client-ca\") pod \"56438044-2c01-434d-9aba-3bd20ff106ae\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") "
Jul 09 14:23:23.034249 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.034234    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-main-tls\") pod \"56438044-2c01-434d-9aba-3bd20ff106ae\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") "
Jul 09 14:23:23.034314 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.034257    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-config-volume\") pod \"56438044-2c01-434d-9aba-3bd20ff106ae\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") "
Jul 09 14:23:23.034314 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.034283    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ql4r\" (UniqueName: \"kubernetes.io/projected/56438044-2c01-434d-9aba-3bd20ff106ae-kube-api-access-9ql4r\") pod \"56438044-2c01-434d-9aba-3bd20ff106ae\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") "
Jul 09 14:23:23.034385 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.034313    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"56438044-2c01-434d-9aba-3bd20ff106ae\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") "
Jul 09 14:23:23.034385 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.034343    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56438044-2c01-434d-9aba-3bd20ff106ae-alertmanager-trusted-ca-bundle\") pod \"56438044-2c01-434d-9aba-3bd20ff106ae\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") "
Jul 09 14:23:23.034385 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.034369    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56438044-2c01-434d-9aba-3bd20ff106ae-config-out\") pod \"56438044-2c01-434d-9aba-3bd20ff106ae\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") "
Jul 09 14:23:23.034527 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.034398    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/56438044-2c01-434d-9aba-3bd20ff106ae-alertmanager-main-db\") pod \"56438044-2c01-434d-9aba-3bd20ff106ae\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") "
Jul 09 14:23:23.034527 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.034431    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56438044-2c01-434d-9aba-3bd20ff106ae-tls-assets\") pod \"56438044-2c01-434d-9aba-3bd20ff106ae\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") "
Jul 09 14:23:23.034527 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.034465    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy\") pod \"56438044-2c01-434d-9aba-3bd20ff106ae\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") "
Jul 09 14:23:23.034527 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.034513    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-web-config\") pod \"56438044-2c01-434d-9aba-3bd20ff106ae\" (UID: \"56438044-2c01-434d-9aba-3bd20ff106ae\") "
Jul 09 14:23:23.034719 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.034596    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56438044-2c01-434d-9aba-3bd20ff106ae-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "56438044-2c01-434d-9aba-3bd20ff106ae" (UID: "56438044-2c01-434d-9aba-3bd20ff106ae"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:23:23.034848 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.034792    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56438044-2c01-434d-9aba-3bd20ff106ae-metrics-client-ca\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:23.036028 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.035984    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56438044-2c01-434d-9aba-3bd20ff106ae-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "56438044-2c01-434d-9aba-3bd20ff106ae" (UID: "56438044-2c01-434d-9aba-3bd20ff106ae"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:23:23.036028 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.036006    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56438044-2c01-434d-9aba-3bd20ff106ae-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "56438044-2c01-434d-9aba-3bd20ff106ae" (UID: "56438044-2c01-434d-9aba-3bd20ff106ae"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:23:23.037882 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.037832    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "56438044-2c01-434d-9aba-3bd20ff106ae" (UID: "56438044-2c01-434d-9aba-3bd20ff106ae"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:23:23.038008 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.037896    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56438044-2c01-434d-9aba-3bd20ff106ae-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "56438044-2c01-434d-9aba-3bd20ff106ae" (UID: "56438044-2c01-434d-9aba-3bd20ff106ae"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:23:23.038410 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.038374    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "56438044-2c01-434d-9aba-3bd20ff106ae" (UID: "56438044-2c01-434d-9aba-3bd20ff106ae"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:23:23.038410 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.038401    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-config-volume" (OuterVolumeSpecName: "config-volume") pod "56438044-2c01-434d-9aba-3bd20ff106ae" (UID: "56438044-2c01-434d-9aba-3bd20ff106ae"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:23:23.038675 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.038516    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "56438044-2c01-434d-9aba-3bd20ff106ae" (UID: "56438044-2c01-434d-9aba-3bd20ff106ae"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:23:23.038675 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.038609    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56438044-2c01-434d-9aba-3bd20ff106ae-kube-api-access-9ql4r" (OuterVolumeSpecName: "kube-api-access-9ql4r") pod "56438044-2c01-434d-9aba-3bd20ff106ae" (UID: "56438044-2c01-434d-9aba-3bd20ff106ae"). InnerVolumeSpecName "kube-api-access-9ql4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:23:23.038675 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.038624    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "56438044-2c01-434d-9aba-3bd20ff106ae" (UID: "56438044-2c01-434d-9aba-3bd20ff106ae"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:23:23.038675 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.038630    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56438044-2c01-434d-9aba-3bd20ff106ae-config-out" (OuterVolumeSpecName: "config-out") pod "56438044-2c01-434d-9aba-3bd20ff106ae" (UID: "56438044-2c01-434d-9aba-3bd20ff106ae"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:23:23.041864 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.041761    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "56438044-2c01-434d-9aba-3bd20ff106ae" (UID: "56438044-2c01-434d-9aba-3bd20ff106ae"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:23:23.049313 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.049285    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-web-config" (OuterVolumeSpecName: "web-config") pod "56438044-2c01-434d-9aba-3bd20ff106ae" (UID: "56438044-2c01-434d-9aba-3bd20ff106ae"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:23:23.135224 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.135139    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-cluster-tls-config\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:23.135224 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.135172    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-main-tls\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:23.135224 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.135183    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-config-volume\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:23.135224 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.135191    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ql4r\" (UniqueName: \"kubernetes.io/projected/56438044-2c01-434d-9aba-3bd20ff106ae-kube-api-access-9ql4r\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:23.135224 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.135201    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:23.135224 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.135212    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56438044-2c01-434d-9aba-3bd20ff106ae-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:23.135224 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.135220    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/56438044-2c01-434d-9aba-3bd20ff106ae-config-out\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:23.135224 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.135228    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/56438044-2c01-434d-9aba-3bd20ff106ae-alertmanager-main-db\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:23.135224 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.135236    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/56438044-2c01-434d-9aba-3bd20ff106ae-tls-assets\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:23.135602 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.135244    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:23.135602 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.135254    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-web-config\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:23.135602 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.135262    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56438044-2c01-434d-9aba-3bd20ff106ae-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:23.303440 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.303398    2563 generic.go:356] "Generic (PLEG): container finished" podID="56438044-2c01-434d-9aba-3bd20ff106ae" containerID="c511d18621691611763959ebcce32a147083feba812eb40f39e9d12a664a33d1" exitCode=0
Jul 09 14:23:23.303599 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.303477    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56438044-2c01-434d-9aba-3bd20ff106ae","Type":"ContainerDied","Data":"c511d18621691611763959ebcce32a147083feba812eb40f39e9d12a664a33d1"}
Jul 09 14:23:23.303599 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.303551    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"56438044-2c01-434d-9aba-3bd20ff106ae","Type":"ContainerDied","Data":"bf6a736573089a52091cd2d5fff7125e0653b6db7a082d48e1e3b0c35f163c74"}
Jul 09 14:23:23.303599 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.303486    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.303599 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.303583    2563 scope.go:117] "RemoveContainer" containerID="da18d1fe28521cf398328d440f094592c3f4e1f32226b22149ee99e52e5a2f58"
Jul 09 14:23:23.312388 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.312367    2563 scope.go:117] "RemoveContainer" containerID="0d3267979ef8003d59a31fb2ba5f0fe25cade7c297bcb9de5fd972d7d0b0019d"
Jul 09 14:23:23.321929 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.321177    2563 scope.go:117] "RemoveContainer" containerID="4e3988a82b583c0ed098ff167652b0c1947a702c770d34692c83146a7cbcbd6c"
Jul 09 14:23:23.328495 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.328473    2563 scope.go:117] "RemoveContainer" containerID="c511d18621691611763959ebcce32a147083feba812eb40f39e9d12a664a33d1"
Jul 09 14:23:23.332060 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.332038    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 14:23:23.336643 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.336623    2563 scope.go:117] "RemoveContainer" containerID="732861bb26a463eed269e499aee2aeae15502521fa4b0c6fb2a08f4530aa3dab"
Jul 09 14:23:23.339002 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.338981    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 14:23:23.343475 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.343459    2563 scope.go:117] "RemoveContainer" containerID="e59c506e8a3536e71eba6110df419daa4e79da1cc77de82aea9e04483b21a0ba"
Jul 09 14:23:23.350259 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.350243    2563 scope.go:117] "RemoveContainer" containerID="7c6d375ec84960a1f580e4f7a5d1695c7e3ab57304585dbe36fe5464f1c61cc3"
Jul 09 14:23:23.357335 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.357319    2563 scope.go:117] "RemoveContainer" containerID="da18d1fe28521cf398328d440f094592c3f4e1f32226b22149ee99e52e5a2f58"
Jul 09 14:23:23.357594 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:23:23.357573    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da18d1fe28521cf398328d440f094592c3f4e1f32226b22149ee99e52e5a2f58\": container with ID starting with da18d1fe28521cf398328d440f094592c3f4e1f32226b22149ee99e52e5a2f58 not found: ID does not exist" containerID="da18d1fe28521cf398328d440f094592c3f4e1f32226b22149ee99e52e5a2f58"
Jul 09 14:23:23.357664 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.357607    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da18d1fe28521cf398328d440f094592c3f4e1f32226b22149ee99e52e5a2f58"} err="failed to get container status \"da18d1fe28521cf398328d440f094592c3f4e1f32226b22149ee99e52e5a2f58\": rpc error: code = NotFound desc = could not find container \"da18d1fe28521cf398328d440f094592c3f4e1f32226b22149ee99e52e5a2f58\": container with ID starting with da18d1fe28521cf398328d440f094592c3f4e1f32226b22149ee99e52e5a2f58 not found: ID does not exist"
Jul 09 14:23:23.357664 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.357652    2563 scope.go:117] "RemoveContainer" containerID="0d3267979ef8003d59a31fb2ba5f0fe25cade7c297bcb9de5fd972d7d0b0019d"
Jul 09 14:23:23.357911 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:23:23.357895    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d3267979ef8003d59a31fb2ba5f0fe25cade7c297bcb9de5fd972d7d0b0019d\": container with ID starting with 0d3267979ef8003d59a31fb2ba5f0fe25cade7c297bcb9de5fd972d7d0b0019d not found: ID does not exist" containerID="0d3267979ef8003d59a31fb2ba5f0fe25cade7c297bcb9de5fd972d7d0b0019d"
Jul 09 14:23:23.357955 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.357918    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3267979ef8003d59a31fb2ba5f0fe25cade7c297bcb9de5fd972d7d0b0019d"} err="failed to get container status \"0d3267979ef8003d59a31fb2ba5f0fe25cade7c297bcb9de5fd972d7d0b0019d\": rpc error: code = NotFound desc = could not find container \"0d3267979ef8003d59a31fb2ba5f0fe25cade7c297bcb9de5fd972d7d0b0019d\": container with ID starting with 0d3267979ef8003d59a31fb2ba5f0fe25cade7c297bcb9de5fd972d7d0b0019d not found: ID does not exist"
Jul 09 14:23:23.357955 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.357933    2563 scope.go:117] "RemoveContainer" containerID="4e3988a82b583c0ed098ff167652b0c1947a702c770d34692c83146a7cbcbd6c"
Jul 09 14:23:23.358143 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:23:23.358125    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e3988a82b583c0ed098ff167652b0c1947a702c770d34692c83146a7cbcbd6c\": container with ID starting with 4e3988a82b583c0ed098ff167652b0c1947a702c770d34692c83146a7cbcbd6c not found: ID does not exist" containerID="4e3988a82b583c0ed098ff167652b0c1947a702c770d34692c83146a7cbcbd6c"
Jul 09 14:23:23.358206 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.358151    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e3988a82b583c0ed098ff167652b0c1947a702c770d34692c83146a7cbcbd6c"} err="failed to get container status \"4e3988a82b583c0ed098ff167652b0c1947a702c770d34692c83146a7cbcbd6c\": rpc error: code = NotFound desc = could not find container \"4e3988a82b583c0ed098ff167652b0c1947a702c770d34692c83146a7cbcbd6c\": container with ID starting with 4e3988a82b583c0ed098ff167652b0c1947a702c770d34692c83146a7cbcbd6c not found: ID does not exist"
Jul 09 14:23:23.358206 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.358173    2563 scope.go:117] "RemoveContainer" containerID="c511d18621691611763959ebcce32a147083feba812eb40f39e9d12a664a33d1"
Jul 09 14:23:23.358381 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:23:23.358364    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c511d18621691611763959ebcce32a147083feba812eb40f39e9d12a664a33d1\": container with ID starting with c511d18621691611763959ebcce32a147083feba812eb40f39e9d12a664a33d1 not found: ID does not exist" containerID="c511d18621691611763959ebcce32a147083feba812eb40f39e9d12a664a33d1"
Jul 09 14:23:23.358418 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.358387    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c511d18621691611763959ebcce32a147083feba812eb40f39e9d12a664a33d1"} err="failed to get container status \"c511d18621691611763959ebcce32a147083feba812eb40f39e9d12a664a33d1\": rpc error: code = NotFound desc = could not find container \"c511d18621691611763959ebcce32a147083feba812eb40f39e9d12a664a33d1\": container with ID starting with c511d18621691611763959ebcce32a147083feba812eb40f39e9d12a664a33d1 not found: ID does not exist"
Jul 09 14:23:23.358418 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.358400    2563 scope.go:117] "RemoveContainer" containerID="732861bb26a463eed269e499aee2aeae15502521fa4b0c6fb2a08f4530aa3dab"
Jul 09 14:23:23.358614 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:23:23.358597    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"732861bb26a463eed269e499aee2aeae15502521fa4b0c6fb2a08f4530aa3dab\": container with ID starting with 732861bb26a463eed269e499aee2aeae15502521fa4b0c6fb2a08f4530aa3dab not found: ID does not exist" containerID="732861bb26a463eed269e499aee2aeae15502521fa4b0c6fb2a08f4530aa3dab"
Jul 09 14:23:23.358669 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.358620    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"732861bb26a463eed269e499aee2aeae15502521fa4b0c6fb2a08f4530aa3dab"} err="failed to get container status \"732861bb26a463eed269e499aee2aeae15502521fa4b0c6fb2a08f4530aa3dab\": rpc error: code = NotFound desc = could not find container \"732861bb26a463eed269e499aee2aeae15502521fa4b0c6fb2a08f4530aa3dab\": container with ID starting with 732861bb26a463eed269e499aee2aeae15502521fa4b0c6fb2a08f4530aa3dab not found: ID does not exist"
Jul 09 14:23:23.358669 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.358638    2563 scope.go:117] "RemoveContainer" containerID="e59c506e8a3536e71eba6110df419daa4e79da1cc77de82aea9e04483b21a0ba"
Jul 09 14:23:23.358867 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:23:23.358852    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e59c506e8a3536e71eba6110df419daa4e79da1cc77de82aea9e04483b21a0ba\": container with ID starting with e59c506e8a3536e71eba6110df419daa4e79da1cc77de82aea9e04483b21a0ba not found: ID does not exist" containerID="e59c506e8a3536e71eba6110df419daa4e79da1cc77de82aea9e04483b21a0ba"
Jul 09 14:23:23.358921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.358870    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e59c506e8a3536e71eba6110df419daa4e79da1cc77de82aea9e04483b21a0ba"} err="failed to get container status \"e59c506e8a3536e71eba6110df419daa4e79da1cc77de82aea9e04483b21a0ba\": rpc error: code = NotFound desc = could not find container \"e59c506e8a3536e71eba6110df419daa4e79da1cc77de82aea9e04483b21a0ba\": container with ID starting with e59c506e8a3536e71eba6110df419daa4e79da1cc77de82aea9e04483b21a0ba not found: ID does not exist"
Jul 09 14:23:23.358921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.358882    2563 scope.go:117] "RemoveContainer" containerID="7c6d375ec84960a1f580e4f7a5d1695c7e3ab57304585dbe36fe5464f1c61cc3"
Jul 09 14:23:23.359118 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:23:23.359103    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c6d375ec84960a1f580e4f7a5d1695c7e3ab57304585dbe36fe5464f1c61cc3\": container with ID starting with 7c6d375ec84960a1f580e4f7a5d1695c7e3ab57304585dbe36fe5464f1c61cc3 not found: ID does not exist" containerID="7c6d375ec84960a1f580e4f7a5d1695c7e3ab57304585dbe36fe5464f1c61cc3"
Jul 09 14:23:23.359160 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.359120    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c6d375ec84960a1f580e4f7a5d1695c7e3ab57304585dbe36fe5464f1c61cc3"} err="failed to get container status \"7c6d375ec84960a1f580e4f7a5d1695c7e3ab57304585dbe36fe5464f1c61cc3\": rpc error: code = NotFound desc = could not find container \"7c6d375ec84960a1f580e4f7a5d1695c7e3ab57304585dbe36fe5464f1c61cc3\": container with ID starting with 7c6d375ec84960a1f580e4f7a5d1695c7e3ab57304585dbe36fe5464f1c61cc3 not found: ID does not exist"
Jul 09 14:23:23.362429 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.362404    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 14:23:23.362756 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.362739    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="kube-rbac-proxy"
Jul 09 14:23:23.362857 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.362759    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="kube-rbac-proxy"
Jul 09 14:23:23.362857 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.362774    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="init-config-reloader"
Jul 09 14:23:23.362857 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.362783    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="init-config-reloader"
Jul 09 14:23:23.362857 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.362828    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="prom-label-proxy"
Jul 09 14:23:23.362857 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.362837    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="prom-label-proxy"
Jul 09 14:23:23.362857 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.362854    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="kube-rbac-proxy-web"
Jul 09 14:23:23.363138 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.362862    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="kube-rbac-proxy-web"
Jul 09 14:23:23.363138 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.362877    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="kube-rbac-proxy-metric"
Jul 09 14:23:23.363138 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.362885    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="kube-rbac-proxy-metric"
Jul 09 14:23:23.363138 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.362897    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="alertmanager"
Jul 09 14:23:23.363138 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.362905    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="alertmanager"
Jul 09 14:23:23.363138 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.362914    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="config-reloader"
Jul 09 14:23:23.363138 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.362922    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="config-reloader"
Jul 09 14:23:23.363138 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.363001    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="kube-rbac-proxy-web"
Jul 09 14:23:23.363138 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.363013    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="alertmanager"
Jul 09 14:23:23.363138 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.363025    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="kube-rbac-proxy"
Jul 09 14:23:23.363138 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.363036    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="config-reloader"
Jul 09 14:23:23.363138 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.363045    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="prom-label-proxy"
Jul 09 14:23:23.363138 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.363055    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" containerName="kube-rbac-proxy-metric"
Jul 09 14:23:23.368507 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.368487    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.371069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.371048    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 14:23:23.371212 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.371088    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 14:23:23.371212 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.371103    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lqr4f\""
Jul 09 14:23:23.371366 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.371345    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 14:23:23.371366 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.371354    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 14:23:23.371496 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.371348    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 14:23:23.371496 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.371479    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 14:23:23.371598 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.371500    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 14:23:23.371598 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.371479    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 14:23:23.376612 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.376594    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 14:23:23.379865 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.379837    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 14:23:23.436857 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.436754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.436857 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.436786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.436857 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.436825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.437060 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.436912    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.437060 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.436951    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-config-volume\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.437060 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.436980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2jtp\" (UniqueName: \"kubernetes.io/projected/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-kube-api-access-f2jtp\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.437060 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.437011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.437060 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.437042    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.437258 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.437081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.437258 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.437095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-web-config\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.437258 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.437161    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.437258 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.437198    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.437258 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.437223    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-config-out\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.537530 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.537497    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.537530 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.537534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.537743 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.537550    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.537743 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.537566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.537743 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.537698    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-config-volume\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.537743 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.537737    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2jtp\" (UniqueName: \"kubernetes.io/projected/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-kube-api-access-f2jtp\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.537964 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.537764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.537964 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.537830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.537964 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.537896    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.537964 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.537920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-web-config\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.538161 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.537963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.538161 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.538011    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.538161 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.538054    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-config-out\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.538753 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.538443    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.538753 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.538563    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.538949 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.538837    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.541346 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.541318    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.541450 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.541409    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.541687 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.541528    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-config-volume\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.541687 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.541568    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-config-out\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.541687 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.541635    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.541687 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.541638    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.541958 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.541719    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-web-config\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.541958 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.541932    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.542651 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.542634    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.547254 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.547236    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2jtp\" (UniqueName: \"kubernetes.io/projected/bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3-kube-api-access-f2jtp\") pod \"alertmanager-main-0\" (UID: \"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.677947 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.677918    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:23:23.841836 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:23.841667    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 14:23:23.844338 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:23:23.844310    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc85dc7a_a2a2_4fc6_9ec0_06d260187bb3.slice/crio-327c1512cd0fbe3b2455f499c974b44d461ba9d171cfa616320280b85703615f WatchSource:0}: Error finding container 327c1512cd0fbe3b2455f499c974b44d461ba9d171cfa616320280b85703615f: Status 404 returned error can't find the container with id 327c1512cd0fbe3b2455f499c974b44d461ba9d171cfa616320280b85703615f
Jul 09 14:23:24.308670 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:24.308641    2563 generic.go:356] "Generic (PLEG): container finished" podID="bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3" containerID="8906e99d792a53f841879c05a7881e664026e09b35a8badd6e0e4653dd3076e6" exitCode=0
Jul 09 14:23:24.309087 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:24.308728    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3","Type":"ContainerDied","Data":"8906e99d792a53f841879c05a7881e664026e09b35a8badd6e0e4653dd3076e6"}
Jul 09 14:23:24.309087 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:24.308824    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3","Type":"ContainerStarted","Data":"327c1512cd0fbe3b2455f499c974b44d461ba9d171cfa616320280b85703615f"}
Jul 09 14:23:24.460102 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:24.460068    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56438044-2c01-434d-9aba-3bd20ff106ae" path="/var/lib/kubelet/pods/56438044-2c01-434d-9aba-3bd20ff106ae/volumes"
Jul 09 14:23:25.317604 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.317573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3","Type":"ContainerStarted","Data":"096c01b7a484350df6790d50623349939b48756b3e51ecd0f6a9d478e259d69d"}
Jul 09 14:23:25.318072 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.317632    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3","Type":"ContainerStarted","Data":"f8fccd3cf7e2b6e58de2530808841b7010fc0f40f61cb45d8bd1e7e862feb43e"}
Jul 09 14:23:25.318072 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.317663    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3","Type":"ContainerStarted","Data":"5dc85ea9b3347404432ac5de75744ecd1e3c7d40381eb69465d750c806ba7d6e"}
Jul 09 14:23:25.318072 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.317694    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3","Type":"ContainerStarted","Data":"ba622efdfb6f805487c83a033c4c2108eea4dc583a9f4ead6e10d8f6c4b3244d"}
Jul 09 14:23:25.318072 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.317718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3","Type":"ContainerStarted","Data":"3d704ba14ab87d52c4c269a972fb034392d09065dc3a0f08158b1f5229fdb23e"}
Jul 09 14:23:25.318072 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.317740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3","Type":"ContainerStarted","Data":"80de2f6ae91e51fcb80931ac0331ce891014ec0a4c30ff9848741cd71967741f"}
Jul 09 14:23:25.344527 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.344458    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.329638153 podStartE2EDuration="2.34443674s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.798587ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:23:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:23:25.343153235 +0000 UTC m=+149.370247646" watchObservedRunningTime="2026-07-09 14:23:25.34443674 +0000 UTC m=+149.371531113"
Jul 09 14:23:25.796641 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.796602    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5445c9b998-cxks4"]
Jul 09 14:23:25.800269 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.800250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.802896 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.802864    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 09 14:23:25.803219 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.803199    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 09 14:23:25.803419 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.803402    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 09 14:23:25.803818 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.803778    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 09 14:23:25.804017 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.803998    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-567fd\""
Jul 09 14:23:25.804316 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.804291    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 09 14:23:25.808229 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.808206    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 09 14:23:25.812338 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.812316    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5445c9b998-cxks4"]
Jul 09 14:23:25.861927 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.861890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df5d743a-8637-4223-9b54-800c6ea97956-serving-certs-ca-bundle\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.862122 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.861953    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/df5d743a-8637-4223-9b54-800c6ea97956-telemeter-client-tls\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.862122 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.862037    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df5d743a-8637-4223-9b54-800c6ea97956-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.862122 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.862072    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df5d743a-8637-4223-9b54-800c6ea97956-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.862122 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.862096    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crm8x\" (UniqueName: \"kubernetes.io/projected/df5d743a-8637-4223-9b54-800c6ea97956-kube-api-access-crm8x\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.862122 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.862117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df5d743a-8637-4223-9b54-800c6ea97956-metrics-client-ca\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.862337 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.862152    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/df5d743a-8637-4223-9b54-800c6ea97956-secret-telemeter-client\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.862337 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.862192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/df5d743a-8637-4223-9b54-800c6ea97956-federate-client-tls\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.963369 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.963333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crm8x\" (UniqueName: \"kubernetes.io/projected/df5d743a-8637-4223-9b54-800c6ea97956-kube-api-access-crm8x\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.963369 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.963369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df5d743a-8637-4223-9b54-800c6ea97956-metrics-client-ca\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.963704 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.963391    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/df5d743a-8637-4223-9b54-800c6ea97956-secret-telemeter-client\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.963704 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.963413    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/df5d743a-8637-4223-9b54-800c6ea97956-federate-client-tls\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.963704 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.963465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df5d743a-8637-4223-9b54-800c6ea97956-serving-certs-ca-bundle\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.963704 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.963498    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/df5d743a-8637-4223-9b54-800c6ea97956-telemeter-client-tls\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.963704 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.963529    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df5d743a-8637-4223-9b54-800c6ea97956-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.963704 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.963560    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df5d743a-8637-4223-9b54-800c6ea97956-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.964346 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.964275    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df5d743a-8637-4223-9b54-800c6ea97956-serving-certs-ca-bundle\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.964862 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.964834    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df5d743a-8637-4223-9b54-800c6ea97956-metrics-client-ca\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.965226 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.965196    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df5d743a-8637-4223-9b54-800c6ea97956-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.966068 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.966046    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/df5d743a-8637-4223-9b54-800c6ea97956-telemeter-client-tls\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.966380 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.966356    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/df5d743a-8637-4223-9b54-800c6ea97956-secret-telemeter-client\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.966582 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.966561    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/df5d743a-8637-4223-9b54-800c6ea97956-federate-client-tls\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.966721 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.966696    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df5d743a-8637-4223-9b54-800c6ea97956-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:25.972286 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:25.972260    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crm8x\" (UniqueName: \"kubernetes.io/projected/df5d743a-8637-4223-9b54-800c6ea97956-kube-api-access-crm8x\") pod \"telemeter-client-5445c9b998-cxks4\" (UID: \"df5d743a-8637-4223-9b54-800c6ea97956\") " pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:26.103591 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.103501    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:23:26.103853 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.103820    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="prometheus" containerID="cri-o://297ca35ca74fb53becae29552790cb6e0aefbbcc56ec0db8f893e4cf6662378d" gracePeriod=600
Jul 09 14:23:26.103961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.103865    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="config-reloader" containerID="cri-o://5daa2317f761ca0e23dd1afb0078ca10de02f4b1cb72f74a6417c3397343670a" gracePeriod=600
Jul 09 14:23:26.103961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.103854    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="kube-rbac-proxy" containerID="cri-o://daff7ee74aa53739810f80cec75069f8a42085d5feb9d2bd629f5fa66643d3e3" gracePeriod=600
Jul 09 14:23:26.103961 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.103901    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="kube-rbac-proxy-thanos" containerID="cri-o://389e3f0514cd4be0b460246a35aea6cf6e987bcc887b7300bab36cf430d39bd9" gracePeriod=600
Jul 09 14:23:26.104126 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.103836    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="kube-rbac-proxy-web" containerID="cri-o://01a2dd42474e2f91d192fb403987c6909fdcfb46d7a6e8bb33fac609abb80a83" gracePeriod=600
Jul 09 14:23:26.104126 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.104024    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="thanos-sidecar" containerID="cri-o://21acd445c2f005607f2e2f6c5dee2eb27783b7b4006103ac1c400af122fc10a7" gracePeriod=600
Jul 09 14:23:26.114065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.113841    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4"
Jul 09 14:23:26.286750 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.286726    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5445c9b998-cxks4"]
Jul 09 14:23:26.288844 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:23:26.288815    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf5d743a_8637_4223_9b54_800c6ea97956.slice/crio-2c9c88f90d40583257d26543fe5e2c0a9565101acb7a31bdc2a09467d3a17dce WatchSource:0}: Error finding container 2c9c88f90d40583257d26543fe5e2c0a9565101acb7a31bdc2a09467d3a17dce: Status 404 returned error can't find the container with id 2c9c88f90d40583257d26543fe5e2c0a9565101acb7a31bdc2a09467d3a17dce
Jul 09 14:23:26.325148 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.325070    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4" event={"ID":"df5d743a-8637-4223-9b54-800c6ea97956","Type":"ContainerStarted","Data":"2c9c88f90d40583257d26543fe5e2c0a9565101acb7a31bdc2a09467d3a17dce"}
Jul 09 14:23:26.329165 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.329136    2563 generic.go:356] "Generic (PLEG): container finished" podID="680e4740-9071-46c1-b59d-fbfebacfb397" containerID="389e3f0514cd4be0b460246a35aea6cf6e987bcc887b7300bab36cf430d39bd9" exitCode=0
Jul 09 14:23:26.329165 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.329165    2563 generic.go:356] "Generic (PLEG): container finished" podID="680e4740-9071-46c1-b59d-fbfebacfb397" containerID="daff7ee74aa53739810f80cec75069f8a42085d5feb9d2bd629f5fa66643d3e3" exitCode=0
Jul 09 14:23:26.329165 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.329174    2563 generic.go:356] "Generic (PLEG): container finished" podID="680e4740-9071-46c1-b59d-fbfebacfb397" containerID="01a2dd42474e2f91d192fb403987c6909fdcfb46d7a6e8bb33fac609abb80a83" exitCode=0
Jul 09 14:23:26.329398 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.329183    2563 generic.go:356] "Generic (PLEG): container finished" podID="680e4740-9071-46c1-b59d-fbfebacfb397" containerID="21acd445c2f005607f2e2f6c5dee2eb27783b7b4006103ac1c400af122fc10a7" exitCode=0
Jul 09 14:23:26.329398 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.329195    2563 generic.go:356] "Generic (PLEG): container finished" podID="680e4740-9071-46c1-b59d-fbfebacfb397" containerID="5daa2317f761ca0e23dd1afb0078ca10de02f4b1cb72f74a6417c3397343670a" exitCode=0
Jul 09 14:23:26.329398 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.329202    2563 generic.go:356] "Generic (PLEG): container finished" podID="680e4740-9071-46c1-b59d-fbfebacfb397" containerID="297ca35ca74fb53becae29552790cb6e0aefbbcc56ec0db8f893e4cf6662378d" exitCode=0
Jul 09 14:23:26.330427 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.329572    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"680e4740-9071-46c1-b59d-fbfebacfb397","Type":"ContainerDied","Data":"389e3f0514cd4be0b460246a35aea6cf6e987bcc887b7300bab36cf430d39bd9"}
Jul 09 14:23:26.330427 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.329645    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"680e4740-9071-46c1-b59d-fbfebacfb397","Type":"ContainerDied","Data":"daff7ee74aa53739810f80cec75069f8a42085d5feb9d2bd629f5fa66643d3e3"}
Jul 09 14:23:26.330427 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.329687    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"680e4740-9071-46c1-b59d-fbfebacfb397","Type":"ContainerDied","Data":"01a2dd42474e2f91d192fb403987c6909fdcfb46d7a6e8bb33fac609abb80a83"}
Jul 09 14:23:26.330427 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.329728    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"680e4740-9071-46c1-b59d-fbfebacfb397","Type":"ContainerDied","Data":"21acd445c2f005607f2e2f6c5dee2eb27783b7b4006103ac1c400af122fc10a7"}
Jul 09 14:23:26.330427 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.329758    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"680e4740-9071-46c1-b59d-fbfebacfb397","Type":"ContainerDied","Data":"5daa2317f761ca0e23dd1afb0078ca10de02f4b1cb72f74a6417c3397343670a"}
Jul 09 14:23:26.330427 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.329795    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"680e4740-9071-46c1-b59d-fbfebacfb397","Type":"ContainerDied","Data":"297ca35ca74fb53becae29552790cb6e0aefbbcc56ec0db8f893e4cf6662378d"}
Jul 09 14:23:26.370592 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.370543    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:26.469062 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469035    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.469062 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469064    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.469302 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469089    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-tls\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.469302 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469111    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-kubelet-serving-ca-bundle\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.469302 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469244    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-kube-rbac-proxy\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.469302 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469281    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-trusted-ca-bundle\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.469527 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469309    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-metrics-client-certs\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.469527 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469345    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-serving-certs-ca-bundle\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.469527 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469373    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/680e4740-9071-46c1-b59d-fbfebacfb397-config-out\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.469527 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469404    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-1\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.469527 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469438    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-0\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.469527 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469463    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-thanos-prometheus-http-client-file\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.469527 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469493    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-db\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.469527 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469517    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/680e4740-9071-46c1-b59d-fbfebacfb397-tls-assets\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.469527 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469518    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:23:26.470162 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469562    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-web-config\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.470162 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469604    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-config\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.470162 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469634    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-metrics-client-ca\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.470162 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469656    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdnx8\" (UniqueName: \"kubernetes.io/projected/680e4740-9071-46c1-b59d-fbfebacfb397-kube-api-access-bdnx8\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.470162 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469685    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-grpc-tls\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.470162 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469723    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-2\") pod \"680e4740-9071-46c1-b59d-fbfebacfb397\" (UID: \"680e4740-9071-46c1-b59d-fbfebacfb397\") "
Jul 09 14:23:26.470162 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.469959    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:23:26.470507 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.470313    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:23:26.470507 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.470370    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.470507 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.470393    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.470650 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.470582    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:23:26.472610 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.470870    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:23:26.472610 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.470951    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:23:26.472610 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.472173    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:23:26.473064 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.473027    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:23:26.473492 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.473454    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/680e4740-9071-46c1-b59d-fbfebacfb397-config-out" (OuterVolumeSpecName: "config-out") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:23:26.473707 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.473616    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/680e4740-9071-46c1-b59d-fbfebacfb397-kube-api-access-bdnx8" (OuterVolumeSpecName: "kube-api-access-bdnx8") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "kube-api-access-bdnx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:23:26.473707 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.473675    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:23:26.474112 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.474088    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-config" (OuterVolumeSpecName: "config") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:23:26.474363 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.474328    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:23:26.474452 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.474418    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:23:26.474522 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.474502    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:23:26.475361 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.475338    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:23:26.475475 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.475457    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:23:26.475525 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.475472    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/680e4740-9071-46c1-b59d-fbfebacfb397-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:23:26.476066 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.476043    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:23:26.484182 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.484151    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-web-config" (OuterVolumeSpecName: "web-config") pod "680e4740-9071-46c1-b59d-fbfebacfb397" (UID: "680e4740-9071-46c1-b59d-fbfebacfb397"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:23:26.571110 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571078    2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-metrics-client-certs\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571110 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571103    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571110 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571115    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/680e4740-9071-46c1-b59d-fbfebacfb397-config-out\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571125    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571133    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571145    2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571153    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-db\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571161    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/680e4740-9071-46c1-b59d-fbfebacfb397-tls-assets\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571168    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-web-config\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571176    2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-config\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571182    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-configmap-metrics-client-ca\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571190    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdnx8\" (UniqueName: \"kubernetes.io/projected/680e4740-9071-46c1-b59d-fbfebacfb397-kube-api-access-bdnx8\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571199    2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-grpc-tls\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571208    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/680e4740-9071-46c1-b59d-fbfebacfb397-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571216    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571224    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571233    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:26.571326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:26.571241    2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/680e4740-9071-46c1-b59d-fbfebacfb397-secret-kube-rbac-proxy\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:23:27.336904 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.336819    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"680e4740-9071-46c1-b59d-fbfebacfb397","Type":"ContainerDied","Data":"d2d424cf429e709dad88ce2f82c01fa5d73293d7a049a9fc406339bd8f9cf2e2"}
Jul 09 14:23:27.336904 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.336865    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.337380 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.336925    2563 scope.go:117] "RemoveContainer" containerID="389e3f0514cd4be0b460246a35aea6cf6e987bcc887b7300bab36cf430d39bd9"
Jul 09 14:23:27.344827 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.344659    2563 scope.go:117] "RemoveContainer" containerID="daff7ee74aa53739810f80cec75069f8a42085d5feb9d2bd629f5fa66643d3e3"
Jul 09 14:23:27.352968 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.352949    2563 scope.go:117] "RemoveContainer" containerID="01a2dd42474e2f91d192fb403987c6909fdcfb46d7a6e8bb33fac609abb80a83"
Jul 09 14:23:27.359841 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.359824    2563 scope.go:117] "RemoveContainer" containerID="21acd445c2f005607f2e2f6c5dee2eb27783b7b4006103ac1c400af122fc10a7"
Jul 09 14:23:27.366382 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.366365    2563 scope.go:117] "RemoveContainer" containerID="5daa2317f761ca0e23dd1afb0078ca10de02f4b1cb72f74a6417c3397343670a"
Jul 09 14:23:27.374987 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.374965    2563 scope.go:117] "RemoveContainer" containerID="297ca35ca74fb53becae29552790cb6e0aefbbcc56ec0db8f893e4cf6662378d"
Jul 09 14:23:27.375175 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.375154    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:23:27.380632 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.380611    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:23:27.383742 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.383727    2563 scope.go:117] "RemoveContainer" containerID="bd738dcd913562978e9ea13e32d01503f60ea69763de14a92654309a00a1262a"
Jul 09 14:23:27.415861 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.415838    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:23:27.416170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416158    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="init-config-reloader"
Jul 09 14:23:27.416206 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416172    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="init-config-reloader"
Jul 09 14:23:27.416206 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416182    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="kube-rbac-proxy-thanos"
Jul 09 14:23:27.416206 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416191    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="kube-rbac-proxy-thanos"
Jul 09 14:23:27.416206 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416205    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="config-reloader"
Jul 09 14:23:27.416322 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416210    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="config-reloader"
Jul 09 14:23:27.416322 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416220    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="kube-rbac-proxy-web"
Jul 09 14:23:27.416322 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416225    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="kube-rbac-proxy-web"
Jul 09 14:23:27.416322 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416231    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="kube-rbac-proxy"
Jul 09 14:23:27.416322 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416236    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="kube-rbac-proxy"
Jul 09 14:23:27.416322 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416249    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="thanos-sidecar"
Jul 09 14:23:27.416322 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416254    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="thanos-sidecar"
Jul 09 14:23:27.416322 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416263    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="prometheus"
Jul 09 14:23:27.416322 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416271    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="prometheus"
Jul 09 14:23:27.416322 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416320    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="thanos-sidecar"
Jul 09 14:23:27.416625 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416328    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="kube-rbac-proxy-web"
Jul 09 14:23:27.416625 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416334    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="kube-rbac-proxy"
Jul 09 14:23:27.416625 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416339    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="prometheus"
Jul 09 14:23:27.416625 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416344    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="kube-rbac-proxy-thanos"
Jul 09 14:23:27.416625 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.416350    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" containerName="config-reloader"
Jul 09 14:23:27.421415 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.421393    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.426294 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.426275    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 14:23:27.426433 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.426405    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 14:23:27.427062 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.427043    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7z7s8\""
Jul 09 14:23:27.427129 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.427073    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 14:23:27.427129 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.427109    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 14:23:27.427386 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.427369    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 14:23:27.427436 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.427415    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 14:23:27.430479 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.430379    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 14:23:27.430657 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.430641    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 14:23:27.430863 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.430850    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-etn4ompkk4mj9\""
Jul 09 14:23:27.431016 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.431000    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 14:23:27.431064 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.431039    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 14:23:27.431064 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.431046    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 14:23:27.431169 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.431004    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 14:23:27.432452 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.432435    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 14:23:27.434986 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.434969    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 14:23:27.448811 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.448780    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:23:27.478723 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.478696    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.478723 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.478725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.478902 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.478745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.478902 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.478769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfef937c-1f64-4c12-90c3-d3d48217a818-config-out\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.478902 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.478827    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.479039 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.478922    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.479039 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.478963    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.479039 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.479024    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.479188 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.479043    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.479188 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.479093    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.479188 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.479125    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.479188 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.479154    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.479324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.479190    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.479324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.479218    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x6zx\" (UniqueName: \"kubernetes.io/projected/cfef937c-1f64-4c12-90c3-d3d48217a818-kube-api-access-8x6zx\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.479324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.479253    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfef937c-1f64-4c12-90c3-d3d48217a818-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.479324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.479279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.479324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.479295    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.479324 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.479310    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cfef937c-1f64-4c12-90c3-d3d48217a818-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.479542 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.479329    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-config\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.479542 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.479343    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-web-config\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.579962 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.579920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.579962 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.579968    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580209 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580209 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580170    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580354 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580487 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580487 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x6zx\" (UniqueName: \"kubernetes.io/projected/cfef937c-1f64-4c12-90c3-d3d48217a818-kube-api-access-8x6zx\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580487 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580435    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfef937c-1f64-4c12-90c3-d3d48217a818-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580487 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580707 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580707 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cfef937c-1f64-4c12-90c3-d3d48217a818-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580707 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580542    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-config\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580707 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-web-config\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580707 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580707 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580707 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580707 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580646    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfef937c-1f64-4c12-90c3-d3d48217a818-config-out\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580707 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580707 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580682    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.580707 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580706    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.581230 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580718    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.581230 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.580955    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.581340 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.581258    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.581340 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.581281    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.582627 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.581543    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cfef937c-1f64-4c12-90c3-d3d48217a818-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.582627 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.582288    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.582943 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.582916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.583709 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.583665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.584682 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.584187    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.584682 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.584391    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.584682 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.584647    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.585006 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.584982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cfef937c-1f64-4c12-90c3-d3d48217a818-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.585670 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.585650    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-web-config\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.586055 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.586034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.586219 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.586109    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.586890 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.586832    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.587192 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.587140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfef937c-1f64-4c12-90c3-d3d48217a818-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.587397 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.587376    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cfef937c-1f64-4c12-90c3-d3d48217a818-config\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.587556 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.587537    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfef937c-1f64-4c12-90c3-d3d48217a818-config-out\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.591750 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.591729    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x6zx\" (UniqueName: \"kubernetes.io/projected/cfef937c-1f64-4c12-90c3-d3d48217a818-kube-api-access-8x6zx\") pod \"prometheus-k8s-0\" (UID: \"cfef937c-1f64-4c12-90c3-d3d48217a818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.734085 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.734057    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:27.885631 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:27.885597    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:23:27.887582 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:23:27.887556    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfef937c_1f64_4c12_90c3_d3d48217a818.slice/crio-13965f7414b47e02ae0ac62148a6f7564c1e0b12fd3e67e2a1d536ef940acc20 WatchSource:0}: Error finding container 13965f7414b47e02ae0ac62148a6f7564c1e0b12fd3e67e2a1d536ef940acc20: Status 404 returned error can't find the container with id 13965f7414b47e02ae0ac62148a6f7564c1e0b12fd3e67e2a1d536ef940acc20
Jul 09 14:23:28.343347 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:28.343308    2563 generic.go:356] "Generic (PLEG): container finished" podID="cfef937c-1f64-4c12-90c3-d3d48217a818" containerID="da447323055971c55ed0fe8587aabe1024e381f9108ecb4407057c248bf5e689" exitCode=0
Jul 09 14:23:28.343867 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:28.343485    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef937c-1f64-4c12-90c3-d3d48217a818","Type":"ContainerDied","Data":"da447323055971c55ed0fe8587aabe1024e381f9108ecb4407057c248bf5e689"}
Jul 09 14:23:28.343867 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:28.343564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef937c-1f64-4c12-90c3-d3d48217a818","Type":"ContainerStarted","Data":"13965f7414b47e02ae0ac62148a6f7564c1e0b12fd3e67e2a1d536ef940acc20"}
Jul 09 14:23:28.460392 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:28.460355    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="680e4740-9071-46c1-b59d-fbfebacfb397" path="/var/lib/kubelet/pods/680e4740-9071-46c1-b59d-fbfebacfb397/volumes"
Jul 09 14:23:29.351058 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:29.351016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4" event={"ID":"df5d743a-8637-4223-9b54-800c6ea97956","Type":"ContainerStarted","Data":"750187b9339ef3eb66277012899694a27da7663e7933b66e7c8f4536d208f904"}
Jul 09 14:23:29.351456 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:29.351080    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4" event={"ID":"df5d743a-8637-4223-9b54-800c6ea97956","Type":"ContainerStarted","Data":"b8c9d186897babcbf6f478c809d8b05dd9760a3b019b3042f7f7cb4f4eff6954"}
Jul 09 14:23:29.351456 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:29.351110    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4" event={"ID":"df5d743a-8637-4223-9b54-800c6ea97956","Type":"ContainerStarted","Data":"bf14991261e4fdfebc38a3bea71d77c6568379639f303cd6c1c3e19334ed6d24"}
Jul 09 14:23:29.357178 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:29.357151    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef937c-1f64-4c12-90c3-d3d48217a818","Type":"ContainerStarted","Data":"0b9d57a6fef0ab6ebc34e42ca61d649528b0f40a7ce88ea36d732a5bc32185a3"}
Jul 09 14:23:29.357321 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:29.357209    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef937c-1f64-4c12-90c3-d3d48217a818","Type":"ContainerStarted","Data":"c3518cf79d34fe59110e4d77be7f49be419cc08c6e3a63eaa2038cdc57767656"}
Jul 09 14:23:29.357321 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:29.357235    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef937c-1f64-4c12-90c3-d3d48217a818","Type":"ContainerStarted","Data":"f1f235bd9957f23c8372531e75c8dd4084babcb47bcbe36b40b457c8b55a8c14"}
Jul 09 14:23:29.357321 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:29.357258    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef937c-1f64-4c12-90c3-d3d48217a818","Type":"ContainerStarted","Data":"69c5d9ad242b8a541c3be6b0eeb0b4d914111081741c0d90b4d4155c23c74d31"}
Jul 09 14:23:29.357321 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:29.357282    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef937c-1f64-4c12-90c3-d3d48217a818","Type":"ContainerStarted","Data":"a46042c71640f0a47f1ba40b2cb8fdd6dd34976d2c04d94c5fae44d09911a39c"}
Jul 09 14:23:29.357321 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:29.357307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfef937c-1f64-4c12-90c3-d3d48217a818","Type":"ContainerStarted","Data":"179cd2eed93e5528224c5419a22c55fff9b3b081e14a3c6da8a8fd86e2d46976"}
Jul 09 14:23:29.375694 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:29.375645    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5445c9b998-cxks4" podStartSLOduration=1.968006608 podStartE2EDuration="4.375629905s" totalImagesPullingTime="2.407623297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:23:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:23:29.374505979 +0000 UTC m=+153.401600567" watchObservedRunningTime="2026-07-09 14:23:29.375629905 +0000 UTC m=+153.402724343"
Jul 09 14:23:29.409402 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:29.409331    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.383669921 podStartE2EDuration="2.409310434s" totalImagesPullingTime="0s" totalInitContainerRuntime="25.640513ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:23:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:23:29.40822046 +0000 UTC m=+153.435314862" watchObservedRunningTime="2026-07-09 14:23:29.409310434 +0000 UTC m=+153.436404817"
Jul 09 14:23:30.686229 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:30.686188    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:23:30.823850 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:30.823796    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:23:31.003716 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:31.003683    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:23:31.423120 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:31.423007    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:23:31.524242 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:31.524202    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:23:32.734344 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:32.734303    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:23:41.710092 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:41.710042    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:23:41.808918 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:23:41.808887    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:24:06.266706 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:24:06.266670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:24:06.324859 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:24:06.324790    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:24:19.322713 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:24:19.322678    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:24:23.046574 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:24:23.046536    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:24:27.734468 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:24:27.734439    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:24:27.749750 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:24:27.749722    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:24:28.604853 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:24:28.604826    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:24:35.960538 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:24:35.960504    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:24:36.061062 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:24:36.061011    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:24:42.126462 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:24:42.126421    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:24:47.929272 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:24:47.929234    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:24:48.031701 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:24:48.031650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:24:56.026565 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:24:56.026503    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:24:56.127984 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:24:56.127950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:24:58.213480 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:24:58.213447    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:24:58.314364 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:24:58.314311    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:25:06.961143 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:25:06.961104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:25:07.022262 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:25:07.022228    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:25:07.211647 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:25:07.211555    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:25:56.302890 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:25:56.302853    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:25:56.305250 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:25:56.305228    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 14:25:56.307270 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:25:56.307251    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:26:01.865951 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:01.865916    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:03.303719 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:03.303687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:28.649946 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:28.649909    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:29.452501 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:29.452469    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:32.675962 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:32.675920    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:32.778327 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:32.778291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:34.660902 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:34.660863    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:34.840626 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:34.840582    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:34.995475 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:34.995436    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:37.071215 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.071177    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:37.459486 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.459460    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gcz7w"]
Jul 09 14:26:37.462540 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.462525    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gcz7w"
Jul 09 14:26:37.465473 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.465453    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mnm55\""
Jul 09 14:26:37.465592 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.465453    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 14:26:37.466380 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.466362    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 14:26:37.473111 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.473089    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gcz7w"]
Jul 09 14:26:37.485907 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.485887    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:37.549394 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.549370    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31c52f8c-03b5-48f3-b9a9-287271f18421-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gcz7w\" (UID: \"31c52f8c-03b5-48f3-b9a9-287271f18421\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gcz7w"
Jul 09 14:26:37.549523 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.549504    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qlxc\" (UniqueName: \"kubernetes.io/projected/31c52f8c-03b5-48f3-b9a9-287271f18421-kube-api-access-7qlxc\") pod \"cert-manager-cainjector-559cdd8c87-gcz7w\" (UID: \"31c52f8c-03b5-48f3-b9a9-287271f18421\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gcz7w"
Jul 09 14:26:37.650397 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.650372    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qlxc\" (UniqueName: \"kubernetes.io/projected/31c52f8c-03b5-48f3-b9a9-287271f18421-kube-api-access-7qlxc\") pod \"cert-manager-cainjector-559cdd8c87-gcz7w\" (UID: \"31c52f8c-03b5-48f3-b9a9-287271f18421\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gcz7w"
Jul 09 14:26:37.650536 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.650431    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31c52f8c-03b5-48f3-b9a9-287271f18421-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gcz7w\" (UID: \"31c52f8c-03b5-48f3-b9a9-287271f18421\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gcz7w"
Jul 09 14:26:37.658598 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.658574    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31c52f8c-03b5-48f3-b9a9-287271f18421-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gcz7w\" (UID: \"31c52f8c-03b5-48f3-b9a9-287271f18421\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gcz7w"
Jul 09 14:26:37.658701 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.658656    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qlxc\" (UniqueName: \"kubernetes.io/projected/31c52f8c-03b5-48f3-b9a9-287271f18421-kube-api-access-7qlxc\") pod \"cert-manager-cainjector-559cdd8c87-gcz7w\" (UID: \"31c52f8c-03b5-48f3-b9a9-287271f18421\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gcz7w"
Jul 09 14:26:37.778113 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.778038    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gcz7w"
Jul 09 14:26:37.909743 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.909710    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gcz7w"]
Jul 09 14:26:37.911903 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:26:37.911874    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31c52f8c_03b5_48f3_b9a9_287271f18421.slice/crio-2f02a9ed46ec941725b7dba707351c58fcfe4ad10a38f4f7c58cd63fed1c790a WatchSource:0}: Error finding container 2f02a9ed46ec941725b7dba707351c58fcfe4ad10a38f4f7c58cd63fed1c790a: Status 404 returned error can't find the container with id 2f02a9ed46ec941725b7dba707351c58fcfe4ad10a38f4f7c58cd63fed1c790a
Jul 09 14:26:37.913834 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:37.913794    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 14:26:38.093772 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:38.093687    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gcz7w" event={"ID":"31c52f8c-03b5-48f3-b9a9-287271f18421","Type":"ContainerStarted","Data":"2f02a9ed46ec941725b7dba707351c58fcfe4ad10a38f4f7c58cd63fed1c790a"}
Jul 09 14:26:39.254859 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:39.254819    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:39.355705 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:39.355666    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:39.820070 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:39.820035    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:41.113193 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:41.113159    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gcz7w" event={"ID":"31c52f8c-03b5-48f3-b9a9-287271f18421","Type":"ContainerStarted","Data":"7fd5f5c16e467dc9054749d0bea207e17be3710a076c37439c133c49fdca3249"}
Jul 09 14:26:41.130717 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:41.130670    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gcz7w" podStartSLOduration=1.028409184 podStartE2EDuration="4.130655034s" totalImagesPullingTime="3.10224585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:26:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:26:41.128907987 +0000 UTC m=+345.156002380" watchObservedRunningTime="2026-07-09 14:26:41.130655034 +0000 UTC m=+345.157749415"
Jul 09 14:26:45.149344 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:45.149314    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:46.702339 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:46.702306    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9knt9"]
Jul 09 14:26:46.705755 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:46.705736    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9knt9"
Jul 09 14:26:46.707943 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:46.707926    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-glw9n\""
Jul 09 14:26:46.714913 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:46.714893    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9knt9"]
Jul 09 14:26:46.825955 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:46.825925    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqtgb\" (UniqueName: \"kubernetes.io/projected/4d2bac25-8134-4281-86eb-ed1814d14bfb-kube-api-access-kqtgb\") pod \"cert-manager-55b4d954d5-9knt9\" (UID: \"4d2bac25-8134-4281-86eb-ed1814d14bfb\") " pod="cert-manager/cert-manager-55b4d954d5-9knt9"
Jul 09 14:26:46.826093 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:46.825968    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d2bac25-8134-4281-86eb-ed1814d14bfb-bound-sa-token\") pod \"cert-manager-55b4d954d5-9knt9\" (UID: \"4d2bac25-8134-4281-86eb-ed1814d14bfb\") " pod="cert-manager/cert-manager-55b4d954d5-9knt9"
Jul 09 14:26:46.927183 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:46.927150    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqtgb\" (UniqueName: \"kubernetes.io/projected/4d2bac25-8134-4281-86eb-ed1814d14bfb-kube-api-access-kqtgb\") pod \"cert-manager-55b4d954d5-9knt9\" (UID: \"4d2bac25-8134-4281-86eb-ed1814d14bfb\") " pod="cert-manager/cert-manager-55b4d954d5-9knt9"
Jul 09 14:26:46.927323 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:46.927193    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d2bac25-8134-4281-86eb-ed1814d14bfb-bound-sa-token\") pod \"cert-manager-55b4d954d5-9knt9\" (UID: \"4d2bac25-8134-4281-86eb-ed1814d14bfb\") " pod="cert-manager/cert-manager-55b4d954d5-9knt9"
Jul 09 14:26:46.936612 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:46.936581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d2bac25-8134-4281-86eb-ed1814d14bfb-bound-sa-token\") pod \"cert-manager-55b4d954d5-9knt9\" (UID: \"4d2bac25-8134-4281-86eb-ed1814d14bfb\") " pod="cert-manager/cert-manager-55b4d954d5-9knt9"
Jul 09 14:26:46.936714 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:46.936629    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqtgb\" (UniqueName: \"kubernetes.io/projected/4d2bac25-8134-4281-86eb-ed1814d14bfb-kube-api-access-kqtgb\") pod \"cert-manager-55b4d954d5-9knt9\" (UID: \"4d2bac25-8134-4281-86eb-ed1814d14bfb\") " pod="cert-manager/cert-manager-55b4d954d5-9knt9"
Jul 09 14:26:47.015322 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:47.015257    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9knt9"
Jul 09 14:26:47.171569 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:47.171536    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9knt9"]
Jul 09 14:26:47.174627 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:26:47.174601    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d2bac25_8134_4281_86eb_ed1814d14bfb.slice/crio-4126b19eff393da77001367a6eb511368dfb08223d80bed07adc264d8dad999e WatchSource:0}: Error finding container 4126b19eff393da77001367a6eb511368dfb08223d80bed07adc264d8dad999e: Status 404 returned error can't find the container with id 4126b19eff393da77001367a6eb511368dfb08223d80bed07adc264d8dad999e
Jul 09 14:26:48.144775 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:48.144745    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9knt9" event={"ID":"4d2bac25-8134-4281-86eb-ed1814d14bfb","Type":"ContainerStarted","Data":"9c10acf3d9c6f336e9b05d803307880503712aea86e0c53f677b482e7d0ad246"}
Jul 09 14:26:48.144775 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:48.144782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9knt9" event={"ID":"4d2bac25-8134-4281-86eb-ed1814d14bfb","Type":"ContainerStarted","Data":"4126b19eff393da77001367a6eb511368dfb08223d80bed07adc264d8dad999e"}
Jul 09 14:26:48.162294 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:48.162245    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9knt9" podStartSLOduration=2.162230572 podStartE2EDuration="2.162230572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:26:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:26:48.162129704 +0000 UTC m=+352.189224084" watchObservedRunningTime="2026-07-09 14:26:48.162230572 +0000 UTC m=+352.189324953"
Jul 09 14:26:49.476946 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:49.476907    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:49.577905 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:49.577862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:56.948423 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:56.948381    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:57.041908 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:57.041870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:26:59.068549 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:26:59.068511    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:01.801261 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:01.801224    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:01.868264 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:01.868210    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:13.492737 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:13.492697    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:13.583854 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:13.583820    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:14.083753 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.083698    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:14.355491 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.355411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:14.456654 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.456616    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:14.505098 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.505055    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"]
Jul 09 14:27:14.550480 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.550443    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"]
Jul 09 14:27:14.550641 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.550544    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.553229 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.553209    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 14:27:14.553362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.553261    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 14:27:14.553427 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.553388    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fdgwt\""
Jul 09 14:27:14.553427 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.553413    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 14:27:14.553526 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.553460    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 14:27:14.566308 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.566279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h7kg\" (UniqueName: \"kubernetes.io/projected/cad06a14-7315-4ad8-9e44-f8beaf5d52de-kube-api-access-6h7kg\") pod \"opendatahub-operator-controller-manager-c7757d956-r6vtl\" (UID: \"cad06a14-7315-4ad8-9e44-f8beaf5d52de\") " pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.566396 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.566314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cad06a14-7315-4ad8-9e44-f8beaf5d52de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c7757d956-r6vtl\" (UID: \"cad06a14-7315-4ad8-9e44-f8beaf5d52de\") " pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.566396 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.566376    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cad06a14-7315-4ad8-9e44-f8beaf5d52de-webhook-cert\") pod \"opendatahub-operator-controller-manager-c7757d956-r6vtl\" (UID: \"cad06a14-7315-4ad8-9e44-f8beaf5d52de\") " pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.566465 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.566403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cad06a14-7315-4ad8-9e44-f8beaf5d52de-tmp\") pod \"opendatahub-operator-controller-manager-c7757d956-r6vtl\" (UID: \"cad06a14-7315-4ad8-9e44-f8beaf5d52de\") " pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.566505 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.566463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cad06a14-7315-4ad8-9e44-f8beaf5d52de-manifests\") pod \"opendatahub-operator-controller-manager-c7757d956-r6vtl\" (UID: \"cad06a14-7315-4ad8-9e44-f8beaf5d52de\") " pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.613050 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.612964    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:14.667774 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.667749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cad06a14-7315-4ad8-9e44-f8beaf5d52de-manifests\") pod \"opendatahub-operator-controller-manager-c7757d956-r6vtl\" (UID: \"cad06a14-7315-4ad8-9e44-f8beaf5d52de\") " pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.667904 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.667778    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h7kg\" (UniqueName: \"kubernetes.io/projected/cad06a14-7315-4ad8-9e44-f8beaf5d52de-kube-api-access-6h7kg\") pod \"opendatahub-operator-controller-manager-c7757d956-r6vtl\" (UID: \"cad06a14-7315-4ad8-9e44-f8beaf5d52de\") " pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.667904 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.667823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cad06a14-7315-4ad8-9e44-f8beaf5d52de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c7757d956-r6vtl\" (UID: \"cad06a14-7315-4ad8-9e44-f8beaf5d52de\") " pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.667904 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.667858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cad06a14-7315-4ad8-9e44-f8beaf5d52de-webhook-cert\") pod \"opendatahub-operator-controller-manager-c7757d956-r6vtl\" (UID: \"cad06a14-7315-4ad8-9e44-f8beaf5d52de\") " pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.667904 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.667887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cad06a14-7315-4ad8-9e44-f8beaf5d52de-tmp\") pod \"opendatahub-operator-controller-manager-c7757d956-r6vtl\" (UID: \"cad06a14-7315-4ad8-9e44-f8beaf5d52de\") " pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.668199 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.668178    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cad06a14-7315-4ad8-9e44-f8beaf5d52de-manifests\") pod \"opendatahub-operator-controller-manager-c7757d956-r6vtl\" (UID: \"cad06a14-7315-4ad8-9e44-f8beaf5d52de\") " pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.670394 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.670368    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cad06a14-7315-4ad8-9e44-f8beaf5d52de-tmp\") pod \"opendatahub-operator-controller-manager-c7757d956-r6vtl\" (UID: \"cad06a14-7315-4ad8-9e44-f8beaf5d52de\") " pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.670497 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.670473    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cad06a14-7315-4ad8-9e44-f8beaf5d52de-webhook-cert\") pod \"opendatahub-operator-controller-manager-c7757d956-r6vtl\" (UID: \"cad06a14-7315-4ad8-9e44-f8beaf5d52de\") " pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.670566 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.670552    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cad06a14-7315-4ad8-9e44-f8beaf5d52de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c7757d956-r6vtl\" (UID: \"cad06a14-7315-4ad8-9e44-f8beaf5d52de\") " pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.676267 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.676246    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h7kg\" (UniqueName: \"kubernetes.io/projected/cad06a14-7315-4ad8-9e44-f8beaf5d52de-kube-api-access-6h7kg\") pod \"opendatahub-operator-controller-manager-c7757d956-r6vtl\" (UID: \"cad06a14-7315-4ad8-9e44-f8beaf5d52de\") " pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.722952 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.722921    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:14.813596 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.813561    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:14.861586 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.861559    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:14.914543 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:14.914511    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:15.069180 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:15.069146    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"]
Jul 09 14:27:15.073870 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:27:15.073839    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad06a14_7315_4ad8_9e44_f8beaf5d52de.slice/crio-e859c73d8df81b209c0e74518f87ec24daeb3069a693d6646a715feebb69870a WatchSource:0}: Error finding container e859c73d8df81b209c0e74518f87ec24daeb3069a693d6646a715feebb69870a: Status 404 returned error can't find the container with id e859c73d8df81b209c0e74518f87ec24daeb3069a693d6646a715feebb69870a
Jul 09 14:27:15.074099 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:15.074066    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:15.254071 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:15.254039    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl" event={"ID":"cad06a14-7315-4ad8-9e44-f8beaf5d52de","Type":"ContainerStarted","Data":"e859c73d8df81b209c0e74518f87ec24daeb3069a693d6646a715feebb69870a"}
Jul 09 14:27:19.280546 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:19.280507    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl" event={"ID":"cad06a14-7315-4ad8-9e44-f8beaf5d52de","Type":"ContainerStarted","Data":"005f32bc8949a0ec53b7019be9200e99c3e08493952fceb87f65395e0d5b07b3"}
Jul 09 14:27:19.378680 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:19.378649    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:19.476684 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:19.476648    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:20.286601 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:20.286570    2563 generic.go:356] "Generic (PLEG): container finished" podID="cad06a14-7315-4ad8-9e44-f8beaf5d52de" containerID="005f32bc8949a0ec53b7019be9200e99c3e08493952fceb87f65395e0d5b07b3" exitCode=0
Jul 09 14:27:20.286986 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:20.286653    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl" event={"ID":"cad06a14-7315-4ad8-9e44-f8beaf5d52de","Type":"ContainerDied","Data":"005f32bc8949a0ec53b7019be9200e99c3e08493952fceb87f65395e0d5b07b3"}
Jul 09 14:27:21.292946 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:21.292903    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl" event={"ID":"cad06a14-7315-4ad8-9e44-f8beaf5d52de","Type":"ContainerStarted","Data":"9f02ab073ebf9d64465599c35dde88e45c698c230fd9791a84746d03366f3640"}
Jul 09 14:27:21.293395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:21.293017    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:21.314404 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:21.314352    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl" podStartSLOduration=2.556317633 podStartE2EDuration="7.314339398s" totalImagesPullingTime="3.694235886s" totalInitContainerRuntime="1.063785879s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:27:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:27:21.314291399 +0000 UTC m=+385.341385795" watchObservedRunningTime="2026-07-09 14:27:21.314339398 +0000 UTC m=+385.341433778"
Jul 09 14:27:31.792099 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:31.792069    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"]
Jul 09 14:27:31.800174 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:31.800156    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"
Jul 09 14:27:31.804584 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:31.804561    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 14:27:31.804707 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:31.804567    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 14:27:31.805019 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:31.804996    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 14:27:31.805151 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:31.804984    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 14:27:31.805151 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:31.805031    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7ktkf\""
Jul 09 14:27:31.807036 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:31.807019    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 14:27:31.808440 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:31.808420    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"]
Jul 09 14:27:31.924749 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:31.924714    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a795d76-3d08-48a2-9253-20ce9c9606a2-cert\") pod \"lws-controller-manager-7988959d95-b7jk9\" (UID: \"3a795d76-3d08-48a2-9253-20ce9c9606a2\") " pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"
Jul 09 14:27:31.924930 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:31.924754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a795d76-3d08-48a2-9253-20ce9c9606a2-metrics-cert\") pod \"lws-controller-manager-7988959d95-b7jk9\" (UID: \"3a795d76-3d08-48a2-9253-20ce9c9606a2\") " pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"
Jul 09 14:27:31.924930 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:31.924785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3a795d76-3d08-48a2-9253-20ce9c9606a2-manager-config\") pod \"lws-controller-manager-7988959d95-b7jk9\" (UID: \"3a795d76-3d08-48a2-9253-20ce9c9606a2\") " pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"
Jul 09 14:27:31.924930 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:31.924892    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhgvs\" (UniqueName: \"kubernetes.io/projected/3a795d76-3d08-48a2-9253-20ce9c9606a2-kube-api-access-nhgvs\") pod \"lws-controller-manager-7988959d95-b7jk9\" (UID: \"3a795d76-3d08-48a2-9253-20ce9c9606a2\") " pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"
Jul 09 14:27:32.025667 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:32.025636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a795d76-3d08-48a2-9253-20ce9c9606a2-cert\") pod \"lws-controller-manager-7988959d95-b7jk9\" (UID: \"3a795d76-3d08-48a2-9253-20ce9c9606a2\") " pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"
Jul 09 14:27:32.025667 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:32.025670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a795d76-3d08-48a2-9253-20ce9c9606a2-metrics-cert\") pod \"lws-controller-manager-7988959d95-b7jk9\" (UID: \"3a795d76-3d08-48a2-9253-20ce9c9606a2\") " pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"
Jul 09 14:27:32.026005 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:32.025691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3a795d76-3d08-48a2-9253-20ce9c9606a2-manager-config\") pod \"lws-controller-manager-7988959d95-b7jk9\" (UID: \"3a795d76-3d08-48a2-9253-20ce9c9606a2\") " pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"
Jul 09 14:27:32.026005 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:32.025839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhgvs\" (UniqueName: \"kubernetes.io/projected/3a795d76-3d08-48a2-9253-20ce9c9606a2-kube-api-access-nhgvs\") pod \"lws-controller-manager-7988959d95-b7jk9\" (UID: \"3a795d76-3d08-48a2-9253-20ce9c9606a2\") " pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"
Jul 09 14:27:32.026487 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:32.026466    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3a795d76-3d08-48a2-9253-20ce9c9606a2-manager-config\") pod \"lws-controller-manager-7988959d95-b7jk9\" (UID: \"3a795d76-3d08-48a2-9253-20ce9c9606a2\") " pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"
Jul 09 14:27:32.028132 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:32.028116    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a795d76-3d08-48a2-9253-20ce9c9606a2-metrics-cert\") pod \"lws-controller-manager-7988959d95-b7jk9\" (UID: \"3a795d76-3d08-48a2-9253-20ce9c9606a2\") " pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"
Jul 09 14:27:32.028254 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:32.028237    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a795d76-3d08-48a2-9253-20ce9c9606a2-cert\") pod \"lws-controller-manager-7988959d95-b7jk9\" (UID: \"3a795d76-3d08-48a2-9253-20ce9c9606a2\") " pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"
Jul 09 14:27:32.036887 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:32.036866    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhgvs\" (UniqueName: \"kubernetes.io/projected/3a795d76-3d08-48a2-9253-20ce9c9606a2-kube-api-access-nhgvs\") pod \"lws-controller-manager-7988959d95-b7jk9\" (UID: \"3a795d76-3d08-48a2-9253-20ce9c9606a2\") " pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"
Jul 09 14:27:32.110553 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:32.110490    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"
Jul 09 14:27:32.240226 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:32.240199    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"]
Jul 09 14:27:32.242793 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:27:32.242765    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a795d76_3d08_48a2_9253_20ce9c9606a2.slice/crio-b08fef402d4a9a8ade3e0a01c0d09562ee7d354c4ed7b6419390bd5abc074205 WatchSource:0}: Error finding container b08fef402d4a9a8ade3e0a01c0d09562ee7d354c4ed7b6419390bd5abc074205: Status 404 returned error can't find the container with id b08fef402d4a9a8ade3e0a01c0d09562ee7d354c4ed7b6419390bd5abc074205
Jul 09 14:27:32.300521 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:32.300493    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c7757d956-r6vtl"
Jul 09 14:27:32.343208 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:32.343179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9" event={"ID":"3a795d76-3d08-48a2-9253-20ce9c9606a2","Type":"ContainerStarted","Data":"b08fef402d4a9a8ade3e0a01c0d09562ee7d354c4ed7b6419390bd5abc074205"}
Jul 09 14:27:33.949706 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:33.949671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:34.092186 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.092146    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:34.654669 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.654538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:34.776307 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.776277    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-77975789f4-n6vr6"]
Jul 09 14:27:34.779636 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.779618    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77975789f4-n6vr6"
Jul 09 14:27:34.782777 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.782755    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 14:27:34.783740 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.783723    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 14:27:34.783823 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.783736    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 14:27:34.783823 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.783737    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 14:27:34.784107 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.784092    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-r9h78\""
Jul 09 14:27:34.787877 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.787857    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77975789f4-n6vr6"]
Jul 09 14:27:34.849086 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.849053    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:34.853124 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.853102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/698a5cf2-8ed4-4a74-811e-a3da96df2688-tmp\") pod \"kube-auth-proxy-77975789f4-n6vr6\" (UID: \"698a5cf2-8ed4-4a74-811e-a3da96df2688\") " pod="openshift-ingress/kube-auth-proxy-77975789f4-n6vr6"
Jul 09 14:27:34.853240 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.853200    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk8cc\" (UniqueName: \"kubernetes.io/projected/698a5cf2-8ed4-4a74-811e-a3da96df2688-kube-api-access-vk8cc\") pod \"kube-auth-proxy-77975789f4-n6vr6\" (UID: \"698a5cf2-8ed4-4a74-811e-a3da96df2688\") " pod="openshift-ingress/kube-auth-proxy-77975789f4-n6vr6"
Jul 09 14:27:34.853240 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.853229    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/698a5cf2-8ed4-4a74-811e-a3da96df2688-tls-certs\") pod \"kube-auth-proxy-77975789f4-n6vr6\" (UID: \"698a5cf2-8ed4-4a74-811e-a3da96df2688\") " pod="openshift-ingress/kube-auth-proxy-77975789f4-n6vr6"
Jul 09 14:27:34.954063 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.953981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk8cc\" (UniqueName: \"kubernetes.io/projected/698a5cf2-8ed4-4a74-811e-a3da96df2688-kube-api-access-vk8cc\") pod \"kube-auth-proxy-77975789f4-n6vr6\" (UID: \"698a5cf2-8ed4-4a74-811e-a3da96df2688\") " pod="openshift-ingress/kube-auth-proxy-77975789f4-n6vr6"
Jul 09 14:27:34.954063 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.954029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/698a5cf2-8ed4-4a74-811e-a3da96df2688-tls-certs\") pod \"kube-auth-proxy-77975789f4-n6vr6\" (UID: \"698a5cf2-8ed4-4a74-811e-a3da96df2688\") " pod="openshift-ingress/kube-auth-proxy-77975789f4-n6vr6"
Jul 09 14:27:34.954508 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.954071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/698a5cf2-8ed4-4a74-811e-a3da96df2688-tmp\") pod \"kube-auth-proxy-77975789f4-n6vr6\" (UID: \"698a5cf2-8ed4-4a74-811e-a3da96df2688\") " pod="openshift-ingress/kube-auth-proxy-77975789f4-n6vr6"
Jul 09 14:27:34.956364 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.956345    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/698a5cf2-8ed4-4a74-811e-a3da96df2688-tmp\") pod \"kube-auth-proxy-77975789f4-n6vr6\" (UID: \"698a5cf2-8ed4-4a74-811e-a3da96df2688\") " pod="openshift-ingress/kube-auth-proxy-77975789f4-n6vr6"
Jul 09 14:27:34.956618 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.956602    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/698a5cf2-8ed4-4a74-811e-a3da96df2688-tls-certs\") pod \"kube-auth-proxy-77975789f4-n6vr6\" (UID: \"698a5cf2-8ed4-4a74-811e-a3da96df2688\") " pod="openshift-ingress/kube-auth-proxy-77975789f4-n6vr6"
Jul 09 14:27:34.966946 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:34.966924    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk8cc\" (UniqueName: \"kubernetes.io/projected/698a5cf2-8ed4-4a74-811e-a3da96df2688-kube-api-access-vk8cc\") pod \"kube-auth-proxy-77975789f4-n6vr6\" (UID: \"698a5cf2-8ed4-4a74-811e-a3da96df2688\") " pod="openshift-ingress/kube-auth-proxy-77975789f4-n6vr6"
Jul 09 14:27:35.017228 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:35.017186    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:35.090068 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:35.090037    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77975789f4-n6vr6"
Jul 09 14:27:35.118520 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:35.118471    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:35.238601 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:35.238560    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:35.243088 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:35.243069    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77975789f4-n6vr6"]
Jul 09 14:27:35.245752 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:27:35.245723    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod698a5cf2_8ed4_4a74_811e_a3da96df2688.slice/crio-e65a5a9fd849dbaf37080a74c12a9c7d7a535db23363868622b8f020f9713141 WatchSource:0}: Error finding container e65a5a9fd849dbaf37080a74c12a9c7d7a535db23363868622b8f020f9713141: Status 404 returned error can't find the container with id e65a5a9fd849dbaf37080a74c12a9c7d7a535db23363868622b8f020f9713141
Jul 09 14:27:35.330004 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:35.329936    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:35.359571 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:35.359536    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77975789f4-n6vr6" event={"ID":"698a5cf2-8ed4-4a74-811e-a3da96df2688","Type":"ContainerStarted","Data":"e65a5a9fd849dbaf37080a74c12a9c7d7a535db23363868622b8f020f9713141"}
Jul 09 14:27:35.361345 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:35.361309    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9" event={"ID":"3a795d76-3d08-48a2-9253-20ce9c9606a2","Type":"ContainerStarted","Data":"a4219c9e244cdb70288789ac8d074389e6f06586228c0743f19679eb93f63e9a"}
Jul 09 14:27:35.361461 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:35.361427    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"
Jul 09 14:27:35.382999 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:35.382954    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9" podStartSLOduration=1.9870118799999998 podStartE2EDuration="4.382938408s" totalImagesPullingTime="2.395926528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:27:35.381460008 +0000 UTC m=+399.408554389" watchObservedRunningTime="2026-07-09 14:27:35.382938408 +0000 UTC m=+399.410032788"
Jul 09 14:27:35.841867 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:35.841841    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:36.058293 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:36.058253    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:36.216663 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:36.216632    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:36.308401 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:36.308368    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:37.199043 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:37.199006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:39.381711 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:39.381677    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77975789f4-n6vr6" event={"ID":"698a5cf2-8ed4-4a74-811e-a3da96df2688","Type":"ContainerStarted","Data":"27eb23192ebb37cecc5612bf2e47ea2f49e793f0cc90d2d83236c42db72deae5"}
Jul 09 14:27:39.399555 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:39.399503    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-77975789f4-n6vr6" podStartSLOduration=2.163345811 podStartE2EDuration="5.399488764s" totalImagesPullingTime="3.236142953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:27:39.398562282 +0000 UTC m=+403.425656695" watchObservedRunningTime="2026-07-09 14:27:39.399488764 +0000 UTC m=+403.426583145"
Jul 09 14:27:42.513423 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:42.513384    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:42.616502 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:42.616462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:43.398264 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:43.398229    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:43.916210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:43.916179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:44.063079 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:44.063049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:46.368661 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:46.368633    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7988959d95-b7jk9"
Jul 09 14:27:46.814680 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:46.814634    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:46.951591 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:46.951548    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:47.094017 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:47.093930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:47.940212 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:47.940171    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:48.044252 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:48.044204    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:48.175622 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:48.175591    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:27:58.975986 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:27:58.975951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:28:03.618093 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:28:03.618064    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:28:03.686116 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:28:03.686085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:28:25.057702 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:28:25.057604    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:28:25.158521 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:28:25.158487    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:28:31.859552 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:28:31.859517    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:28:31.960029 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:28:31.959992    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:28:32.496776 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:28:32.496744    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:28:32.561020 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:28:32.560975    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:28:35.588349 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:28:35.588297    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:28:35.644247 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:28:35.644155    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:28:42.957464 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:28:42.957429    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:28:43.057657 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:28:43.057612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:28:43.157962 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:28:43.157930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:04.624495 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:04.624454    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:08.219440 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:08.219401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:10.301141 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:10.301102    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:10.463129 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:10.463093    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:11.267370 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:11.267341    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:12.809358 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:12.809316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:13.112696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:13.112614    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:13.747060 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:13.747024    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:15.886649 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:15.886599    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:16.003511 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:16.003478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:17.245076 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:17.245037    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:18.505904 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:18.505861    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:20.436435 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:20.436403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:20.537143 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:20.537116    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:23.424951 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:23.424913    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:23.809255 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:23.809220    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:24.220230 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:24.220201    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:24.320436 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:24.320401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:33.501494 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:33.501456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:33.613903 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:33.613860    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:36.451285 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:36.451243    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:36.547242 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:36.547208    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:39.033897 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:39.033853    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:39.143523 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:39.143482    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:42.836921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:42.836881    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:42.936433 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:42.936403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:52.424613 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:52.424532    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:52.489326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:52.489293    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:52.830409 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:52.830367    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:52.899590 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:52.899552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:54.764309 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:54.764278    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:54.864733 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:54.864704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:56.637199 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:56.637163    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:56.740221 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:56.740186    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:29:57.777297 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:29:57.777266    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:07.911032 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:07.910993    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:07.968444 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:07.968409    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:14.757062 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.757033    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"]
Jul 09 14:30:14.760490 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.760472    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.763192 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.763169    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 14:30:14.763290 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.763193    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rd5st\""
Jul 09 14:30:14.772042 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.772020    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"]
Jul 09 14:30:14.788943 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.788911    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76a0ea55-242c-483c-893a-259a723e16f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.789043 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.788949    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p228h\" (UniqueName: \"kubernetes.io/projected/76a0ea55-242c-483c-893a-259a723e16f9-kube-api-access-p228h\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.789043 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.788969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a0ea55-242c-483c-893a-259a723e16f9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.789043 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.789019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76a0ea55-242c-483c-893a-259a723e16f9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.789181 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.789055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76a0ea55-242c-483c-893a-259a723e16f9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.789181 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.789117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76a0ea55-242c-483c-893a-259a723e16f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.789181 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.789145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76a0ea55-242c-483c-893a-259a723e16f9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.789288 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.789232    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a0ea55-242c-483c-893a-259a723e16f9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.789288 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.789261    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76a0ea55-242c-483c-893a-259a723e16f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.800252 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.800223    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:14.890666 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.890631    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76a0ea55-242c-483c-893a-259a723e16f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.890849 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.890674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76a0ea55-242c-483c-893a-259a723e16f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.890849 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.890699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p228h\" (UniqueName: \"kubernetes.io/projected/76a0ea55-242c-483c-893a-259a723e16f9-kube-api-access-p228h\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.890849 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.890724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a0ea55-242c-483c-893a-259a723e16f9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.890849 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.890753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76a0ea55-242c-483c-893a-259a723e16f9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.890849 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.890782    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76a0ea55-242c-483c-893a-259a723e16f9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.890849 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.890844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76a0ea55-242c-483c-893a-259a723e16f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.891161 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.890874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76a0ea55-242c-483c-893a-259a723e16f9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.891161 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.890989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a0ea55-242c-483c-893a-259a723e16f9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.891271 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.891188    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a0ea55-242c-483c-893a-259a723e16f9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.891375 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.891352    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a0ea55-242c-483c-893a-259a723e16f9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.891629 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.891608    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76a0ea55-242c-483c-893a-259a723e16f9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.891673 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.891622    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76a0ea55-242c-483c-893a-259a723e16f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.891739 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.891720    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76a0ea55-242c-483c-893a-259a723e16f9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.893092 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.893065    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76a0ea55-242c-483c-893a-259a723e16f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.893283 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.893267    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76a0ea55-242c-483c-893a-259a723e16f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.899137 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.899113    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76a0ea55-242c-483c-893a-259a723e16f9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:14.900188 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:14.900167    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p228h\" (UniqueName: \"kubernetes.io/projected/76a0ea55-242c-483c-893a-259a723e16f9-kube-api-access-p228h\") pod \"maas-default-gateway-openshift-default-56654dcf7-qwhmj\" (UID: \"76a0ea55-242c-483c-893a-259a723e16f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:15.071325 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:15.071246    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:15.210506 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:15.210480    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"]
Jul 09 14:30:15.212776 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:30:15.212744    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a0ea55_242c_483c_893a_259a723e16f9.slice/crio-7f5777b50a8ed65494d7bacff19a237ca359aaf033ee6d911263cf5d5e8edd04 WatchSource:0}: Error finding container 7f5777b50a8ed65494d7bacff19a237ca359aaf033ee6d911263cf5d5e8edd04: Status 404 returned error can't find the container with id 7f5777b50a8ed65494d7bacff19a237ca359aaf033ee6d911263cf5d5e8edd04
Jul 09 14:30:15.248417 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:15.248375    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:16.091292 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:16.091249    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj" event={"ID":"76a0ea55-242c-483c-893a-259a723e16f9","Type":"ContainerStarted","Data":"7f5777b50a8ed65494d7bacff19a237ca359aaf033ee6d911263cf5d5e8edd04"}
Jul 09 14:30:17.911991 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:17.911956    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 09 14:30:17.912239 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:17.912036    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 09 14:30:17.912239 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:17.912066    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 09 14:30:18.105705 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:18.105655    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj" event={"ID":"76a0ea55-242c-483c-893a-259a723e16f9","Type":"ContainerStarted","Data":"e7023c1e95673f71ac6f83c2dbf9105e961e31b444d2c1e8066d9579eaa6bc7a"}
Jul 09 14:30:18.161984 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:18.161874    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj" podStartSLOduration=1.464851825 podStartE2EDuration="4.161857376s" totalImagesPullingTime="2.697005551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:30:18.159072877 +0000 UTC m=+562.186167271" watchObservedRunningTime="2026-07-09 14:30:18.161857376 +0000 UTC m=+562.188951838"
Jul 09 14:30:19.071449 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.071416    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:19.076174 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.076148    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:19.110050 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.110019    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:19.110917 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.110900    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:30:19.216208 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.216176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:19.341956 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.341863    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:19.406841 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.406779    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:19.631048 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.630970    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:30:19.634338 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.634319    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"
Jul 09 14:30:19.637048 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.637029    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 14:30:19.637793 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.637776    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g7ht8\""
Jul 09 14:30:19.637870 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.637776    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 14:30:19.637870 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.637778    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 14:30:19.642973 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.642949    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:30:19.669638 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.669614    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:30:19.736736 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.736697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv6vv\" (UniqueName: \"kubernetes.io/projected/05b30786-830a-45b3-ae68-8b05baf51fdc-kube-api-access-jv6vv\") pod \"limitador-limitador-54d6d988d5-mq8jd\" (UID: \"05b30786-830a-45b3-ae68-8b05baf51fdc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"
Jul 09 14:30:19.736882 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.736860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/05b30786-830a-45b3-ae68-8b05baf51fdc-config-file\") pod \"limitador-limitador-54d6d988d5-mq8jd\" (UID: \"05b30786-830a-45b3-ae68-8b05baf51fdc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"
Jul 09 14:30:19.838006 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.837962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv6vv\" (UniqueName: \"kubernetes.io/projected/05b30786-830a-45b3-ae68-8b05baf51fdc-kube-api-access-jv6vv\") pod \"limitador-limitador-54d6d988d5-mq8jd\" (UID: \"05b30786-830a-45b3-ae68-8b05baf51fdc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"
Jul 09 14:30:19.838149 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.838102    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/05b30786-830a-45b3-ae68-8b05baf51fdc-config-file\") pod \"limitador-limitador-54d6d988d5-mq8jd\" (UID: \"05b30786-830a-45b3-ae68-8b05baf51fdc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"
Jul 09 14:30:19.838710 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.838692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/05b30786-830a-45b3-ae68-8b05baf51fdc-config-file\") pod \"limitador-limitador-54d6d988d5-mq8jd\" (UID: \"05b30786-830a-45b3-ae68-8b05baf51fdc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"
Jul 09 14:30:19.847338 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.847313    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv6vv\" (UniqueName: \"kubernetes.io/projected/05b30786-830a-45b3-ae68-8b05baf51fdc-kube-api-access-jv6vv\") pod \"limitador-limitador-54d6d988d5-mq8jd\" (UID: \"05b30786-830a-45b3-ae68-8b05baf51fdc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"
Jul 09 14:30:19.945166 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:19.945074    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"
Jul 09 14:30:20.080349 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:20.080324    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:30:20.082166 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:30:20.082139    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b30786_830a_45b3_ae68_8b05baf51fdc.slice/crio-aaed36d751b35aea2097468ee79064c36bfb20767e0bfec9bbe584b970eade72 WatchSource:0}: Error finding container aaed36d751b35aea2097468ee79064c36bfb20767e0bfec9bbe584b970eade72: Status 404 returned error can't find the container with id aaed36d751b35aea2097468ee79064c36bfb20767e0bfec9bbe584b970eade72
Jul 09 14:30:20.114954 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:20.114922    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mq8jd" event={"ID":"05b30786-830a-45b3-ae68-8b05baf51fdc","Type":"ContainerStarted","Data":"aaed36d751b35aea2097468ee79064c36bfb20767e0bfec9bbe584b970eade72"}
Jul 09 14:30:20.259301 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:20.259258    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:20.259883 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:20.259866    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-mppvv"]
Jul 09 14:30:20.264214 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:20.264198    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mppvv"
Jul 09 14:30:20.266403 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:20.266381    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mtlgh\""
Jul 09 14:30:20.271132 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:20.271112    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mppvv"]
Jul 09 14:30:20.343429 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:20.343397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqg8v\" (UniqueName: \"kubernetes.io/projected/fa38d4b2-2082-4aae-a113-50a0894f7eb5-kube-api-access-rqg8v\") pod \"authorino-75d556bd77-mppvv\" (UID: \"fa38d4b2-2082-4aae-a113-50a0894f7eb5\") " pod="kuadrant-system/authorino-75d556bd77-mppvv"
Jul 09 14:30:20.346566 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:20.346536    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:20.444679 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:20.444646    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqg8v\" (UniqueName: \"kubernetes.io/projected/fa38d4b2-2082-4aae-a113-50a0894f7eb5-kube-api-access-rqg8v\") pod \"authorino-75d556bd77-mppvv\" (UID: \"fa38d4b2-2082-4aae-a113-50a0894f7eb5\") " pod="kuadrant-system/authorino-75d556bd77-mppvv"
Jul 09 14:30:20.453865 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:20.453836    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqg8v\" (UniqueName: \"kubernetes.io/projected/fa38d4b2-2082-4aae-a113-50a0894f7eb5-kube-api-access-rqg8v\") pod \"authorino-75d556bd77-mppvv\" (UID: \"fa38d4b2-2082-4aae-a113-50a0894f7eb5\") " pod="kuadrant-system/authorino-75d556bd77-mppvv"
Jul 09 14:30:20.575739 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:20.575660    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mppvv"
Jul 09 14:30:20.705284 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:20.705252    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mppvv"]
Jul 09 14:30:20.708150 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:30:20.708123    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa38d4b2_2082_4aae_a113_50a0894f7eb5.slice/crio-cfac8f2755a723eb494b503d3d2af1f99958f15ae1f8a4446fc6438258005bdb WatchSource:0}: Error finding container cfac8f2755a723eb494b503d3d2af1f99958f15ae1f8a4446fc6438258005bdb: Status 404 returned error can't find the container with id cfac8f2755a723eb494b503d3d2af1f99958f15ae1f8a4446fc6438258005bdb
Jul 09 14:30:21.123671 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:21.123587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mppvv" event={"ID":"fa38d4b2-2082-4aae-a113-50a0894f7eb5","Type":"ContainerStarted","Data":"cfac8f2755a723eb494b503d3d2af1f99958f15ae1f8a4446fc6438258005bdb"}
Jul 09 14:30:25.148354 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:25.148247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mppvv" event={"ID":"fa38d4b2-2082-4aae-a113-50a0894f7eb5","Type":"ContainerStarted","Data":"f3cea59a1c5c0dc2fe644d9f177209e6bf8240372d94e36373bfdd65cadf43ec"}
Jul 09 14:30:25.149885 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:25.149862    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mq8jd" event={"ID":"05b30786-830a-45b3-ae68-8b05baf51fdc","Type":"ContainerStarted","Data":"a68e8f435656e190f878faa7ef16b8cda4570c6be612b386c84be09de28d4193"}
Jul 09 14:30:25.150006 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:25.149938    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"
Jul 09 14:30:25.165526 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:25.165482    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-mppvv" podStartSLOduration=1.119497642 podStartE2EDuration="5.165456069s" totalImagesPullingTime="4.045958427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:30:25.163400931 +0000 UTC m=+569.190495518" watchObservedRunningTime="2026-07-09 14:30:25.165456069 +0000 UTC m=+569.192550460"
Jul 09 14:30:25.182609 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:25.182558    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-mq8jd" podStartSLOduration=1.512005775 podStartE2EDuration="6.182538638s" totalImagesPullingTime="4.670532863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:30:25.180905633 +0000 UTC m=+569.208000015" watchObservedRunningTime="2026-07-09 14:30:25.182538638 +0000 UTC m=+569.209633024"
Jul 09 14:30:32.122511 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:32.122474    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:32.199835 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:32.199780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:36.155846 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:36.155792    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"
Jul 09 14:30:40.518271 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:40.518226    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:40.615131 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:40.615101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:41.052260 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:41.052225    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:52.802301 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:52.802268    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:53.030118 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.030087    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cx5qp"]
Jul 09 14:30:53.040136 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.040104    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cx5qp"
Jul 09 14:30:53.042377 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.042351    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cx5qp"]
Jul 09 14:30:53.138691 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.138610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcdjw\" (UniqueName: \"kubernetes.io/projected/87ea37e4-f043-4f58-97d9-58a964194001-kube-api-access-hcdjw\") pod \"authorino-5d4b67c446-cx5qp\" (UID: \"87ea37e4-f043-4f58-97d9-58a964194001\") " pod="kuadrant-system/authorino-5d4b67c446-cx5qp"
Jul 09 14:30:53.190490 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.190454    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:30:53.239027 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.238998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcdjw\" (UniqueName: \"kubernetes.io/projected/87ea37e4-f043-4f58-97d9-58a964194001-kube-api-access-hcdjw\") pod \"authorino-5d4b67c446-cx5qp\" (UID: \"87ea37e4-f043-4f58-97d9-58a964194001\") " pod="kuadrant-system/authorino-5d4b67c446-cx5qp"
Jul 09 14:30:53.250650 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.250618    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcdjw\" (UniqueName: \"kubernetes.io/projected/87ea37e4-f043-4f58-97d9-58a964194001-kube-api-access-hcdjw\") pod \"authorino-5d4b67c446-cx5qp\" (UID: \"87ea37e4-f043-4f58-97d9-58a964194001\") " pod="kuadrant-system/authorino-5d4b67c446-cx5qp"
Jul 09 14:30:53.287270 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.287238    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cx5qp"]
Jul 09 14:30:53.287544 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.287531    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cx5qp"
Jul 09 14:30:53.314494 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.314466    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7489fffc7c-xk5fb"]
Jul 09 14:30:53.318321 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.318299    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7489fffc7c-xk5fb"
Jul 09 14:30:53.327123 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.326983    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7489fffc7c-xk5fb"]
Jul 09 14:30:53.339584 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.339506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcn77\" (UniqueName: \"kubernetes.io/projected/3e565b5d-aad4-4ae2-8ff1-08a5a958821d-kube-api-access-hcn77\") pod \"authorino-7489fffc7c-xk5fb\" (UID: \"3e565b5d-aad4-4ae2-8ff1-08a5a958821d\") " pod="kuadrant-system/authorino-7489fffc7c-xk5fb"
Jul 09 14:30:53.429192 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.429170    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cx5qp"]
Jul 09 14:30:53.431849 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:30:53.431824    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87ea37e4_f043_4f58_97d9_58a964194001.slice/crio-bd13427c1731cdf96776fa32feb4a4f595c6a9926b78b8bd2c66b5d40d4b5155 WatchSource:0}: Error finding container bd13427c1731cdf96776fa32feb4a4f595c6a9926b78b8bd2c66b5d40d4b5155: Status 404 returned error can't find the container with id bd13427c1731cdf96776fa32feb4a4f595c6a9926b78b8bd2c66b5d40d4b5155
Jul 09 14:30:53.440456 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.440433    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcn77\" (UniqueName: \"kubernetes.io/projected/3e565b5d-aad4-4ae2-8ff1-08a5a958821d-kube-api-access-hcn77\") pod \"authorino-7489fffc7c-xk5fb\" (UID: \"3e565b5d-aad4-4ae2-8ff1-08a5a958821d\") " pod="kuadrant-system/authorino-7489fffc7c-xk5fb"
Jul 09 14:30:53.449774 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.449745    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcn77\" (UniqueName: \"kubernetes.io/projected/3e565b5d-aad4-4ae2-8ff1-08a5a958821d-kube-api-access-hcn77\") pod \"authorino-7489fffc7c-xk5fb\" (UID: \"3e565b5d-aad4-4ae2-8ff1-08a5a958821d\") " pod="kuadrant-system/authorino-7489fffc7c-xk5fb"
Jul 09 14:30:53.452187 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.452163    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7489fffc7c-xk5fb"]
Jul 09 14:30:53.452513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.452498    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7489fffc7c-xk5fb"
Jul 09 14:30:53.482400 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.482369    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-698bdfdf4f-kb842"]
Jul 09 14:30:53.486304 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.486286    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-698bdfdf4f-kb842"
Jul 09 14:30:53.488757 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.488735    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 14:30:53.493492 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.493465    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-698bdfdf4f-kb842"]
Jul 09 14:30:53.541006 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.540970    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czzpk\" (UniqueName: \"kubernetes.io/projected/c95060c4-2f7b-4b59-92e7-dd41cf1abfdf-kube-api-access-czzpk\") pod \"authorino-698bdfdf4f-kb842\" (UID: \"c95060c4-2f7b-4b59-92e7-dd41cf1abfdf\") " pod="kuadrant-system/authorino-698bdfdf4f-kb842"
Jul 09 14:30:53.541232 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.541024    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c95060c4-2f7b-4b59-92e7-dd41cf1abfdf-tls-cert\") pod \"authorino-698bdfdf4f-kb842\" (UID: \"c95060c4-2f7b-4b59-92e7-dd41cf1abfdf\") " pod="kuadrant-system/authorino-698bdfdf4f-kb842"
Jul 09 14:30:53.594405 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.594375    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7489fffc7c-xk5fb"]
Jul 09 14:30:53.597246 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:30:53.597223    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e565b5d_aad4_4ae2_8ff1_08a5a958821d.slice/crio-6bc8f7069f9f3a3973647a5e73f6b14beafdb84f4d42844de179076ca275d23b WatchSource:0}: Error finding container 6bc8f7069f9f3a3973647a5e73f6b14beafdb84f4d42844de179076ca275d23b: Status 404 returned error can't find the container with id 6bc8f7069f9f3a3973647a5e73f6b14beafdb84f4d42844de179076ca275d23b
Jul 09 14:30:53.641963 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.641934    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czzpk\" (UniqueName: \"kubernetes.io/projected/c95060c4-2f7b-4b59-92e7-dd41cf1abfdf-kube-api-access-czzpk\") pod \"authorino-698bdfdf4f-kb842\" (UID: \"c95060c4-2f7b-4b59-92e7-dd41cf1abfdf\") " pod="kuadrant-system/authorino-698bdfdf4f-kb842"
Jul 09 14:30:53.642099 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.641974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c95060c4-2f7b-4b59-92e7-dd41cf1abfdf-tls-cert\") pod \"authorino-698bdfdf4f-kb842\" (UID: \"c95060c4-2f7b-4b59-92e7-dd41cf1abfdf\") " pod="kuadrant-system/authorino-698bdfdf4f-kb842"
Jul 09 14:30:53.644393 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.644375    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c95060c4-2f7b-4b59-92e7-dd41cf1abfdf-tls-cert\") pod \"authorino-698bdfdf4f-kb842\" (UID: \"c95060c4-2f7b-4b59-92e7-dd41cf1abfdf\") " pod="kuadrant-system/authorino-698bdfdf4f-kb842"
Jul 09 14:30:53.650889 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.650871    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czzpk\" (UniqueName: \"kubernetes.io/projected/c95060c4-2f7b-4b59-92e7-dd41cf1abfdf-kube-api-access-czzpk\") pod \"authorino-698bdfdf4f-kb842\" (UID: \"c95060c4-2f7b-4b59-92e7-dd41cf1abfdf\") " pod="kuadrant-system/authorino-698bdfdf4f-kb842"
Jul 09 14:30:53.796920 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.796882    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-698bdfdf4f-kb842"
Jul 09 14:30:53.941430 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:53.941406    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-698bdfdf4f-kb842"]
Jul 09 14:30:53.943512 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:30:53.943487    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc95060c4_2f7b_4b59_92e7_dd41cf1abfdf.slice/crio-72e84cb2eae61ad8873517d55e468e87532beea63033d2c632808c6ccf1d4669 WatchSource:0}: Error finding container 72e84cb2eae61ad8873517d55e468e87532beea63033d2c632808c6ccf1d4669: Status 404 returned error can't find the container with id 72e84cb2eae61ad8873517d55e468e87532beea63033d2c632808c6ccf1d4669
Jul 09 14:30:54.284782 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:54.284743    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-698bdfdf4f-kb842" event={"ID":"c95060c4-2f7b-4b59-92e7-dd41cf1abfdf","Type":"ContainerStarted","Data":"72e84cb2eae61ad8873517d55e468e87532beea63033d2c632808c6ccf1d4669"}
Jul 09 14:30:54.285980 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:54.285951    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7489fffc7c-xk5fb" event={"ID":"3e565b5d-aad4-4ae2-8ff1-08a5a958821d","Type":"ContainerStarted","Data":"6bc8f7069f9f3a3973647a5e73f6b14beafdb84f4d42844de179076ca275d23b"}
Jul 09 14:30:54.287424 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:54.287402    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cx5qp" event={"ID":"87ea37e4-f043-4f58-97d9-58a964194001","Type":"ContainerStarted","Data":"6c2f7f1fa597cdc09b1f72dfba3bc5e4d923f41cf86179534c98e6fbbfaf9ef7"}
Jul 09 14:30:54.287509 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:54.287432    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cx5qp" event={"ID":"87ea37e4-f043-4f58-97d9-58a964194001","Type":"ContainerStarted","Data":"bd13427c1731cdf96776fa32feb4a4f595c6a9926b78b8bd2c66b5d40d4b5155"}
Jul 09 14:30:54.287580 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:54.287532    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-cx5qp" podUID="87ea37e4-f043-4f58-97d9-58a964194001" containerName="authorino" containerID="cri-o://6c2f7f1fa597cdc09b1f72dfba3bc5e4d923f41cf86179534c98e6fbbfaf9ef7" gracePeriod=30
Jul 09 14:30:54.303755 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:54.303706    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-cx5qp" podStartSLOduration=0.63802988 podStartE2EDuration="1.303687513s" totalImagesPullingTime="665.657633ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:30:54.302783433 +0000 UTC m=+598.329877816" watchObservedRunningTime="2026-07-09 14:30:54.303687513 +0000 UTC m=+598.330781894"
Jul 09 14:30:54.547243 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:54.547219    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cx5qp"
Jul 09 14:30:54.648029 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:54.647974    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcdjw\" (UniqueName: \"kubernetes.io/projected/87ea37e4-f043-4f58-97d9-58a964194001-kube-api-access-hcdjw\") pod \"87ea37e4-f043-4f58-97d9-58a964194001\" (UID: \"87ea37e4-f043-4f58-97d9-58a964194001\") "
Jul 09 14:30:54.650196 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:54.650168    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87ea37e4-f043-4f58-97d9-58a964194001-kube-api-access-hcdjw" (OuterVolumeSpecName: "kube-api-access-hcdjw") pod "87ea37e4-f043-4f58-97d9-58a964194001" (UID: "87ea37e4-f043-4f58-97d9-58a964194001"). InnerVolumeSpecName "kube-api-access-hcdjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:30:54.749167 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:54.749130    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcdjw\" (UniqueName: \"kubernetes.io/projected/87ea37e4-f043-4f58-97d9-58a964194001-kube-api-access-hcdjw\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:30:55.294137 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.294106    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7489fffc7c-xk5fb" event={"ID":"3e565b5d-aad4-4ae2-8ff1-08a5a958821d","Type":"ContainerStarted","Data":"fbda934ac9ccb9805a2760e77eb2b0b4bc78b56ee29344caad721b79e5baa008"}
Jul 09 14:30:55.294562 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.294112    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7489fffc7c-xk5fb" podUID="3e565b5d-aad4-4ae2-8ff1-08a5a958821d" containerName="authorino" containerID="cri-o://fbda934ac9ccb9805a2760e77eb2b0b4bc78b56ee29344caad721b79e5baa008" gracePeriod=30
Jul 09 14:30:55.295459 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.295432    2563 generic.go:356] "Generic (PLEG): container finished" podID="87ea37e4-f043-4f58-97d9-58a964194001" containerID="6c2f7f1fa597cdc09b1f72dfba3bc5e4d923f41cf86179534c98e6fbbfaf9ef7" exitCode=0
Jul 09 14:30:55.295575 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.295470    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cx5qp"
Jul 09 14:30:55.295575 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.295501    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cx5qp" event={"ID":"87ea37e4-f043-4f58-97d9-58a964194001","Type":"ContainerDied","Data":"6c2f7f1fa597cdc09b1f72dfba3bc5e4d923f41cf86179534c98e6fbbfaf9ef7"}
Jul 09 14:30:55.295575 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.295548    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cx5qp" event={"ID":"87ea37e4-f043-4f58-97d9-58a964194001","Type":"ContainerDied","Data":"bd13427c1731cdf96776fa32feb4a4f595c6a9926b78b8bd2c66b5d40d4b5155"}
Jul 09 14:30:55.295575 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.295569    2563 scope.go:117] "RemoveContainer" containerID="6c2f7f1fa597cdc09b1f72dfba3bc5e4d923f41cf86179534c98e6fbbfaf9ef7"
Jul 09 14:30:55.297041 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.297008    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-698bdfdf4f-kb842" event={"ID":"c95060c4-2f7b-4b59-92e7-dd41cf1abfdf","Type":"ContainerStarted","Data":"e5c50ed39b616046fc7133df832a79c47a53c831a14db7fd8a0b48deb3525204"}
Jul 09 14:30:55.304487 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.304348    2563 scope.go:117] "RemoveContainer" containerID="6c2f7f1fa597cdc09b1f72dfba3bc5e4d923f41cf86179534c98e6fbbfaf9ef7"
Jul 09 14:30:55.304610 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:30:55.304592    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c2f7f1fa597cdc09b1f72dfba3bc5e4d923f41cf86179534c98e6fbbfaf9ef7\": container with ID starting with 6c2f7f1fa597cdc09b1f72dfba3bc5e4d923f41cf86179534c98e6fbbfaf9ef7 not found: ID does not exist" containerID="6c2f7f1fa597cdc09b1f72dfba3bc5e4d923f41cf86179534c98e6fbbfaf9ef7"
Jul 09 14:30:55.304653 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.304619    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c2f7f1fa597cdc09b1f72dfba3bc5e4d923f41cf86179534c98e6fbbfaf9ef7"} err="failed to get container status \"6c2f7f1fa597cdc09b1f72dfba3bc5e4d923f41cf86179534c98e6fbbfaf9ef7\": rpc error: code = NotFound desc = could not find container \"6c2f7f1fa597cdc09b1f72dfba3bc5e4d923f41cf86179534c98e6fbbfaf9ef7\": container with ID starting with 6c2f7f1fa597cdc09b1f72dfba3bc5e4d923f41cf86179534c98e6fbbfaf9ef7 not found: ID does not exist"
Jul 09 14:30:55.309729 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.309682    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7489fffc7c-xk5fb" podStartSLOduration=1.31899229 podStartE2EDuration="2.309666437s" totalImagesPullingTime="990.674147ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:30:55.309483355 +0000 UTC m=+599.336577748" watchObservedRunningTime="2026-07-09 14:30:55.309666437 +0000 UTC m=+599.336760821"
Jul 09 14:30:55.331435 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.331390    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-698bdfdf4f-kb842" podStartSLOduration=1.986590068 podStartE2EDuration="2.33137519s" totalImagesPullingTime="344.785122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:30:55.329699717 +0000 UTC m=+599.356794099" watchObservedRunningTime="2026-07-09 14:30:55.33137519 +0000 UTC m=+599.358469571"
Jul 09 14:30:55.356925 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.356900    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mppvv"]
Jul 09 14:30:55.357073 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.357054    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-mppvv" podUID="fa38d4b2-2082-4aae-a113-50a0894f7eb5" containerName="authorino" containerID="cri-o://f3cea59a1c5c0dc2fe644d9f177209e6bf8240372d94e36373bfdd65cadf43ec" gracePeriod=30
Jul 09 14:30:55.369543 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.369505    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cx5qp"]
Jul 09 14:30:55.376112 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.376087    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cx5qp"]
Jul 09 14:30:55.613852 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.613829    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7489fffc7c-xk5fb"
Jul 09 14:30:55.616615 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.616595    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mppvv"
Jul 09 14:30:55.657283 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.657251    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqg8v\" (UniqueName: \"kubernetes.io/projected/fa38d4b2-2082-4aae-a113-50a0894f7eb5-kube-api-access-rqg8v\") pod \"fa38d4b2-2082-4aae-a113-50a0894f7eb5\" (UID: \"fa38d4b2-2082-4aae-a113-50a0894f7eb5\") "
Jul 09 14:30:55.659461 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.659429    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa38d4b2-2082-4aae-a113-50a0894f7eb5-kube-api-access-rqg8v" (OuterVolumeSpecName: "kube-api-access-rqg8v") pod "fa38d4b2-2082-4aae-a113-50a0894f7eb5" (UID: "fa38d4b2-2082-4aae-a113-50a0894f7eb5"). InnerVolumeSpecName "kube-api-access-rqg8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:30:55.758347 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.758309    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcn77\" (UniqueName: \"kubernetes.io/projected/3e565b5d-aad4-4ae2-8ff1-08a5a958821d-kube-api-access-hcn77\") pod \"3e565b5d-aad4-4ae2-8ff1-08a5a958821d\" (UID: \"3e565b5d-aad4-4ae2-8ff1-08a5a958821d\") "
Jul 09 14:30:55.758489 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.758470    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqg8v\" (UniqueName: \"kubernetes.io/projected/fa38d4b2-2082-4aae-a113-50a0894f7eb5-kube-api-access-rqg8v\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:30:55.760355 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.760331    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e565b5d-aad4-4ae2-8ff1-08a5a958821d-kube-api-access-hcn77" (OuterVolumeSpecName: "kube-api-access-hcn77") pod "3e565b5d-aad4-4ae2-8ff1-08a5a958821d" (UID: "3e565b5d-aad4-4ae2-8ff1-08a5a958821d"). InnerVolumeSpecName "kube-api-access-hcn77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:30:55.859691 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:55.859610    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcn77\" (UniqueName: \"kubernetes.io/projected/3e565b5d-aad4-4ae2-8ff1-08a5a958821d-kube-api-access-hcn77\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:30:56.303959 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.303929    2563 generic.go:356] "Generic (PLEG): container finished" podID="fa38d4b2-2082-4aae-a113-50a0894f7eb5" containerID="f3cea59a1c5c0dc2fe644d9f177209e6bf8240372d94e36373bfdd65cadf43ec" exitCode=0
Jul 09 14:30:56.304375 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.303990    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mppvv"
Jul 09 14:30:56.304375 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.304026    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mppvv" event={"ID":"fa38d4b2-2082-4aae-a113-50a0894f7eb5","Type":"ContainerDied","Data":"f3cea59a1c5c0dc2fe644d9f177209e6bf8240372d94e36373bfdd65cadf43ec"}
Jul 09 14:30:56.304375 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.304069    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mppvv" event={"ID":"fa38d4b2-2082-4aae-a113-50a0894f7eb5","Type":"ContainerDied","Data":"cfac8f2755a723eb494b503d3d2af1f99958f15ae1f8a4446fc6438258005bdb"}
Jul 09 14:30:56.304375 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.304087    2563 scope.go:117] "RemoveContainer" containerID="f3cea59a1c5c0dc2fe644d9f177209e6bf8240372d94e36373bfdd65cadf43ec"
Jul 09 14:30:56.306530 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.306502    2563 generic.go:356] "Generic (PLEG): container finished" podID="3e565b5d-aad4-4ae2-8ff1-08a5a958821d" containerID="fbda934ac9ccb9805a2760e77eb2b0b4bc78b56ee29344caad721b79e5baa008" exitCode=0
Jul 09 14:30:56.306646 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.306548    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7489fffc7c-xk5fb"
Jul 09 14:30:56.306646 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.306571    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7489fffc7c-xk5fb" event={"ID":"3e565b5d-aad4-4ae2-8ff1-08a5a958821d","Type":"ContainerDied","Data":"fbda934ac9ccb9805a2760e77eb2b0b4bc78b56ee29344caad721b79e5baa008"}
Jul 09 14:30:56.306646 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.306609    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7489fffc7c-xk5fb" event={"ID":"3e565b5d-aad4-4ae2-8ff1-08a5a958821d","Type":"ContainerDied","Data":"6bc8f7069f9f3a3973647a5e73f6b14beafdb84f4d42844de179076ca275d23b"}
Jul 09 14:30:56.315504 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.315482    2563 scope.go:117] "RemoveContainer" containerID="f3cea59a1c5c0dc2fe644d9f177209e6bf8240372d94e36373bfdd65cadf43ec"
Jul 09 14:30:56.315894 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:30:56.315869    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3cea59a1c5c0dc2fe644d9f177209e6bf8240372d94e36373bfdd65cadf43ec\": container with ID starting with f3cea59a1c5c0dc2fe644d9f177209e6bf8240372d94e36373bfdd65cadf43ec not found: ID does not exist" containerID="f3cea59a1c5c0dc2fe644d9f177209e6bf8240372d94e36373bfdd65cadf43ec"
Jul 09 14:30:56.315998 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.315905    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3cea59a1c5c0dc2fe644d9f177209e6bf8240372d94e36373bfdd65cadf43ec"} err="failed to get container status \"f3cea59a1c5c0dc2fe644d9f177209e6bf8240372d94e36373bfdd65cadf43ec\": rpc error: code = NotFound desc = could not find container \"f3cea59a1c5c0dc2fe644d9f177209e6bf8240372d94e36373bfdd65cadf43ec\": container with ID starting with f3cea59a1c5c0dc2fe644d9f177209e6bf8240372d94e36373bfdd65cadf43ec not found: ID does not exist"
Jul 09 14:30:56.315998 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.315928    2563 scope.go:117] "RemoveContainer" containerID="fbda934ac9ccb9805a2760e77eb2b0b4bc78b56ee29344caad721b79e5baa008"
Jul 09 14:30:56.316429 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:30:56.316397    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="get container status: runtime container status: rpc error: code = NotFound desc = could not find container \"f3cea59a1c5c0dc2fe644d9f177209e6bf8240372d94e36373bfdd65cadf43ec\": container with ID starting with f3cea59a1c5c0dc2fe644d9f177209e6bf8240372d94e36373bfdd65cadf43ec not found: ID does not exist"
Jul 09 14:30:56.325208 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.325194    2563 scope.go:117] "RemoveContainer" containerID="fbda934ac9ccb9805a2760e77eb2b0b4bc78b56ee29344caad721b79e5baa008"
Jul 09 14:30:56.325431 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:30:56.325413    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbda934ac9ccb9805a2760e77eb2b0b4bc78b56ee29344caad721b79e5baa008\": container with ID starting with fbda934ac9ccb9805a2760e77eb2b0b4bc78b56ee29344caad721b79e5baa008 not found: ID does not exist" containerID="fbda934ac9ccb9805a2760e77eb2b0b4bc78b56ee29344caad721b79e5baa008"
Jul 09 14:30:56.325474 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.325441    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbda934ac9ccb9805a2760e77eb2b0b4bc78b56ee29344caad721b79e5baa008"} err="failed to get container status \"fbda934ac9ccb9805a2760e77eb2b0b4bc78b56ee29344caad721b79e5baa008\": rpc error: code = NotFound desc = could not find container \"fbda934ac9ccb9805a2760e77eb2b0b4bc78b56ee29344caad721b79e5baa008\": container with ID starting with fbda934ac9ccb9805a2760e77eb2b0b4bc78b56ee29344caad721b79e5baa008 not found: ID does not exist"
Jul 09 14:30:56.334191 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.334171    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7489fffc7c-xk5fb"]
Jul 09 14:30:56.336009 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.335985    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7489fffc7c-xk5fb"]
Jul 09 14:30:56.343160 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.343141    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:30:56.348224 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.348198    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mppvv"]
Jul 09 14:30:56.351476 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.351457    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mppvv"]
Jul 09 14:30:56.460738 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.460710    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e565b5d-aad4-4ae2-8ff1-08a5a958821d" path="/var/lib/kubelet/pods/3e565b5d-aad4-4ae2-8ff1-08a5a958821d/volumes"
Jul 09 14:30:56.461052 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.461040    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87ea37e4-f043-4f58-97d9-58a964194001" path="/var/lib/kubelet/pods/87ea37e4-f043-4f58-97d9-58a964194001/volumes"
Jul 09 14:30:56.461314 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:56.461303    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa38d4b2-2082-4aae-a113-50a0894f7eb5" path="/var/lib/kubelet/pods/fa38d4b2-2082-4aae-a113-50a0894f7eb5/volumes"
Jul 09 14:30:59.989943 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:30:59.989876    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:00.097724 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:00.097690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:00.199769 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:00.199736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:00.352965 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:00.352880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:01.098401 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:01.098373    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:03.361069 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:03.361003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:05.362679 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:05.362638    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:11.668114 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:11.668079    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:23.023202 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:23.023121    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:34.819231 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:34.819196    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:35.271414 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:35.271364    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:35.654840 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:35.654727    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:35.791204 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:35.791151    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:35.901390 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:35.901353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:36.117276 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:36.117243    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:31:44.530336 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:44.530303    2563 generic.go:356] "Generic (PLEG): container finished" podID="76a0ea55-242c-483c-893a-259a723e16f9" containerID="e7023c1e95673f71ac6f83c2dbf9105e961e31b444d2c1e8066d9579eaa6bc7a" exitCode=0
Jul 09 14:31:44.530750 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:44.530379    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj" event={"ID":"76a0ea55-242c-483c-893a-259a723e16f9","Type":"ContainerDied","Data":"e7023c1e95673f71ac6f83c2dbf9105e961e31b444d2c1e8066d9579eaa6bc7a"}
Jul 09 14:31:44.530831 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:44.530787    2563 scope.go:117] "RemoveContainer" containerID="e7023c1e95673f71ac6f83c2dbf9105e961e31b444d2c1e8066d9579eaa6bc7a"
Jul 09 14:31:44.531877 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:44.531846    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 09 14:31:44.531992 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:44.531931    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 09 14:31:44.531992 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:44.531980    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 09 14:31:45.537994 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:45.537958    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj" event={"ID":"76a0ea55-242c-483c-893a-259a723e16f9","Type":"ContainerStarted","Data":"518e5180904633de95459fd00153b69a62cfccf1ea49008d2e63c6cc31a4cdb5"}
Jul 09 14:31:46.071986 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:46.071947    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:31:46.073201 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:46.073172    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qwhmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 09 14:31:46.073341 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:46.073235    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj" podUID="76a0ea55-242c-483c-893a-259a723e16f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 09 14:31:46.346111 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:46.346016    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:46.673385 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:46.673286    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:47.071846 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:47.071785    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qwhmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 09 14:31:47.072023 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:47.071872    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj" podUID="76a0ea55-242c-483c-893a-259a723e16f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 09 14:31:48.072741 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:48.072696    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qwhmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 09 14:31:48.073250 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:48.072772    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj" podUID="76a0ea55-242c-483c-893a-259a723e16f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 09 14:31:49.072239 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:49.072194    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qwhmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 09 14:31:49.072416 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:49.072261    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj" podUID="76a0ea55-242c-483c-893a-259a723e16f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 09 14:31:49.110418 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:49.110392    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:31:50.075952 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:50.075922    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:31:50.076790 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:50.076769    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qwhmj"
Jul 09 14:31:51.615137 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:51.615101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:58.399199 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:58.399166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:31:58.899034 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:31:58.898997    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:32:16.526379 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:16.526349    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:32:17.213082 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:17.213043    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:32:19.682473 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.682434    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"]
Jul 09 14:32:19.682945 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.682837    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e565b5d-aad4-4ae2-8ff1-08a5a958821d" containerName="authorino"
Jul 09 14:32:19.682945 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.682848    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e565b5d-aad4-4ae2-8ff1-08a5a958821d" containerName="authorino"
Jul 09 14:32:19.682945 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.682865    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa38d4b2-2082-4aae-a113-50a0894f7eb5" containerName="authorino"
Jul 09 14:32:19.682945 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.682871    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa38d4b2-2082-4aae-a113-50a0894f7eb5" containerName="authorino"
Jul 09 14:32:19.682945 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.682879    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ea37e4-f043-4f58-97d9-58a964194001" containerName="authorino"
Jul 09 14:32:19.682945 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.682886    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ea37e4-f043-4f58-97d9-58a964194001" containerName="authorino"
Jul 09 14:32:19.682945 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.682942    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="87ea37e4-f043-4f58-97d9-58a964194001" containerName="authorino"
Jul 09 14:32:19.682945 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.682950    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa38d4b2-2082-4aae-a113-50a0894f7eb5" containerName="authorino"
Jul 09 14:32:19.683356 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.682961    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e565b5d-aad4-4ae2-8ff1-08a5a958821d" containerName="authorino"
Jul 09 14:32:19.686273 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.686254    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.689302 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.689282    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 14:32:19.689459 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.689340    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 14:32:19.689459 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.689436    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 09 14:32:19.690167 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.690148    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ndfhx\""
Jul 09 14:32:19.700824 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.700782    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"]
Jul 09 14:32:19.820991 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.820960    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tnn4\" (UniqueName: \"kubernetes.io/projected/288b33b8-7047-4482-b786-c302024c8e3b-kube-api-access-8tnn4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.820991 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.820995    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/288b33b8-7047-4482-b786-c302024c8e3b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.821265 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.821014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/288b33b8-7047-4482-b786-c302024c8e3b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.821265 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.821086    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/288b33b8-7047-4482-b786-c302024c8e3b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.821265 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.821114    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/288b33b8-7047-4482-b786-c302024c8e3b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.821265 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.821155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288b33b8-7047-4482-b786-c302024c8e3b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.921939 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.921900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/288b33b8-7047-4482-b786-c302024c8e3b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.921939 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.921938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/288b33b8-7047-4482-b786-c302024c8e3b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.922167 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.921976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288b33b8-7047-4482-b786-c302024c8e3b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.922167 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.922041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tnn4\" (UniqueName: \"kubernetes.io/projected/288b33b8-7047-4482-b786-c302024c8e3b-kube-api-access-8tnn4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.922167 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.922075    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/288b33b8-7047-4482-b786-c302024c8e3b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.922167 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.922100    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/288b33b8-7047-4482-b786-c302024c8e3b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.922435 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.922393    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/288b33b8-7047-4482-b786-c302024c8e3b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.922559 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.922453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288b33b8-7047-4482-b786-c302024c8e3b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.922559 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.922496    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/288b33b8-7047-4482-b786-c302024c8e3b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.924295 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.924279    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/288b33b8-7047-4482-b786-c302024c8e3b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.924545 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.924527    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/288b33b8-7047-4482-b786-c302024c8e3b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.930935 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.930915    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tnn4\" (UniqueName: \"kubernetes.io/projected/288b33b8-7047-4482-b786-c302024c8e3b-kube-api-access-8tnn4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tn7k6\" (UID: \"288b33b8-7047-4482-b786-c302024c8e3b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:19.996984 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:19.996934    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:20.069672 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:20.069646    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:32:20.130627 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:20.130600    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"]
Jul 09 14:32:20.132676 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:32:20.132646    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod288b33b8_7047_4482_b786_c302024c8e3b.slice/crio-efcb4984371a832b5000deaa1b576364eabea09403d8af0372f6a7155309a7bb WatchSource:0}: Error finding container efcb4984371a832b5000deaa1b576364eabea09403d8af0372f6a7155309a7bb: Status 404 returned error can't find the container with id efcb4984371a832b5000deaa1b576364eabea09403d8af0372f6a7155309a7bb
Jul 09 14:32:20.134006 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:20.133989    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 14:32:20.713942 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:20.713901    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6" event={"ID":"288b33b8-7047-4482-b786-c302024c8e3b","Type":"ContainerStarted","Data":"efcb4984371a832b5000deaa1b576364eabea09403d8af0372f6a7155309a7bb"}
Jul 09 14:32:21.460529 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:21.460497    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:32:21.722541 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:21.722453    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6" event={"ID":"288b33b8-7047-4482-b786-c302024c8e3b","Type":"ContainerStarted","Data":"303a33941dea78739db78a8282d601ce572a8af14e683f64e0252b68f08c5914"}
Jul 09 14:32:21.745650 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:21.745590    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6" podStartSLOduration=1.673786529 podStartE2EDuration="2.745572663s" totalImagesPullingTime="1.071786134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:32:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:21.744477293 +0000 UTC m=+685.771571678" watchObservedRunningTime="2026-07-09 14:32:21.745572663 +0000 UTC m=+685.772667085"
Jul 09 14:32:28.101276 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:28.101232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:32:29.900941 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:29.900904    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:32:29.997996 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:29.997963    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:29.998175 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:29.998020    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:30.011012 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:30.010985    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:30.784239 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:30.784209    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tn7k6"
Jul 09 14:32:39.516867 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:39.516793    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:32:41.608456 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:41.608416    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:32:53.307306 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.307223    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"]
Jul 09 14:32:53.313477 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.313455    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.316084 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.316061    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 09 14:32:53.324166 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.324144    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"]
Jul 09 14:32:53.351162 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.351128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:32:53.426084 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.426052    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ded52ace-b59c-4d1d-8efa-20439d922a5d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.426084 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.426087    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vg7k\" (UniqueName: \"kubernetes.io/projected/ded52ace-b59c-4d1d-8efa-20439d922a5d-kube-api-access-9vg7k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.426322 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.426109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ded52ace-b59c-4d1d-8efa-20439d922a5d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.426322 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.426126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ded52ace-b59c-4d1d-8efa-20439d922a5d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.426322 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.426175    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ded52ace-b59c-4d1d-8efa-20439d922a5d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.426322 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.426192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ded52ace-b59c-4d1d-8efa-20439d922a5d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.527002 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.526961    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ded52ace-b59c-4d1d-8efa-20439d922a5d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.527002 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.527005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ded52ace-b59c-4d1d-8efa-20439d922a5d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.527277 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.527157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ded52ace-b59c-4d1d-8efa-20439d922a5d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.527277 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.527183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vg7k\" (UniqueName: \"kubernetes.io/projected/ded52ace-b59c-4d1d-8efa-20439d922a5d-kube-api-access-9vg7k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.527277 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.527211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ded52ace-b59c-4d1d-8efa-20439d922a5d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.527277 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.527238    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ded52ace-b59c-4d1d-8efa-20439d922a5d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.527496 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.527412    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ded52ace-b59c-4d1d-8efa-20439d922a5d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.527592 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.527571    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ded52ace-b59c-4d1d-8efa-20439d922a5d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.527658 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.527624    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ded52ace-b59c-4d1d-8efa-20439d922a5d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.529421 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.529402    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ded52ace-b59c-4d1d-8efa-20439d922a5d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.529572 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.529555    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ded52ace-b59c-4d1d-8efa-20439d922a5d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.536461 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.536428    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vg7k\" (UniqueName: \"kubernetes.io/projected/ded52ace-b59c-4d1d-8efa-20439d922a5d-kube-api-access-9vg7k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt\" (UID: \"ded52ace-b59c-4d1d-8efa-20439d922a5d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.623521 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.623447    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:32:53.757704 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.757680    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"]
Jul 09 14:32:53.759674 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:32:53.759640    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podded52ace_b59c_4d1d_8efa_20439d922a5d.slice/crio-266a4991baa9b601a4e014455162dd127ae475db38d1dc0deae41409f6b8dd2b WatchSource:0}: Error finding container 266a4991baa9b601a4e014455162dd127ae475db38d1dc0deae41409f6b8dd2b: Status 404 returned error can't find the container with id 266a4991baa9b601a4e014455162dd127ae475db38d1dc0deae41409f6b8dd2b
Jul 09 14:32:53.880946 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:53.880862    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt" event={"ID":"ded52ace-b59c-4d1d-8efa-20439d922a5d","Type":"ContainerStarted","Data":"266a4991baa9b601a4e014455162dd127ae475db38d1dc0deae41409f6b8dd2b"}
Jul 09 14:32:54.886959 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:54.886928    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt" event={"ID":"ded52ace-b59c-4d1d-8efa-20439d922a5d","Type":"ContainerStarted","Data":"3f800e2105a6c9fbc952ee0df848d64df9ac6803c5e56a7346d1419a918d2a3c"}
Jul 09 14:32:54.906276 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:54.906230    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt" podStartSLOduration=1.676429895 podStartE2EDuration="1.906215164s" totalImagesPullingTime="229.785269ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:54.90530126 +0000 UTC m=+718.932395641" watchObservedRunningTime="2026-07-09 14:32:54.906215164 +0000 UTC m=+718.933309545"
Jul 09 14:32:55.905287 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:32:55.905251    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:33:03.624049 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:03.624014    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:33:03.624433 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:03.624066    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:33:03.636218 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:03.636195    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:33:03.943938 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:03.943856    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt"
Jul 09 14:33:42.735497 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:42.735458    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65565996b4-v7kwz"]
Jul 09 14:33:42.739555 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:42.739533    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65565996b4-v7kwz"
Jul 09 14:33:42.747530 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:42.747504    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65565996b4-v7kwz"]
Jul 09 14:33:42.867782 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:42.867748    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd-tls-cert\") pod \"authorino-65565996b4-v7kwz\" (UID: \"f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd\") " pod="kuadrant-system/authorino-65565996b4-v7kwz"
Jul 09 14:33:42.867974 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:42.867948    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdjnp\" (UniqueName: \"kubernetes.io/projected/f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd-kube-api-access-kdjnp\") pod \"authorino-65565996b4-v7kwz\" (UID: \"f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd\") " pod="kuadrant-system/authorino-65565996b4-v7kwz"
Jul 09 14:33:42.968421 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:42.968377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdjnp\" (UniqueName: \"kubernetes.io/projected/f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd-kube-api-access-kdjnp\") pod \"authorino-65565996b4-v7kwz\" (UID: \"f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd\") " pod="kuadrant-system/authorino-65565996b4-v7kwz"
Jul 09 14:33:42.968421 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:42.968430    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd-tls-cert\") pod \"authorino-65565996b4-v7kwz\" (UID: \"f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd\") " pod="kuadrant-system/authorino-65565996b4-v7kwz"
Jul 09 14:33:42.971080 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:42.971058    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd-tls-cert\") pod \"authorino-65565996b4-v7kwz\" (UID: \"f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd\") " pod="kuadrant-system/authorino-65565996b4-v7kwz"
Jul 09 14:33:42.976882 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:42.976858    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdjnp\" (UniqueName: \"kubernetes.io/projected/f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd-kube-api-access-kdjnp\") pod \"authorino-65565996b4-v7kwz\" (UID: \"f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd\") " pod="kuadrant-system/authorino-65565996b4-v7kwz"
Jul 09 14:33:43.049979 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:43.049906    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65565996b4-v7kwz"
Jul 09 14:33:43.184172 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:43.184140    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:33:43.202640 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:43.202619    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65565996b4-v7kwz"]
Jul 09 14:33:43.204748 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:33:43.204717    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7b64e8c_be7b_4390_92d4_0c3e3f8ae0cd.slice/crio-aff3c194cb4caa18c8f10b82c691722197cb0d737ddf6872cbf74a071f6667b4 WatchSource:0}: Error finding container aff3c194cb4caa18c8f10b82c691722197cb0d737ddf6872cbf74a071f6667b4: Status 404 returned error can't find the container with id aff3c194cb4caa18c8f10b82c691722197cb0d737ddf6872cbf74a071f6667b4
Jul 09 14:33:43.274921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:43.274887    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:33:44.125718 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:44.124982    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65565996b4-v7kwz" event={"ID":"f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd","Type":"ContainerStarted","Data":"d0c70bab164a12dfd220ed57b1f76cdec57d409c52b7bdc17ed299448e7d1802"}
Jul 09 14:33:44.125718 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:44.125035    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65565996b4-v7kwz" event={"ID":"f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd","Type":"ContainerStarted","Data":"aff3c194cb4caa18c8f10b82c691722197cb0d737ddf6872cbf74a071f6667b4"}
Jul 09 14:33:44.143744 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:44.143680    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65565996b4-v7kwz" podStartSLOduration=1.693102093 podStartE2EDuration="2.143660917s" totalImagesPullingTime="450.558824ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:44.142758363 +0000 UTC m=+768.169852743" watchObservedRunningTime="2026-07-09 14:33:44.143660917 +0000 UTC m=+768.170755299"
Jul 09 14:33:44.180335 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:44.180241    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-698bdfdf4f-kb842"]
Jul 09 14:33:44.180521 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:44.180450    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-698bdfdf4f-kb842" podUID="c95060c4-2f7b-4b59-92e7-dd41cf1abfdf" containerName="authorino" containerID="cri-o://e5c50ed39b616046fc7133df832a79c47a53c831a14db7fd8a0b48deb3525204" gracePeriod=30
Jul 09 14:33:44.341295 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:44.341244    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:33:44.434104 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:44.434069    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:33:44.461508 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:44.461476    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-698bdfdf4f-kb842"
Jul 09 14:33:44.587270 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:44.587238    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c95060c4-2f7b-4b59-92e7-dd41cf1abfdf-tls-cert\") pod \"c95060c4-2f7b-4b59-92e7-dd41cf1abfdf\" (UID: \"c95060c4-2f7b-4b59-92e7-dd41cf1abfdf\") "
Jul 09 14:33:44.587435 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:44.587276    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czzpk\" (UniqueName: \"kubernetes.io/projected/c95060c4-2f7b-4b59-92e7-dd41cf1abfdf-kube-api-access-czzpk\") pod \"c95060c4-2f7b-4b59-92e7-dd41cf1abfdf\" (UID: \"c95060c4-2f7b-4b59-92e7-dd41cf1abfdf\") "
Jul 09 14:33:44.589661 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:44.589628    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c95060c4-2f7b-4b59-92e7-dd41cf1abfdf-kube-api-access-czzpk" (OuterVolumeSpecName: "kube-api-access-czzpk") pod "c95060c4-2f7b-4b59-92e7-dd41cf1abfdf" (UID: "c95060c4-2f7b-4b59-92e7-dd41cf1abfdf"). InnerVolumeSpecName "kube-api-access-czzpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:33:44.598194 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:44.598162    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c95060c4-2f7b-4b59-92e7-dd41cf1abfdf-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c95060c4-2f7b-4b59-92e7-dd41cf1abfdf" (UID: "c95060c4-2f7b-4b59-92e7-dd41cf1abfdf"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:33:44.689131 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:44.689035    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c95060c4-2f7b-4b59-92e7-dd41cf1abfdf-tls-cert\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:33:44.689131 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:44.689071    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czzpk\" (UniqueName: \"kubernetes.io/projected/c95060c4-2f7b-4b59-92e7-dd41cf1abfdf-kube-api-access-czzpk\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:33:45.131939 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:45.131907    2563 generic.go:356] "Generic (PLEG): container finished" podID="c95060c4-2f7b-4b59-92e7-dd41cf1abfdf" containerID="e5c50ed39b616046fc7133df832a79c47a53c831a14db7fd8a0b48deb3525204" exitCode=0
Jul 09 14:33:45.132320 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:45.131965    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-698bdfdf4f-kb842"
Jul 09 14:33:45.132320 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:45.131997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-698bdfdf4f-kb842" event={"ID":"c95060c4-2f7b-4b59-92e7-dd41cf1abfdf","Type":"ContainerDied","Data":"e5c50ed39b616046fc7133df832a79c47a53c831a14db7fd8a0b48deb3525204"}
Jul 09 14:33:45.132320 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:45.132036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-698bdfdf4f-kb842" event={"ID":"c95060c4-2f7b-4b59-92e7-dd41cf1abfdf","Type":"ContainerDied","Data":"72e84cb2eae61ad8873517d55e468e87532beea63033d2c632808c6ccf1d4669"}
Jul 09 14:33:45.132320 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:45.132050    2563 scope.go:117] "RemoveContainer" containerID="e5c50ed39b616046fc7133df832a79c47a53c831a14db7fd8a0b48deb3525204"
Jul 09 14:33:45.141731 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:45.141712    2563 scope.go:117] "RemoveContainer" containerID="e5c50ed39b616046fc7133df832a79c47a53c831a14db7fd8a0b48deb3525204"
Jul 09 14:33:45.142104 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:33:45.142085    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5c50ed39b616046fc7133df832a79c47a53c831a14db7fd8a0b48deb3525204\": container with ID starting with e5c50ed39b616046fc7133df832a79c47a53c831a14db7fd8a0b48deb3525204 not found: ID does not exist" containerID="e5c50ed39b616046fc7133df832a79c47a53c831a14db7fd8a0b48deb3525204"
Jul 09 14:33:45.142193 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:45.142117    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5c50ed39b616046fc7133df832a79c47a53c831a14db7fd8a0b48deb3525204"} err="failed to get container status \"e5c50ed39b616046fc7133df832a79c47a53c831a14db7fd8a0b48deb3525204\": rpc error: code = NotFound desc = could not find container \"e5c50ed39b616046fc7133df832a79c47a53c831a14db7fd8a0b48deb3525204\": container with ID starting with e5c50ed39b616046fc7133df832a79c47a53c831a14db7fd8a0b48deb3525204 not found: ID does not exist"
Jul 09 14:33:45.157944 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:45.157916    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-698bdfdf4f-kb842"]
Jul 09 14:33:45.163110 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:45.163082    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-698bdfdf4f-kb842"]
Jul 09 14:33:46.460012 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:33:46.459973    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c95060c4-2f7b-4b59-92e7-dd41cf1abfdf" path="/var/lib/kubelet/pods/c95060c4-2f7b-4b59-92e7-dd41cf1abfdf/volumes"
Jul 09 14:34:21.598670 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:34:21.598582    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:34:32.301061 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:34:32.301031    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:34:42.916930 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:34:42.916891    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:34:52.106517 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:34:52.106476    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:35:02.901176 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:02.901138    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:35:05.120226 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:05.120184    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:35:06.439539 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:06.439500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:35:29.206463 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:29.206417    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:35:41.204248 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:41.204206    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:35:50.175102 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:50.175014    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:35:50.277998 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:50.277968    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:35:50.380665 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:50.380635    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:35:52.636346 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:52.636311    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:35:56.195243 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:56.195208    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:35:56.256102 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:56.256071    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:35:56.343694 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:56.343657    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:35:56.345235 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:56.345212    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:35:56.347668 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:56.347652    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 14:35:56.372341 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:56.372319    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:35:56.442895 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:56.442856    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:35:56.544035 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:35:56.543998    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:36:02.623085 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:36:02.623053    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:36:02.722862 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:36:02.722827    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:36:03.613118 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:36:03.613086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:36:18.496054 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:36:18.496019    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:36:26.298047 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:36:26.297998    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:36:37.201325 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:36:37.201284    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:36:45.096463 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:36:45.096424    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:36:56.503984 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:36:56.503948    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:37:04.801950 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:37:04.801900    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:37:06.097784 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:37:06.097747    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:37:17.206938 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:37:17.206853    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:37:26.998678 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:37:26.998640    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:37:28.318878 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:37:28.318840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:37:49.901343 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:37:49.901303    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:37:58.699000 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:37:58.698966    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:38:21.399815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:38:21.399758    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:38:31.605863 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:38:31.605830    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:38:47.906118 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:38:47.906035    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:38:58.602040 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:38:58.601992    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:39:09.706788 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:39:09.706733    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:39:18.715415 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:39:18.715379    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:39:27.900842 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:39:27.900792    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:39:53.217275 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:39:53.217238    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:39:53.341715 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:39:53.341678    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:40:56.378882 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:40:56.378852    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:40:56.406944 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:40:56.406920    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:41:18.399786 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:41:18.399749    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:41:24.240906 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:41:24.240876    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:41:30.296956 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:41:30.296918    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:41:39.409642 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:41:39.406228    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:41:50.297595 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:41:50.297511    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:42:01.691851 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:42:01.691786    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:42:12.204699 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:42:12.204665    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:42:21.298387 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:42:21.298349    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:42:32.488045 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:42:32.488008    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:42:43.203347 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:42:43.203308    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:42:51.998954 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:42:51.998923    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:43:06.418892 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:43:06.418853    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:43:22.717090 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:43:22.717000    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:43:31.996291 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:43:31.996262    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:43:42.596873 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:43:42.596840    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:43:52.090363 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:43:52.090333    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:44:02.803292 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:44:02.803256    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:44:11.802193 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:44:11.802154    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:44:25.600593 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:44:25.600555    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:44:34.896167 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:44:34.896134    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:44:45.198130 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:44:45.198091    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:44:54.403867 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:44:54.403755    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:45:03.811638 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:45:03.811595    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:45:16.913402 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:45:16.913364    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:45:26.708412 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:45:26.708368    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:45:36.104294 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:45:36.104259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:45:38.730210 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:45:38.730169    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:45:45.897868 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:45:45.897832    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:45:56.410740 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:45:56.410711    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:45:56.434379 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:45:56.434352    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:45:58.615655 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:45:58.615622    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:46:07.208362 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:07.208324    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:46:14.055361 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:14.055319    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:46:19.413395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:19.413311    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:46:23.877472 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:23.877426    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:46:32.199697 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:32.199659    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:46:35.908216 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:35.908179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:46:43.699493 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:43.699459    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:46:49.441793 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:49.441752    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:46:49.538130 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:49.538096    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:46:49.923747 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:49.923712    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:46:55.805378 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:55.805345    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:46:55.880287 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:55.880251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:46:56.064865 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:56.064771    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:46:56.146066 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:56.146033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:46:57.273156 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:57.273120    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:46:57.434827 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:57.434768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:46:57.539316 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:57.539237    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:46:57.657615 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:57.657580    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:46:58.050690 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:58.050656    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:46:58.154694 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:58.154656    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:46:59.808466 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:46:59.808432    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:47:00.500066 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:00.500040    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:02.363233 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:02.363196    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:02.565358 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:02.565321    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:02.668550 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:02.668463    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:02.946515 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:02.946428    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:06.587198 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:06.587162    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:09.052594 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:09.052561    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:47:09.229498 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:09.229465    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:09.301151 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:09.301110    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:09.471553 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:09.471521    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:09.536001 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:09.535968    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:10.600214 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:10.600183    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:10.704651 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:10.704610    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:10.801745 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:10.801699    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:11.040461 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:11.040405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:11.255510 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:11.255462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:11.356894 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:11.356795    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:12.567010 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:12.566980    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:15.801102 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:15.801072    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:16.357765 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:16.357729    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:21.964072 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:21.964034    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:22.063929 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:22.063881    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:23.895749 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:23.895707    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:27.959462 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:27.959407    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:28.060691 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:28.060660    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:28.206736 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:28.206701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:28.308381 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:28.308294    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:29.384006 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:29.383970    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:29.481733 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:29.481698    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:29.560620 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:29.560556    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:29.876315 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:29.876280    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:30.128904 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:30.128786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:30.242168 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:30.242131    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:31.691930 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:31.691899    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:32.402871 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:32.402838    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:47:33.760295 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:33.760254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:33.965091 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:33.965057    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:34.045700 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:34.045610    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:34.214659 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:34.214631    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:38.002264 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:38.002226    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:39.930385 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:39.930352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:39.996979 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:39.996946    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:40.438756 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:40.438723    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:40.540491 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:40.540453    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:40.666154 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:40.666120    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:40.905846 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:40.905814    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:47:42.088919 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:42.088880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:48.265222 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:48.265127    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:48.334414 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:48.334371    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:48.431027 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:48.430990    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:48.551512 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:48.551428    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:48.642214 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:48.642179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:47:48.987379 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:47:48.987348    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:48:15.000643 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:48:15.000575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:48:21.100211 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:48:21.100173    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:48:21.234000 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:48:21.233955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:48:21.334757 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:48:21.334719    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:48:37.345852 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:48:37.345814    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:48:43.775201 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:48:43.775160    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:48:43.881385 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:48:43.881338    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:48:44.014696 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:48:44.014666    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:48:54.545467 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:48:54.545428    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:48:55.444995 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:48:55.444954    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:02.316433 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:02.316399    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:02.474012 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:02.473969    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:02.572201 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:02.572104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:03.504444 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:03.504403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:03.679953 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:03.679919    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:05.048398 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:05.048365    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:49:05.428635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:05.428546    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:11.936054 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:11.936020    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:12.035461 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:12.035428    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:12.618398 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:12.618365    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:49:12.621185 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:12.621155    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:19.805416 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:19.805335    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:19.912518 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:19.912476    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:20.103557 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:20.103459    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:20.249434 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:20.249398    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:49:20.559533 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:20.559501    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:20.820326 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:20.820199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:23.661269 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:23.661216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:24.074103 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:24.074047    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:24.385845 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:24.385731    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:24.800422 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:24.800387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:25.574298 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:25.574243    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:25.936622 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:25.936514    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:28.093267 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:28.093232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:28.877721 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:28.877682    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:29.036026 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:29.035994    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:49:29.089545 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:29.089505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:29.318255 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:29.318199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:35.747465 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:35.747420    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:35.875959 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:35.875915    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:37.273023 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:37.272970    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:37.598046 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:37.597953    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:37.867267 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:37.867176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:38.297676 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:38.297641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:38.634159 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:38.634072    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:41.928673 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:41.928636    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:49:45.662195 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:45.662136    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:45.799692 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:45.799646    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:46.011132 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:46.011103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:46.246573 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:46.246536    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:46.472525 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:46.472499    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:46.601665 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:46.601635    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:46.746906 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:46.746813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:53.198768 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:53.198731    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:53.532218 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:53.532181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:53.697921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:53.697886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:53.925893 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:53.925778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:49:54.061706 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:49:54.061654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:00.454760 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:00.454725    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:00.623267 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:00.623226    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:07.546458 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:07.546403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:08.130017 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:08.129969    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:08.375795 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:08.375757    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:11.679939 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:11.679883    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:11.818528 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:11.818483    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:12.033379 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:12.033347    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:12.512895 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:12.512868    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:12.647484 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:12.647454    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:16.096662 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:16.096617    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:19.537318 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:19.537279    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:50:28.186814 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:28.186777    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:28.283727 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:28.283690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:30.637470 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.637436    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"]
Jul 09 14:50:30.637878 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.637831    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c95060c4-2f7b-4b59-92e7-dd41cf1abfdf" containerName="authorino"
Jul 09 14:50:30.637878 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.637842    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c95060c4-2f7b-4b59-92e7-dd41cf1abfdf" containerName="authorino"
Jul 09 14:50:30.637968 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.637900    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c95060c4-2f7b-4b59-92e7-dd41cf1abfdf" containerName="authorino"
Jul 09 14:50:30.640931 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.640912    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.645612 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.645590    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5788dd92\"/\"kube-root-ca.crt\""
Jul 09 14:50:30.645729 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.645625    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5788dd92\"/\"default-dockercfg-sj7mx\""
Jul 09 14:50:30.645729 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.645599    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5788dd92\"/\"e2e-lifecycle-model-5788dd92-kserve-self-signed-certs\""
Jul 09 14:50:30.645729 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.645645    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5788dd92\"/\"openshift-service-ca.crt\""
Jul 09 14:50:30.667381 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.667358    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"]
Jul 09 14:50:30.724498 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.724471    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:30.755118 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.755082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-dshm\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.755259 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.755135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-tmp-dir\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.755259 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.755251    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03e465e3-d942-4d80-9c64-92d5bfcc27b1-tls-certs\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.755371 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.755284    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cghg\" (UniqueName: \"kubernetes.io/projected/03e465e3-d942-4d80-9c64-92d5bfcc27b1-kube-api-access-9cghg\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.755419 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.755377    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-model-cache\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.755419 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.755411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-home\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.856819 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.856760    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-model-cache\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.857015 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.856826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-home\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.857015 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.856881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-dshm\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.857015 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.856912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-tmp-dir\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.857015 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.856992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03e465e3-d942-4d80-9c64-92d5bfcc27b1-tls-certs\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.857238 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.857029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cghg\" (UniqueName: \"kubernetes.io/projected/03e465e3-d942-4d80-9c64-92d5bfcc27b1-kube-api-access-9cghg\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.857238 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.857206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-model-cache\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.857336 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.857270    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-home\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.857388 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.857369    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-tmp-dir\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.859407 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.859385    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-dshm\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.859641 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.859622    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03e465e3-d942-4d80-9c64-92d5bfcc27b1-tls-certs\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.867544 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.867524    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cghg\" (UniqueName: \"kubernetes.io/projected/03e465e3-d942-4d80-9c64-92d5bfcc27b1-kube-api-access-9cghg\") pod \"e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") " pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:30.950323 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:30.950285    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:31.095350 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:31.095327    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"]
Jul 09 14:50:31.097679 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:50:31.097654    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03e465e3_d942_4d80_9c64_92d5bfcc27b1.slice/crio-6b2efcfd743db13d8d5d4fd81ce84105bce1a1e6ae1b5fb21ce53fd9415e59e7 WatchSource:0}: Error finding container 6b2efcfd743db13d8d5d4fd81ce84105bce1a1e6ae1b5fb21ce53fd9415e59e7: Status 404 returned error can't find the container with id 6b2efcfd743db13d8d5d4fd81ce84105bce1a1e6ae1b5fb21ce53fd9415e59e7
Jul 09 14:50:32.030547 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:32.030511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh" event={"ID":"03e465e3-d942-4d80-9c64-92d5bfcc27b1","Type":"ContainerStarted","Data":"19642ca146b91d767eead234b37c665e19a5e096b2582106421382861408784b"}
Jul 09 14:50:32.030547 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:32.030550    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh" event={"ID":"03e465e3-d942-4d80-9c64-92d5bfcc27b1","Type":"ContainerStarted","Data":"6b2efcfd743db13d8d5d4fd81ce84105bce1a1e6ae1b5fb21ce53fd9415e59e7"}
Jul 09 14:50:33.918890 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:33.918838    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh" podStartSLOduration=3.918794642 podStartE2EDuration="3.918794642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:50:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:50:32.06637304 +0000 UTC m=+1776.093467420" watchObservedRunningTime="2026-07-09 14:50:33.918794642 +0000 UTC m=+1777.945889022"
Jul 09 14:50:33.920419 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:33.920402    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:50:34.857918 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:34.857887    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:34.970018 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:34.969970    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:40.950846 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:40.950792    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:40.951253 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:40.950868    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:40.963098 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:40.963067    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:41.083397 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:41.083369    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:50:51.427985 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:51.427902    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:50:54.037092 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:54.037058    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:55.578042 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:55.578005    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:50:56.442981 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:56.442955    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:50:56.465389 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:50:56.465365    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:51:00.121380 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:00.121344    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:51:05.107030 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:05.106993    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"]
Jul 09 14:51:05.192796 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:05.192758    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:51:05.919754 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:05.919721    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:51:20.128332 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.128284    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh" podUID="03e465e3-d942-4d80-9c64-92d5bfcc27b1" containerName="main" containerID="cri-o://19642ca146b91d767eead234b37c665e19a5e096b2582106421382861408784b" gracePeriod=45
Jul 09 14:51:20.267827 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.267766    2563 generic.go:356] "Generic (PLEG): container finished" podID="03e465e3-d942-4d80-9c64-92d5bfcc27b1" containerID="19642ca146b91d767eead234b37c665e19a5e096b2582106421382861408784b" exitCode=0
Jul 09 14:51:20.267968 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.267835    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh" event={"ID":"03e465e3-d942-4d80-9c64-92d5bfcc27b1","Type":"ContainerDied","Data":"19642ca146b91d767eead234b37c665e19a5e096b2582106421382861408784b"}
Jul 09 14:51:20.378426 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.378372    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:51:20.538714 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.538688    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-dshm\") pod \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") "
Jul 09 14:51:20.538902 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.538757    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cghg\" (UniqueName: \"kubernetes.io/projected/03e465e3-d942-4d80-9c64-92d5bfcc27b1-kube-api-access-9cghg\") pod \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") "
Jul 09 14:51:20.538902 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.538779    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-model-cache\") pod \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") "
Jul 09 14:51:20.538902 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.538891    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-tmp-dir\") pod \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") "
Jul 09 14:51:20.539028 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.538933    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-home\") pod \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") "
Jul 09 14:51:20.539028 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.538976    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03e465e3-d942-4d80-9c64-92d5bfcc27b1-tls-certs\") pod \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\" (UID: \"03e465e3-d942-4d80-9c64-92d5bfcc27b1\") "
Jul 09 14:51:20.539128 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.539078    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-model-cache" (OuterVolumeSpecName: "model-cache") pod "03e465e3-d942-4d80-9c64-92d5bfcc27b1" (UID: "03e465e3-d942-4d80-9c64-92d5bfcc27b1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:51:20.539128 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.539113    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "03e465e3-d942-4d80-9c64-92d5bfcc27b1" (UID: "03e465e3-d942-4d80-9c64-92d5bfcc27b1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:51:20.539267 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.539242    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-home" (OuterVolumeSpecName: "home") pod "03e465e3-d942-4d80-9c64-92d5bfcc27b1" (UID: "03e465e3-d942-4d80-9c64-92d5bfcc27b1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:51:20.539353 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.539334    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-model-cache\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:51:20.539395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.539362    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-tmp-dir\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:51:20.539395 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.539374    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-home\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:51:20.541162 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.541134    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03e465e3-d942-4d80-9c64-92d5bfcc27b1-kube-api-access-9cghg" (OuterVolumeSpecName: "kube-api-access-9cghg") pod "03e465e3-d942-4d80-9c64-92d5bfcc27b1" (UID: "03e465e3-d942-4d80-9c64-92d5bfcc27b1"). InnerVolumeSpecName "kube-api-access-9cghg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:51:20.541267 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.541168    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-dshm" (OuterVolumeSpecName: "dshm") pod "03e465e3-d942-4d80-9c64-92d5bfcc27b1" (UID: "03e465e3-d942-4d80-9c64-92d5bfcc27b1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:51:20.541267 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.541168    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03e465e3-d942-4d80-9c64-92d5bfcc27b1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "03e465e3-d942-4d80-9c64-92d5bfcc27b1" (UID: "03e465e3-d942-4d80-9c64-92d5bfcc27b1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:51:20.640354 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.640274    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cghg\" (UniqueName: \"kubernetes.io/projected/03e465e3-d942-4d80-9c64-92d5bfcc27b1-kube-api-access-9cghg\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:51:20.640354 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.640301    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03e465e3-d942-4d80-9c64-92d5bfcc27b1-tls-certs\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:51:20.640354 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:20.640313    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03e465e3-d942-4d80-9c64-92d5bfcc27b1-dshm\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:51:21.273572 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:21.273544    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"
Jul 09 14:51:21.274109 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:21.273544    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh" event={"ID":"03e465e3-d942-4d80-9c64-92d5bfcc27b1","Type":"ContainerDied","Data":"6b2efcfd743db13d8d5d4fd81ce84105bce1a1e6ae1b5fb21ce53fd9415e59e7"}
Jul 09 14:51:21.274109 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:21.273678    2563 scope.go:117] "RemoveContainer" containerID="19642ca146b91d767eead234b37c665e19a5e096b2582106421382861408784b"
Jul 09 14:51:21.312954 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:21.312924    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"]
Jul 09 14:51:21.316453 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:21.316431    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-5788dd92/e2e-lifecycle-model-5788dd92-kserve-86797cf655-lfjgh"]
Jul 09 14:51:22.000658 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:22.000621    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:51:22.460036 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:22.460005    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03e465e3-d942-4d80-9c64-92d5bfcc27b1" path="/var/lib/kubelet/pods/03e465e3-d942-4d80-9c64-92d5bfcc27b1/volumes"
Jul 09 14:51:43.000257 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:43.000223    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:51:44.628831 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:44.628778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:51:46.446020 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:46.445977    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:51:52.411428 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:52.411392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:51:52.569064 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:52.569034    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:51:52.826912 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:52.826876    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:51:53.111449 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:53.111352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:51:54.446222 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:54.446188    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:51:54.751772 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:54.751737    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:51:55.818035 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:55.817908    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:51:56.118084 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:56.117986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:51:57.394708 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:51:57.394671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:52:03.537736 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:03.537698    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:52:06.950026 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:06.949983    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:52:07.126279 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:07.126250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:52:07.854258 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:07.854212    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:52:13.917172 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:13.917130    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:52:16.418172 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:16.418137    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:52:16.618527 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:16.618489    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:52:16.905068 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:16.905033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:52:27.418297 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:27.418253    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:52:27.818672 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:27.818631    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:52:48.795719 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:48.795676    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:52:55.664254 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:55.664222    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:52:55.776503 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:55.776468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:52:56.050265 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:56.050224    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:52:56.538245 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:56.538212    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:52:56.698310 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:56.698276    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:52:59.610488 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:59.610452    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:52:59.790113 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:52:59.790073    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:00.001383 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:00.001345    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:00.317853 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:00.317742    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:00.899711 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:00.899679    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:01.065132 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:01.065094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:04.039922 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:04.039882    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:04.407777 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:04.407662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:04.834860 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:04.834827    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:05.180349 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:05.180261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:07.608339 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:07.608300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:07.749134 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:07.749092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:07.767596 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:07.767565    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:53:07.874290 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:07.874218    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:08.271612 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:08.271583    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:08.838685 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:08.838646    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:08.938114 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:08.938069    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:12.040682 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:12.040645    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:16.512755 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.512720    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"]
Jul 09 14:53:16.513165 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.513151    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03e465e3-d942-4d80-9c64-92d5bfcc27b1" containerName="main"
Jul 09 14:53:16.513211 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.513166    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03e465e3-d942-4d80-9c64-92d5bfcc27b1" containerName="main"
Jul 09 14:53:16.513290 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.513241    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="03e465e3-d942-4d80-9c64-92d5bfcc27b1" containerName="main"
Jul 09 14:53:16.516390 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.516373    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.522155 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.522136    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-bf99b0\"/\"kube-root-ca.crt\""
Jul 09 14:53:16.522477 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.522460    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-bf99b0\"/\"default-dockercfg-js7dz\""
Jul 09 14:53:16.522575 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.522482    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-bf99b0\"/\"openshift-service-ca.crt\""
Jul 09 14:53:16.522575 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.522486    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-bf99b0\"/\"test-model-bf99b0-kserve-self-signed-certs\""
Jul 09 14:53:16.532494 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.532472    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"]
Jul 09 14:53:16.619616 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.619585    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acebe722-f798-4e19-b1b5-81e776386511-tls-certs\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.619765 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.619629    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-model-cache\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.619765 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.619660    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-dshm\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.619765 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.619714    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-tmp-dir\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.619765 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.619748    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzfph\" (UniqueName: \"kubernetes.io/projected/acebe722-f798-4e19-b1b5-81e776386511-kube-api-access-jzfph\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.619924 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.619818    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-home\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.647838 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.647780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:16.720571 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.720546    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-dshm\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.720739 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.720587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-tmp-dir\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.720739 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.720626    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzfph\" (UniqueName: \"kubernetes.io/projected/acebe722-f798-4e19-b1b5-81e776386511-kube-api-access-jzfph\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.720739 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.720678    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-home\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.720739 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.720724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acebe722-f798-4e19-b1b5-81e776386511-tls-certs\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.720986 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.720751    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-model-cache\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.721235 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.721212    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-tmp-dir\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.721235 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.721224    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-home\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.721348 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.721310    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-model-cache\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.723237 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.723212    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-dshm\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.723397 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.723377    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acebe722-f798-4e19-b1b5-81e776386511-tls-certs\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.732790 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.732767    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzfph\" (UniqueName: \"kubernetes.io/projected/acebe722-f798-4e19-b1b5-81e776386511-kube-api-access-jzfph\") pod \"test-model-bf99b0-kserve-67ffb6b9b9-kv8wc\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") " pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.825189 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.825111    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:16.961848 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:16.961816    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"]
Jul 09 14:53:16.964931 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:53:16.964909    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacebe722_f798_4e19_b1b5_81e776386511.slice/crio-09e751dc4e9c7a43a7b9f473c545b0a51775019586b3e2262853e10651858a62 WatchSource:0}: Error finding container 09e751dc4e9c7a43a7b9f473c545b0a51775019586b3e2262853e10651858a62: Status 404 returned error can't find the container with id 09e751dc4e9c7a43a7b9f473c545b0a51775019586b3e2262853e10651858a62
Jul 09 14:53:17.829618 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:17.829581    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc" event={"ID":"acebe722-f798-4e19-b1b5-81e776386511","Type":"ContainerStarted","Data":"0c1391c95f93488486db3a4e789a34ad58e7f947e0ef21fcaa80c7b7cbde2901"}
Jul 09 14:53:17.829618 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:17.829626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc" event={"ID":"acebe722-f798-4e19-b1b5-81e776386511","Type":"ContainerStarted","Data":"09e751dc4e9c7a43a7b9f473c545b0a51775019586b3e2262853e10651858a62"}
Jul 09 14:53:17.860117 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:17.860069    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc" podStartSLOduration=1.86005538 podStartE2EDuration="1.86005538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:53:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:53:17.858405367 +0000 UTC m=+1941.885499747" watchObservedRunningTime="2026-07-09 14:53:17.86005538 +0000 UTC m=+1941.887149739"
Jul 09 14:53:19.121819 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:19.121764    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:53:21.937473 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:21.937440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:22.045154 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:22.045121    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:26.826070 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:26.826033    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:26.826486 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:26.826086    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:26.838482 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:26.838457    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:26.887522 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:26.887495    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:53:29.793825 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:29.793763    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:29.896238 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:29.896194    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:33.513240 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:33.513204    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:53:49.408525 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.408441    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"]
Jul 09 14:53:49.412431 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.412410    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.415291 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.415270    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ab1ad0\"/\"default-dockercfg-5sb95\""
Jul 09 14:53:49.416323 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.416307    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ab1ad0\"/\"kube-root-ca.crt\""
Jul 09 14:53:49.416451 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.416432    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ab1ad0\"/\"openshift-service-ca.crt\""
Jul 09 14:53:49.416510 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.416438    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ab1ad0\"/\"test-model-ab1ad0-kserve-self-signed-certs\""
Jul 09 14:53:49.424425 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.424404    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"]
Jul 09 14:53:49.469317 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.469286    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:53:49.535671 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.535642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-model-cache\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.535851 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.535698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-dshm\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.535851 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.535828    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rvr4\" (UniqueName: \"kubernetes.io/projected/ca684dd8-aead-4372-a4fa-45f21d87ed29-kube-api-access-9rvr4\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.535942 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.535892    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca684dd8-aead-4372-a4fa-45f21d87ed29-tls-certs\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.535942 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.535927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-tmp-dir\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.536088 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.536064    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-home\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.637009 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.636975    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-home\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.637183 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.637040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-model-cache\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.637183 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.637071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-dshm\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.637183 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.637108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rvr4\" (UniqueName: \"kubernetes.io/projected/ca684dd8-aead-4372-a4fa-45f21d87ed29-kube-api-access-9rvr4\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.637183 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.637156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca684dd8-aead-4372-a4fa-45f21d87ed29-tls-certs\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.637404 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.637183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-tmp-dir\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.637481 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.637457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-home\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.637528 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.637485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-model-cache\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.637568 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.637527    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-tmp-dir\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.639508 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.639485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-dshm\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.639717 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.639698    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca684dd8-aead-4372-a4fa-45f21d87ed29-tls-certs\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.648066 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.648039    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rvr4\" (UniqueName: \"kubernetes.io/projected/ca684dd8-aead-4372-a4fa-45f21d87ed29-kube-api-access-9rvr4\") pod \"test-model-ab1ad0-kserve-5884f944b7-rgnzp\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") " pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.722809 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.722780    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:49.858393 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.858363    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"]
Jul 09 14:53:49.861660 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:53:49.861629    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca684dd8_aead_4372_a4fa_45f21d87ed29.slice/crio-d46add7745461056591d3f9c85e699c7802e35542ed24773af650f2acffdb7ea WatchSource:0}: Error finding container d46add7745461056591d3f9c85e699c7802e35542ed24773af650f2acffdb7ea: Status 404 returned error can't find the container with id d46add7745461056591d3f9c85e699c7802e35542ed24773af650f2acffdb7ea
Jul 09 14:53:49.987898 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.987822    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp" event={"ID":"ca684dd8-aead-4372-a4fa-45f21d87ed29","Type":"ContainerStarted","Data":"71fff11f820e064ba882673a2ddc0ae268a946af29dff9628bee41a379815b92"}
Jul 09 14:53:49.987898 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:49.987862    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp" event={"ID":"ca684dd8-aead-4372-a4fa-45f21d87ed29","Type":"ContainerStarted","Data":"d46add7745461056591d3f9c85e699c7802e35542ed24773af650f2acffdb7ea"}
Jul 09 14:53:50.011695 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:50.011652    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp" podStartSLOduration=1.01163694 podStartE2EDuration="1.01163694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:53:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:53:50.011111533 +0000 UTC m=+1974.038205913" watchObservedRunningTime="2026-07-09 14:53:50.01163694 +0000 UTC m=+1974.038731344"
Jul 09 14:53:54.108163 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:54.108112    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:53:59.723767 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:59.723730    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:59.724161 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:59.723817    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:53:59.736367 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:53:59.736347    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:54:00.051094 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:00.051010    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:54:08.415270 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:08.415224    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:54:10.906202 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:10.906167    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"]
Jul 09 14:54:10.923114 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:10.923074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:11.936457 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:11.936427    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"]
Jul 09 14:54:11.964678 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:11.964634    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:12.155159 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:12.155127    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:12.588296 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:12.588251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:12.807283 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:12.807249    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:12.908390 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:12.908303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:13.112576 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:13.112540    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:17.641301 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:17.641260    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:22.414971 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:22.414937    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:22.519905 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:22.519870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:25.411740 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:25.411706    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:54:25.926697 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:25.926631    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc" podUID="acebe722-f798-4e19-b1b5-81e776386511" containerName="main" containerID="cri-o://0c1391c95f93488486db3a4e789a34ad58e7f947e0ef21fcaa80c7b7cbde2901" gracePeriod=45
Jul 09 14:54:26.170723 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.170513    2563 generic.go:356] "Generic (PLEG): container finished" podID="acebe722-f798-4e19-b1b5-81e776386511" containerID="0c1391c95f93488486db3a4e789a34ad58e7f947e0ef21fcaa80c7b7cbde2901" exitCode=0
Jul 09 14:54:26.170723 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.170545    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc" event={"ID":"acebe722-f798-4e19-b1b5-81e776386511","Type":"ContainerDied","Data":"0c1391c95f93488486db3a4e789a34ad58e7f947e0ef21fcaa80c7b7cbde2901"}
Jul 09 14:54:26.170723 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.170573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc" event={"ID":"acebe722-f798-4e19-b1b5-81e776386511","Type":"ContainerDied","Data":"09e751dc4e9c7a43a7b9f473c545b0a51775019586b3e2262853e10651858a62"}
Jul 09 14:54:26.170723 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.170584    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09e751dc4e9c7a43a7b9f473c545b0a51775019586b3e2262853e10651858a62"
Jul 09 14:54:26.186831 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.186743    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:54:26.291839 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.291772    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acebe722-f798-4e19-b1b5-81e776386511-tls-certs\") pod \"acebe722-f798-4e19-b1b5-81e776386511\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") "
Jul 09 14:54:26.292002 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.291871    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-dshm\") pod \"acebe722-f798-4e19-b1b5-81e776386511\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") "
Jul 09 14:54:26.292002 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.291936    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-tmp-dir\") pod \"acebe722-f798-4e19-b1b5-81e776386511\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") "
Jul 09 14:54:26.292002 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.291968    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzfph\" (UniqueName: \"kubernetes.io/projected/acebe722-f798-4e19-b1b5-81e776386511-kube-api-access-jzfph\") pod \"acebe722-f798-4e19-b1b5-81e776386511\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") "
Jul 09 14:54:26.292122 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.292004    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-home\") pod \"acebe722-f798-4e19-b1b5-81e776386511\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") "
Jul 09 14:54:26.292122 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.292038    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-model-cache\") pod \"acebe722-f798-4e19-b1b5-81e776386511\" (UID: \"acebe722-f798-4e19-b1b5-81e776386511\") "
Jul 09 14:54:26.292305 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.292245    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "acebe722-f798-4e19-b1b5-81e776386511" (UID: "acebe722-f798-4e19-b1b5-81e776386511"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:54:26.292305 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.292262    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-home" (OuterVolumeSpecName: "home") pod "acebe722-f798-4e19-b1b5-81e776386511" (UID: "acebe722-f798-4e19-b1b5-81e776386511"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:54:26.292517 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.292370    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-model-cache" (OuterVolumeSpecName: "model-cache") pod "acebe722-f798-4e19-b1b5-81e776386511" (UID: "acebe722-f798-4e19-b1b5-81e776386511"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:54:26.292517 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.292454    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-tmp-dir\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:54:26.292517 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.292469    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-home\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:54:26.292517 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.292477    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-model-cache\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:54:26.294265 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.294243    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acebe722-f798-4e19-b1b5-81e776386511-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "acebe722-f798-4e19-b1b5-81e776386511" (UID: "acebe722-f798-4e19-b1b5-81e776386511"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:54:26.294731 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.294707    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-dshm" (OuterVolumeSpecName: "dshm") pod "acebe722-f798-4e19-b1b5-81e776386511" (UID: "acebe722-f798-4e19-b1b5-81e776386511"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:54:26.294847 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.294734    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acebe722-f798-4e19-b1b5-81e776386511-kube-api-access-jzfph" (OuterVolumeSpecName: "kube-api-access-jzfph") pod "acebe722-f798-4e19-b1b5-81e776386511" (UID: "acebe722-f798-4e19-b1b5-81e776386511"). InnerVolumeSpecName "kube-api-access-jzfph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:54:26.393246 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.393213    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acebe722-f798-4e19-b1b5-81e776386511-dshm\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:54:26.393246 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.393239    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzfph\" (UniqueName: \"kubernetes.io/projected/acebe722-f798-4e19-b1b5-81e776386511-kube-api-access-jzfph\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:54:26.393246 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.393250    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acebe722-f798-4e19-b1b5-81e776386511-tls-certs\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:54:26.957073 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:26.957022    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp" podUID="ca684dd8-aead-4372-a4fa-45f21d87ed29" containerName="main" containerID="cri-o://71fff11f820e064ba882673a2ddc0ae268a946af29dff9628bee41a379815b92" gracePeriod=45
Jul 09 14:54:27.176949 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.176914    2563 generic.go:356] "Generic (PLEG): container finished" podID="ca684dd8-aead-4372-a4fa-45f21d87ed29" containerID="71fff11f820e064ba882673a2ddc0ae268a946af29dff9628bee41a379815b92" exitCode=0
Jul 09 14:54:27.177115 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.176973    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp" event={"ID":"ca684dd8-aead-4372-a4fa-45f21d87ed29","Type":"ContainerDied","Data":"71fff11f820e064ba882673a2ddc0ae268a946af29dff9628bee41a379815b92"}
Jul 09 14:54:27.177115 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.177041    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"
Jul 09 14:54:27.194944 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.194917    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"]
Jul 09 14:54:27.198667 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.198646    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-bf99b0/test-model-bf99b0-kserve-67ffb6b9b9-kv8wc"]
Jul 09 14:54:27.212755 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.212705    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:54:27.301515 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.301479    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-home\") pod \"ca684dd8-aead-4372-a4fa-45f21d87ed29\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") "
Jul 09 14:54:27.301693 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.301523    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rvr4\" (UniqueName: \"kubernetes.io/projected/ca684dd8-aead-4372-a4fa-45f21d87ed29-kube-api-access-9rvr4\") pod \"ca684dd8-aead-4372-a4fa-45f21d87ed29\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") "
Jul 09 14:54:27.301693 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.301549    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-dshm\") pod \"ca684dd8-aead-4372-a4fa-45f21d87ed29\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") "
Jul 09 14:54:27.301693 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.301628    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-model-cache\") pod \"ca684dd8-aead-4372-a4fa-45f21d87ed29\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") "
Jul 09 14:54:27.301693 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.301679    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca684dd8-aead-4372-a4fa-45f21d87ed29-tls-certs\") pod \"ca684dd8-aead-4372-a4fa-45f21d87ed29\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") "
Jul 09 14:54:27.301934 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.301753    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-tmp-dir\") pod \"ca684dd8-aead-4372-a4fa-45f21d87ed29\" (UID: \"ca684dd8-aead-4372-a4fa-45f21d87ed29\") "
Jul 09 14:54:27.301934 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.301773    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-home" (OuterVolumeSpecName: "home") pod "ca684dd8-aead-4372-a4fa-45f21d87ed29" (UID: "ca684dd8-aead-4372-a4fa-45f21d87ed29"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:54:27.302028 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.301930    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-model-cache" (OuterVolumeSpecName: "model-cache") pod "ca684dd8-aead-4372-a4fa-45f21d87ed29" (UID: "ca684dd8-aead-4372-a4fa-45f21d87ed29"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:54:27.302067 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.302032    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ca684dd8-aead-4372-a4fa-45f21d87ed29" (UID: "ca684dd8-aead-4372-a4fa-45f21d87ed29"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:54:27.302195 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.302176    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-tmp-dir\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:54:27.302248 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.302202    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-home\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:54:27.302248 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.302215    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-model-cache\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:54:27.303930 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.303907    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca684dd8-aead-4372-a4fa-45f21d87ed29-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ca684dd8-aead-4372-a4fa-45f21d87ed29" (UID: "ca684dd8-aead-4372-a4fa-45f21d87ed29"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:54:27.303930 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.303922    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca684dd8-aead-4372-a4fa-45f21d87ed29-kube-api-access-9rvr4" (OuterVolumeSpecName: "kube-api-access-9rvr4") pod "ca684dd8-aead-4372-a4fa-45f21d87ed29" (UID: "ca684dd8-aead-4372-a4fa-45f21d87ed29"). InnerVolumeSpecName "kube-api-access-9rvr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:54:27.304073 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.303956    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-dshm" (OuterVolumeSpecName: "dshm") pod "ca684dd8-aead-4372-a4fa-45f21d87ed29" (UID: "ca684dd8-aead-4372-a4fa-45f21d87ed29"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:54:27.402839 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.402793    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rvr4\" (UniqueName: \"kubernetes.io/projected/ca684dd8-aead-4372-a4fa-45f21d87ed29-kube-api-access-9rvr4\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:54:27.402839 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.402834    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca684dd8-aead-4372-a4fa-45f21d87ed29-dshm\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:54:27.402839 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:27.402843    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca684dd8-aead-4372-a4fa-45f21d87ed29-tls-certs\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:54:28.182818 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:28.182771    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp" event={"ID":"ca684dd8-aead-4372-a4fa-45f21d87ed29","Type":"ContainerDied","Data":"d46add7745461056591d3f9c85e699c7802e35542ed24773af650f2acffdb7ea"}
Jul 09 14:54:28.182818 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:28.182786    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"
Jul 09 14:54:28.183257 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:28.182842    2563 scope.go:117] "RemoveContainer" containerID="71fff11f820e064ba882673a2ddc0ae268a946af29dff9628bee41a379815b92"
Jul 09 14:54:28.205279 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:28.205252    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"]
Jul 09 14:54:28.209652 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:28.209631    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-ab1ad0/test-model-ab1ad0-kserve-5884f944b7-rgnzp"]
Jul 09 14:54:28.459628 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:28.459586    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acebe722-f798-4e19-b1b5-81e776386511" path="/var/lib/kubelet/pods/acebe722-f798-4e19-b1b5-81e776386511/volumes"
Jul 09 14:54:28.460114 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:28.460094    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca684dd8-aead-4372-a4fa-45f21d87ed29" path="/var/lib/kubelet/pods/ca684dd8-aead-4372-a4fa-45f21d87ed29/volumes"
Jul 09 14:54:54.799155 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:54.799115    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:55.082157 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:55.082062    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:55.308460 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:55.308422    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:55.481929 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:55.481896    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:55.898568 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:55.898479    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:56.001756 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:56.001720    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:56.100023 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:56.099991    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:56.266519 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:56.266489    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:54:59.312939 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:54:59.312904    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:55:02.173291 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:02.173247    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:02.275929 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:02.275894    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:02.569619 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:02.569586    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:02.685544 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:02.685500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:03.029133 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:03.029095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:03.380084 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:03.379992    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:03.645525 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:03.645423    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:06.137213 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:06.137177    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:06.233562 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:06.233523    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:06.318722 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:06.318683    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:06.511826 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:06.511768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:06.832576 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:06.832491    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:06.931857 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:06.931820    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:10.642402 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:10.642368    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:11.157476 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:11.157438    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:11.473762 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:11.473733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:11.643480 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:11.643439    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:14.214402 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:14.214363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:14.319907 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:14.319865    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:14.448309 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:14.448246    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:14.532619 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:14.532535    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:55:14.565595 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:14.565550    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:15.151138 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:15.151104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:15.235213 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:15.235164    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:18.693120 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:18.693038    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:27.007495 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:27.007463    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:27.374744 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:27.374642    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:27.474836 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:27.474769    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:27.578097 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:27.578068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:27.881814 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:27.881765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:29.210923 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:29.210882    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:29.310715 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:29.310678    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:30.210408 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:30.210374    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:55:33.533521 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:33.533484    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:33.634589 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:33.634551    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:33.881031 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:33.880942    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:34.157753 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:34.157657    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:34.270567 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:34.270537    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:34.678237 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:34.678199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:34.930323 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:34.930234    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:35.040463 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:35.040426    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:35.289848 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:35.289780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:41.045889 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:41.045851    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:41.157192 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:41.157156    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:41.340000 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:41.339917    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:41.545152 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:41.545118    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:41.897587 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:41.897553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:42.235411 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:42.235368    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:42.619864 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:42.619764    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:45.450221 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:45.450192    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:45.586697 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:45.586660    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:45.721831 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:45.721788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:45.734616 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:45.734588    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:55:46.146133 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:46.146043    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:46.329041 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:46.328999    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:46.428570 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:46.428486    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:49.968690 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:49.968656    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:50.302114 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:50.302028    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:50.650956 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:50.650869    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:51.195541 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:51.195508    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:53.574617 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:53.574583    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:53.685059 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:53.685020    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:53.787415 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:53.787376    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:53.983731 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:53.983703    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:54.339734 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:54.339637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:54.465813 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:54.465773    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:56.477778 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:56.477748    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:55:56.496926 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:56.496906    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 14:55:57.982552 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:55:57.982514    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:00.015359 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:00.015325    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:56:08.404370 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:08.404333    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:08.496038 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:08.496012    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:15.254218 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:15.254175    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:15.354486 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:15.354445    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:18.497664 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.497624    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"]
Jul 09 14:56:18.498062 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.498042    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca684dd8-aead-4372-a4fa-45f21d87ed29" containerName="main"
Jul 09 14:56:18.498062 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.498054    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca684dd8-aead-4372-a4fa-45f21d87ed29" containerName="main"
Jul 09 14:56:18.498140 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.498073    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acebe722-f798-4e19-b1b5-81e776386511" containerName="main"
Jul 09 14:56:18.498140 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.498078    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="acebe722-f798-4e19-b1b5-81e776386511" containerName="main"
Jul 09 14:56:18.498202 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.498143    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="acebe722-f798-4e19-b1b5-81e776386511" containerName="main"
Jul 09 14:56:18.498202 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.498150    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca684dd8-aead-4372-a4fa-45f21d87ed29" containerName="main"
Jul 09 14:56:18.501065 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.501048    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.504832 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.504778    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0d877f\"/\"openshift-service-ca.crt\""
Jul 09 14:56:18.504951 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.504890    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0d877f\"/\"default-dockercfg-gmsw6\""
Jul 09 14:56:18.505015 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.504890    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0d877f\"/\"kube-root-ca.crt\""
Jul 09 14:56:18.505015 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.504891    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0d877f\"/\"auth-test-model-0d877f-kserve-self-signed-certs\""
Jul 09 14:56:18.510650 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.510622    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"]
Jul 09 14:56:18.525026 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.525002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:18.536084 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.536058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-model-cache\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.536208 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.536088    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45a65f05-48af-4b0b-b634-ef67140195b5-tls-certs\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.536208 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.536120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzc5f\" (UniqueName: \"kubernetes.io/projected/45a65f05-48af-4b0b-b634-ef67140195b5-kube-api-access-gzc5f\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.536208 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.536176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-dshm\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.536334 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.536283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-tmp-dir\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.536385 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.536333    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-home\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.637655 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.637623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-home\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.637833 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.637680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-model-cache\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.637833 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.637704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45a65f05-48af-4b0b-b634-ef67140195b5-tls-certs\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.637833 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.637752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzc5f\" (UniqueName: \"kubernetes.io/projected/45a65f05-48af-4b0b-b634-ef67140195b5-kube-api-access-gzc5f\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.637833 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.637785    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-dshm\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.638046 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.637856    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-tmp-dir\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.638129 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.638108    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-home\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.638192 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.638172    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-tmp-dir\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.638239 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.638166    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-model-cache\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.640035 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.640015    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-dshm\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.640211 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.640195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45a65f05-48af-4b0b-b634-ef67140195b5-tls-certs\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.646583 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.646565    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzc5f\" (UniqueName: \"kubernetes.io/projected/45a65f05-48af-4b0b-b634-ef67140195b5-kube-api-access-gzc5f\") pod \"auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") " pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.811037 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.810931    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:18.952168 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:18.952145    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"]
Jul 09 14:56:18.954308 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:56:18.954265    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45a65f05_48af_4b0b_b634_ef67140195b5.slice/crio-f50b52dd5abe7d4f3a7f7c8b6db825a7b66e66be8c52f8001b384f806f3e7be5 WatchSource:0}: Error finding container f50b52dd5abe7d4f3a7f7c8b6db825a7b66e66be8c52f8001b384f806f3e7be5: Status 404 returned error can't find the container with id f50b52dd5abe7d4f3a7f7c8b6db825a7b66e66be8c52f8001b384f806f3e7be5
Jul 09 14:56:19.743745 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:19.743714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc" event={"ID":"45a65f05-48af-4b0b-b634-ef67140195b5","Type":"ContainerStarted","Data":"00388ddc528923716a3456a9c04cc5369e83c208a623002e18bc997db5eaed20"}
Jul 09 14:56:19.744157 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:19.743753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc" event={"ID":"45a65f05-48af-4b0b-b634-ef67140195b5","Type":"ContainerStarted","Data":"f50b52dd5abe7d4f3a7f7c8b6db825a7b66e66be8c52f8001b384f806f3e7be5"}
Jul 09 14:56:19.773089 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:19.773041    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc" podStartSLOduration=1.773026497 podStartE2EDuration="1.773026497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:56:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:19.771019948 +0000 UTC m=+2123.798114330" watchObservedRunningTime="2026-07-09 14:56:19.773026497 +0000 UTC m=+2123.800120878"
Jul 09 14:56:21.814747 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:21.814713    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:56:22.255179 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:22.255140    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:28.811056 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:28.811008    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:28.811056 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:28.811064    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:28.823999 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:28.823969    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:56:29.806964 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:56:29.806930    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:57:01.747445 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.747404    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"]
Jul 09 14:57:01.751077 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.751060    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.757618 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.757287    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d74e21\"/\"openshift-service-ca.crt\""
Jul 09 14:57:01.757618 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.757508    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d74e21\"/\"auth-test-model-d74e21-kserve-self-signed-certs\""
Jul 09 14:57:01.757618 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.757530    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d74e21\"/\"kube-root-ca.crt\""
Jul 09 14:57:01.757815 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.757791    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d74e21\"/\"default-dockercfg-sccsf\""
Jul 09 14:57:01.765720 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.765697    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"]
Jul 09 14:57:01.804191 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.804153    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:01.841108 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.841084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-tls-certs\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.841259 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.841134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-tmp-dir\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.841259 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.841202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkxjf\" (UniqueName: \"kubernetes.io/projected/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-kube-api-access-tkxjf\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.841353 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.841292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-dshm\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.841353 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.841335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-model-cache\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.841428 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.841413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-home\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.942239 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.942199    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-tmp-dir\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.942239 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.942244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkxjf\" (UniqueName: \"kubernetes.io/projected/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-kube-api-access-tkxjf\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.942464 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.942308    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-dshm\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.942464 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.942346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-model-cache\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.942464 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.942422    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-home\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.942610 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.942559    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-tls-certs\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.942668 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.942656    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-tmp-dir\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.942725 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.942708    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-home\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.942852 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.942834    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-model-cache\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.944619 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.944596    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-dshm\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.945043 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.945025    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-tls-certs\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:01.952743 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:01.952674    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkxjf\" (UniqueName: \"kubernetes.io/projected/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-kube-api-access-tkxjf\") pod \"auth-test-model-d74e21-kserve-54b9f5694c-vgxbc\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") " pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:02.060490 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:02.060408    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:02.205862 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:02.205742    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"]
Jul 09 14:57:02.208677 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:57:02.208645    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2abb8e63_f2c8_4dbd_ab32_b61f8116f1d7.slice/crio-364fc8053891f2f669eef595c4b9dffe10b367c7587734023880803602e485c3 WatchSource:0}: Error finding container 364fc8053891f2f669eef595c4b9dffe10b367c7587734023880803602e485c3: Status 404 returned error can't find the container with id 364fc8053891f2f669eef595c4b9dffe10b367c7587734023880803602e485c3
Jul 09 14:57:02.960328 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:02.960284    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc" event={"ID":"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7","Type":"ContainerStarted","Data":"ae5885aa2f63c265e4d5f599acf4a6403567be1322300e805114435c6b1563f7"}
Jul 09 14:57:02.960328 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:02.960329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc" event={"ID":"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7","Type":"ContainerStarted","Data":"364fc8053891f2f669eef595c4b9dffe10b367c7587734023880803602e485c3"}
Jul 09 14:57:02.988623 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:02.988570    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc" podStartSLOduration=1.988555069 podStartE2EDuration="1.988555069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:02.987195546 +0000 UTC m=+2167.014289927" watchObservedRunningTime="2026-07-09 14:57:02.988555069 +0000 UTC m=+2167.015649450"
Jul 09 14:57:06.109289 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:06.109252    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:57:12.061192 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:12.061156    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:12.061591 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:12.061212    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:12.073898 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:12.073876    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:13.019516 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:13.019491    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:57:21.391843 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:21.391784    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:57:38.053096 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:38.053057    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:57:54.107315 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:57:54.107234    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:58:12.604593 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:58:12.604557    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:58:31.600179 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:58:31.600099    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:58:41.808085 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:58:41.808050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:50.403419 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:58:50.403382    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:59:05.022886 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:05.022854    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"]
Jul 09 14:59:05.045588 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:05.045555    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:05.986913 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:05.986881    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"]
Jul 09 14:59:06.007311 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:06.007277    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:09.103821 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:09.103765    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:59:09.885135 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:09.885102    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:09.986989 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:09.986957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:17.128809 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:17.128768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:20.043458 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.043418    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc" podUID="45a65f05-48af-4b0b-b634-ef67140195b5" containerName="main" containerID="cri-o://00388ddc528923716a3456a9c04cc5369e83c208a623002e18bc997db5eaed20" gracePeriod=45
Jul 09 14:59:20.302275 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.302216    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:59:20.402170 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.402126    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-home\") pod \"45a65f05-48af-4b0b-b634-ef67140195b5\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") "
Jul 09 14:59:20.402371 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.402199    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45a65f05-48af-4b0b-b634-ef67140195b5-tls-certs\") pod \"45a65f05-48af-4b0b-b634-ef67140195b5\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") "
Jul 09 14:59:20.402371 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.402263    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-tmp-dir\") pod \"45a65f05-48af-4b0b-b634-ef67140195b5\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") "
Jul 09 14:59:20.402371 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.402290    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzc5f\" (UniqueName: \"kubernetes.io/projected/45a65f05-48af-4b0b-b634-ef67140195b5-kube-api-access-gzc5f\") pod \"45a65f05-48af-4b0b-b634-ef67140195b5\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") "
Jul 09 14:59:20.402371 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.402317    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-model-cache\") pod \"45a65f05-48af-4b0b-b634-ef67140195b5\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") "
Jul 09 14:59:20.402371 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.402338    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-dshm\") pod \"45a65f05-48af-4b0b-b634-ef67140195b5\" (UID: \"45a65f05-48af-4b0b-b634-ef67140195b5\") "
Jul 09 14:59:20.402635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.402417    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-home" (OuterVolumeSpecName: "home") pod "45a65f05-48af-4b0b-b634-ef67140195b5" (UID: "45a65f05-48af-4b0b-b634-ef67140195b5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:59:20.402635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.402611    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "45a65f05-48af-4b0b-b634-ef67140195b5" (UID: "45a65f05-48af-4b0b-b634-ef67140195b5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:59:20.402635 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.402619    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-model-cache" (OuterVolumeSpecName: "model-cache") pod "45a65f05-48af-4b0b-b634-ef67140195b5" (UID: "45a65f05-48af-4b0b-b634-ef67140195b5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:59:20.402761 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.402623    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-home\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:59:20.404607 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.404581    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45a65f05-48af-4b0b-b634-ef67140195b5-kube-api-access-gzc5f" (OuterVolumeSpecName: "kube-api-access-gzc5f") pod "45a65f05-48af-4b0b-b634-ef67140195b5" (UID: "45a65f05-48af-4b0b-b634-ef67140195b5"). InnerVolumeSpecName "kube-api-access-gzc5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:59:20.404607 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.404589    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-dshm" (OuterVolumeSpecName: "dshm") pod "45a65f05-48af-4b0b-b634-ef67140195b5" (UID: "45a65f05-48af-4b0b-b634-ef67140195b5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:59:20.404607 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.404600    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45a65f05-48af-4b0b-b634-ef67140195b5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "45a65f05-48af-4b0b-b634-ef67140195b5" (UID: "45a65f05-48af-4b0b-b634-ef67140195b5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:59:20.503480 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.503443    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45a65f05-48af-4b0b-b634-ef67140195b5-tls-certs\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:59:20.503480 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.503469    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-tmp-dir\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:59:20.503480 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.503479    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzc5f\" (UniqueName: \"kubernetes.io/projected/45a65f05-48af-4b0b-b634-ef67140195b5-kube-api-access-gzc5f\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:59:20.503480 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.503487    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-model-cache\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:59:20.503730 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.503495    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45a65f05-48af-4b0b-b634-ef67140195b5-dshm\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:59:20.637398 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.637307    2563 generic.go:356] "Generic (PLEG): container finished" podID="45a65f05-48af-4b0b-b634-ef67140195b5" containerID="00388ddc528923716a3456a9c04cc5369e83c208a623002e18bc997db5eaed20" exitCode=0
Jul 09 14:59:20.637398 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.637372    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"
Jul 09 14:59:20.637587 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.637390    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc" event={"ID":"45a65f05-48af-4b0b-b634-ef67140195b5","Type":"ContainerDied","Data":"00388ddc528923716a3456a9c04cc5369e83c208a623002e18bc997db5eaed20"}
Jul 09 14:59:20.637587 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.637432    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc" event={"ID":"45a65f05-48af-4b0b-b634-ef67140195b5","Type":"ContainerDied","Data":"f50b52dd5abe7d4f3a7f7c8b6db825a7b66e66be8c52f8001b384f806f3e7be5"}
Jul 09 14:59:20.637587 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.637450    2563 scope.go:117] "RemoveContainer" containerID="00388ddc528923716a3456a9c04cc5369e83c208a623002e18bc997db5eaed20"
Jul 09 14:59:20.646577 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.646562    2563 scope.go:117] "RemoveContainer" containerID="00388ddc528923716a3456a9c04cc5369e83c208a623002e18bc997db5eaed20"
Jul 09 14:59:20.646856 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:59:20.646838    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00388ddc528923716a3456a9c04cc5369e83c208a623002e18bc997db5eaed20\": container with ID starting with 00388ddc528923716a3456a9c04cc5369e83c208a623002e18bc997db5eaed20 not found: ID does not exist" containerID="00388ddc528923716a3456a9c04cc5369e83c208a623002e18bc997db5eaed20"
Jul 09 14:59:20.646910 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.646865    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00388ddc528923716a3456a9c04cc5369e83c208a623002e18bc997db5eaed20"} err="failed to get container status \"00388ddc528923716a3456a9c04cc5369e83c208a623002e18bc997db5eaed20\": rpc error: code = NotFound desc = could not find container \"00388ddc528923716a3456a9c04cc5369e83c208a623002e18bc997db5eaed20\": container with ID starting with 00388ddc528923716a3456a9c04cc5369e83c208a623002e18bc997db5eaed20 not found: ID does not exist"
Jul 09 14:59:20.654859 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.654789    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"]
Jul 09 14:59:20.659391 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:20.659367    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0d877f/auth-test-model-0d877f-kserve-5b6b5d694c-hc5dc"]
Jul 09 14:59:21.007522 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.007485    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc" podUID="2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7" containerName="main" containerID="cri-o://ae5885aa2f63c265e4d5f599acf4a6403567be1322300e805114435c6b1563f7" gracePeriod=45
Jul 09 14:59:21.262850 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.262774    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:59:21.310917 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.310892    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-model-cache\") pod \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") "
Jul 09 14:59:21.311063 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.310932    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-tmp-dir\") pod \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") "
Jul 09 14:59:21.311063 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.310947    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-dshm\") pod \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") "
Jul 09 14:59:21.311063 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.310966    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-tls-certs\") pod \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") "
Jul 09 14:59:21.311063 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.311043    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkxjf\" (UniqueName: \"kubernetes.io/projected/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-kube-api-access-tkxjf\") pod \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") "
Jul 09 14:59:21.311225 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.311091    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-home\") pod \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\" (UID: \"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7\") "
Jul 09 14:59:21.311225 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.311153    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7" (UID: "2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:59:21.311225 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.311182    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-model-cache" (OuterVolumeSpecName: "model-cache") pod "2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7" (UID: "2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:59:21.311461 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.311434    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-home" (OuterVolumeSpecName: "home") pod "2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7" (UID: "2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:59:21.311461 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.311441    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-model-cache\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:59:21.311644 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.311486    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-tmp-dir\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:59:21.313336 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.313317    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7" (UID: "2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:59:21.313616 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.313595    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-kube-api-access-tkxjf" (OuterVolumeSpecName: "kube-api-access-tkxjf") pod "2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7" (UID: "2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7"). InnerVolumeSpecName "kube-api-access-tkxjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:59:21.313616 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.313603    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-dshm" (OuterVolumeSpecName: "dshm") pod "2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7" (UID: "2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:59:21.412513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.412480    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-dshm\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:59:21.412513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.412506    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-tls-certs\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:59:21.412513 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.412517    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkxjf\" (UniqueName: \"kubernetes.io/projected/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-kube-api-access-tkxjf\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:59:21.412757 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.412526    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7-home\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 14:59:21.644429 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.644342    2563 generic.go:356] "Generic (PLEG): container finished" podID="2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7" containerID="ae5885aa2f63c265e4d5f599acf4a6403567be1322300e805114435c6b1563f7" exitCode=0
Jul 09 14:59:21.644429 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.644383    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"
Jul 09 14:59:21.644760 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.644425    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc" event={"ID":"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7","Type":"ContainerDied","Data":"ae5885aa2f63c265e4d5f599acf4a6403567be1322300e805114435c6b1563f7"}
Jul 09 14:59:21.644760 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.644473    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc" event={"ID":"2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7","Type":"ContainerDied","Data":"364fc8053891f2f669eef595c4b9dffe10b367c7587734023880803602e485c3"}
Jul 09 14:59:21.644760 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.644495    2563 scope.go:117] "RemoveContainer" containerID="ae5885aa2f63c265e4d5f599acf4a6403567be1322300e805114435c6b1563f7"
Jul 09 14:59:21.653887 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.653871    2563 scope.go:117] "RemoveContainer" containerID="ae5885aa2f63c265e4d5f599acf4a6403567be1322300e805114435c6b1563f7"
Jul 09 14:59:21.654164 ip-10-0-140-234 kubenswrapper[2563]: E0709 14:59:21.654145    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae5885aa2f63c265e4d5f599acf4a6403567be1322300e805114435c6b1563f7\": container with ID starting with ae5885aa2f63c265e4d5f599acf4a6403567be1322300e805114435c6b1563f7 not found: ID does not exist" containerID="ae5885aa2f63c265e4d5f599acf4a6403567be1322300e805114435c6b1563f7"
Jul 09 14:59:21.654217 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.654173    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae5885aa2f63c265e4d5f599acf4a6403567be1322300e805114435c6b1563f7"} err="failed to get container status \"ae5885aa2f63c265e4d5f599acf4a6403567be1322300e805114435c6b1563f7\": rpc error: code = NotFound desc = could not find container \"ae5885aa2f63c265e4d5f599acf4a6403567be1322300e805114435c6b1563f7\": container with ID starting with ae5885aa2f63c265e4d5f599acf4a6403567be1322300e805114435c6b1563f7 not found: ID does not exist"
Jul 09 14:59:21.665877 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.665852    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"]
Jul 09 14:59:21.670108 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:21.670084    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/auth-test-model-d74e21-kserve-54b9f5694c-vgxbc"]
Jul 09 14:59:22.460668 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:22.460630    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7" path="/var/lib/kubelet/pods/2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7/volumes"
Jul 09 14:59:22.461076 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:22.461064    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45a65f05-48af-4b0b-b634-ef67140195b5" path="/var/lib/kubelet/pods/45a65f05-48af-4b0b-b634-ef67140195b5/volumes"
Jul 09 14:59:25.899579 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:25.899535    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:59:28.930462 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:28.930422    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:37.881091 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.881056    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"]
Jul 09 14:59:37.881661 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.881646    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7" containerName="main"
Jul 09 14:59:37.881706 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.881664    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7" containerName="main"
Jul 09 14:59:37.881706 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.881681    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a65f05-48af-4b0b-b634-ef67140195b5" containerName="main"
Jul 09 14:59:37.881706 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.881689    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a65f05-48af-4b0b-b634-ef67140195b5" containerName="main"
Jul 09 14:59:37.881817 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.881784    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="45a65f05-48af-4b0b-b634-ef67140195b5" containerName="main"
Jul 09 14:59:37.881866 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.881828    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2abb8e63-f2c8-4dbd-ab32-b61f8116f1d7" containerName="main"
Jul 09 14:59:37.885219 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.885199    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:37.887707 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.887686    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d74e21\"/\"kube-root-ca.crt\""
Jul 09 14:59:37.888791 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.888770    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d74e21\"/\"default-dockercfg-sccsf\""
Jul 09 14:59:37.888921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.888872    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d74e21\"/\"openshift-service-ca.crt\""
Jul 09 14:59:37.888921 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.888905    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d74e21\"/\"sub-test-model-d74e21-kserve-self-signed-certs\""
Jul 09 14:59:37.894984 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.894963    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"]
Jul 09 14:59:37.919834 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.919790    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:37.968142 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.968122    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-dshm\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:37.968250 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.968168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-tls-certs\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:37.968250 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.968201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-tmp-dir\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:37.968369 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.968255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-model-cache\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:37.968369 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.968338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-home\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:37.968476 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:37.968418    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bbkh\" (UniqueName: \"kubernetes.io/projected/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-kube-api-access-7bbkh\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:38.069304 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.069269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bbkh\" (UniqueName: \"kubernetes.io/projected/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-kube-api-access-7bbkh\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:38.069501 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.069333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-dshm\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:38.069501 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.069384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-tls-certs\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:38.069501 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.069416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-tmp-dir\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:38.069501 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.069443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-model-cache\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:38.069501 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.069491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-home\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:38.069895 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.069865    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-home\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:38.069986 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.069871    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-tmp-dir\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:38.069986 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.069906    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-model-cache\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:38.071834 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.071794    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-dshm\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:38.072094 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.072075    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-tls-certs\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:38.078103 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.078080    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bbkh\" (UniqueName: \"kubernetes.io/projected/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-kube-api-access-7bbkh\") pod \"sub-test-model-d74e21-kserve-6d874b7d5-s84gj\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") " pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:38.196454 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.196370    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:38.329047 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.329023    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"]
Jul 09 14:59:38.331141 ip-10-0-140-234 kubenswrapper[2563]: W0709 14:59:38.331111    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb636eff_f69d_4a66_b9c1_8fae9c66dfec.slice/crio-febdb92292617a66e4e24497a05e51cd987a53ff14510ffa58b03f5b4b2f87c0 WatchSource:0}: Error finding container febdb92292617a66e4e24497a05e51cd987a53ff14510ffa58b03f5b4b2f87c0: Status 404 returned error can't find the container with id febdb92292617a66e4e24497a05e51cd987a53ff14510ffa58b03f5b4b2f87c0
Jul 09 14:59:38.731419 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.731376    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj" event={"ID":"fb636eff-f69d-4a66-b9c1-8fae9c66dfec","Type":"ContainerStarted","Data":"6287e60dc66b645527169bef6bedced0430d8abde02ef9de8297fa5699cc2a8c"}
Jul 09 14:59:38.731586 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.731426    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj" event={"ID":"fb636eff-f69d-4a66-b9c1-8fae9c66dfec","Type":"ContainerStarted","Data":"febdb92292617a66e4e24497a05e51cd987a53ff14510ffa58b03f5b4b2f87c0"}
Jul 09 14:59:38.749173 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:38.749129    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj" podStartSLOduration=1.749114463 podStartE2EDuration="1.749114463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:59:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:59:38.747076673 +0000 UTC m=+2322.774171055" watchObservedRunningTime="2026-07-09 14:59:38.749114463 +0000 UTC m=+2322.776208843"
Jul 09 14:59:45.102761 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:45.102729    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 14:59:48.196932 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:48.196852    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:48.196932 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:48.196904    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:48.209256 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:48.209235    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:48.791880 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:48.791854    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 14:59:56.575420 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:56.575389    2563 scope.go:117] "RemoveContainer" containerID="0c1391c95f93488486db3a4e789a34ad58e7f947e0ef21fcaa80c7b7cbde2901"
Jul 09 14:59:59.704266 ip-10-0-140-234 kubenswrapper[2563]: I0709 14:59:59.704230    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 15:00:00.136913 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.136882    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg"]
Jul 09 15:00:00.141902 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.141884    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v"]
Jul 09 15:00:00.142020 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.141995    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg"
Jul 09 15:00:00.144511 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.144478    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-djq6x\""
Jul 09 15:00:00.144511 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.144497    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 15:00:00.144511 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.144478    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 15:00:00.145031 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.145017    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q"]
Jul 09 15:00:00.145137 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.145125    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v"
Jul 09 15:00:00.148436 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.148412    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q"
Jul 09 15:00:00.148571 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.148537    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg"]
Jul 09 15:00:00.153609 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.153585    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q"]
Jul 09 15:00:00.156181 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.156159    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v"]
Jul 09 15:00:00.189780 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.189752    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8t2h\" (UniqueName: \"kubernetes.io/projected/eead84e9-e770-4d21-bf11-e92868a6cde7-kube-api-access-z8t2h\") pod \"maas-api-key-cleanup-29726820-b684q\" (UID: \"eead84e9-e770-4d21-bf11-e92868a6cde7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q"
Jul 09 15:00:00.189929 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.189794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtswh\" (UniqueName: \"kubernetes.io/projected/8ae3a942-1c62-481b-a676-8b6855dc73bd-kube-api-access-wtswh\") pod \"maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg\" (UID: \"8ae3a942-1c62-481b-a676-8b6855dc73bd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg"
Jul 09 15:00:00.189929 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.189880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfqx2\" (UniqueName: \"kubernetes.io/projected/5d578ba8-6aa3-42f8-b179-fff8a253c98e-kube-api-access-jfqx2\") pod \"maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v\" (UID: \"5d578ba8-6aa3-42f8-b179-fff8a253c98e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v"
Jul 09 15:00:00.291180 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.291144    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8t2h\" (UniqueName: \"kubernetes.io/projected/eead84e9-e770-4d21-bf11-e92868a6cde7-kube-api-access-z8t2h\") pod \"maas-api-key-cleanup-29726820-b684q\" (UID: \"eead84e9-e770-4d21-bf11-e92868a6cde7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q"
Jul 09 15:00:00.291360 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.291198    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtswh\" (UniqueName: \"kubernetes.io/projected/8ae3a942-1c62-481b-a676-8b6855dc73bd-kube-api-access-wtswh\") pod \"maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg\" (UID: \"8ae3a942-1c62-481b-a676-8b6855dc73bd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg"
Jul 09 15:00:00.291360 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.291269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfqx2\" (UniqueName: \"kubernetes.io/projected/5d578ba8-6aa3-42f8-b179-fff8a253c98e-kube-api-access-jfqx2\") pod \"maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v\" (UID: \"5d578ba8-6aa3-42f8-b179-fff8a253c98e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v"
Jul 09 15:00:00.300147 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.300118    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfqx2\" (UniqueName: \"kubernetes.io/projected/5d578ba8-6aa3-42f8-b179-fff8a253c98e-kube-api-access-jfqx2\") pod \"maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v\" (UID: \"5d578ba8-6aa3-42f8-b179-fff8a253c98e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v"
Jul 09 15:00:00.300251 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.300118    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtswh\" (UniqueName: \"kubernetes.io/projected/8ae3a942-1c62-481b-a676-8b6855dc73bd-kube-api-access-wtswh\") pod \"maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg\" (UID: \"8ae3a942-1c62-481b-a676-8b6855dc73bd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg"
Jul 09 15:00:00.300306 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.300286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8t2h\" (UniqueName: \"kubernetes.io/projected/eead84e9-e770-4d21-bf11-e92868a6cde7-kube-api-access-z8t2h\") pod \"maas-api-key-cleanup-29726820-b684q\" (UID: \"eead84e9-e770-4d21-bf11-e92868a6cde7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q"
Jul 09 15:00:00.457295 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.457253    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg"
Jul 09 15:00:00.467696 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.467671    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v"
Jul 09 15:00:00.474318 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.474290    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q"
Jul 09 15:00:00.631487 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.631000    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg"]
Jul 09 15:00:00.636374 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.636353    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 15:00:00.655583 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.655488    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v"]
Jul 09 15:00:00.658386 ip-10-0-140-234 kubenswrapper[2563]: W0709 15:00:00.658355    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d578ba8_6aa3_42f8_b179_fff8a253c98e.slice/crio-95f811cc5220a3a8e58891e75e6da4ae5fa56d263e71df6b93669891c93f294b WatchSource:0}: Error finding container 95f811cc5220a3a8e58891e75e6da4ae5fa56d263e71df6b93669891c93f294b: Status 404 returned error can't find the container with id 95f811cc5220a3a8e58891e75e6da4ae5fa56d263e71df6b93669891c93f294b
Jul 09 15:00:00.677210 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.677187    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q"]
Jul 09 15:00:00.679389 ip-10-0-140-234 kubenswrapper[2563]: W0709 15:00:00.679366    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeead84e9_e770_4d21_bf11_e92868a6cde7.slice/crio-8218a2d9b63aaebfdad0891682f6ead979ff2a151dd0a678c1ef66e5ba6e1328 WatchSource:0}: Error finding container 8218a2d9b63aaebfdad0891682f6ead979ff2a151dd0a678c1ef66e5ba6e1328: Status 404 returned error can't find the container with id 8218a2d9b63aaebfdad0891682f6ead979ff2a151dd0a678c1ef66e5ba6e1328
Jul 09 15:00:00.843884 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.843759    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q" event={"ID":"eead84e9-e770-4d21-bf11-e92868a6cde7","Type":"ContainerStarted","Data":"8218a2d9b63aaebfdad0891682f6ead979ff2a151dd0a678c1ef66e5ba6e1328"}
Jul 09 15:00:00.844946 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.844920    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v" event={"ID":"5d578ba8-6aa3-42f8-b179-fff8a253c98e","Type":"ContainerStarted","Data":"95f811cc5220a3a8e58891e75e6da4ae5fa56d263e71df6b93669891c93f294b"}
Jul 09 15:00:00.846049 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:00.846025    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg" event={"ID":"8ae3a942-1c62-481b-a676-8b6855dc73bd","Type":"ContainerStarted","Data":"6f93bb7fd01802140952e8aec8ae9c77fabd1d973cda29c6523ce1e7ed96867a"}
Jul 09 15:00:05.878017 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:05.877972    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg" event={"ID":"8ae3a942-1c62-481b-a676-8b6855dc73bd","Type":"ContainerStarted","Data":"c3923cecf3f5db02592750a1e3a522dd2bafe5a2552df159c1b488f3dd9c1204"}
Jul 09 15:00:05.896829 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:05.896761    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg" podStartSLOduration=1.752251689 podStartE2EDuration="5.896744343s" totalImagesPullingTime="4.144492654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:00:05.895108434 +0000 UTC m=+2349.922202837" watchObservedRunningTime="2026-07-09 15:00:05.896744343 +0000 UTC m=+2349.923838726"
Jul 09 15:00:15.103655 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:15.103610    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:15.994675 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:15.994640    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"]
Jul 09 15:00:16.014951 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:16.014918    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:16.934247 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:16.934154    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q" event={"ID":"eead84e9-e770-4d21-bf11-e92868a6cde7","Type":"ContainerStarted","Data":"3d8a739fd81997fdfdc29f2577816876dcf10b7afd1f0ee35f6d6a9853bf0449"}
Jul 09 15:00:16.935748 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:16.935716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v" event={"ID":"5d578ba8-6aa3-42f8-b179-fff8a253c98e","Type":"ContainerStarted","Data":"23de4d9c438362824dbe373d7289d743ab81bdab5cceeb13c812a0dadc266cee"}
Jul 09 15:00:16.952278 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:16.952234    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q" podStartSLOduration=0.988456097 podStartE2EDuration="16.952218594s" totalImagesPullingTime="15.963762497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:00:16.950264814 +0000 UTC m=+2360.977359196" watchObservedRunningTime="2026-07-09 15:00:16.952218594 +0000 UTC m=+2360.979312952"
Jul 09 15:00:16.966966 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:16.966923    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v" podStartSLOduration=1.6654230970000001 podStartE2EDuration="16.966909376s" totalImagesPullingTime="15.301486279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:00:16.965360978 +0000 UTC m=+2360.992455361" watchObservedRunningTime="2026-07-09 15:00:16.966909376 +0000 UTC m=+2360.994003757"
Jul 09 15:00:20.593835 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:20.593787    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 15:00:20.735724 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:20.735683    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:29.885178 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:29.885143    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:29.986203 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:29.986164    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:31.017359 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.017321    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj" podUID="fb636eff-f69d-4a66-b9c1-8fae9c66dfec" containerName="main" containerID="cri-o://6287e60dc66b645527169bef6bedced0430d8abde02ef9de8297fa5699cc2a8c" gracePeriod=45
Jul 09 15:00:31.272875 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.272787    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 15:00:31.293913 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.293883    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-tls-certs\") pod \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") "
Jul 09 15:00:31.294122 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.293990    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-tmp-dir\") pod \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") "
Jul 09 15:00:31.294122 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.294029    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-home\") pod \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") "
Jul 09 15:00:31.294122 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.294054    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-dshm\") pod \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") "
Jul 09 15:00:31.294405 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.294132    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-model-cache\") pod \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") "
Jul 09 15:00:31.294405 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.294191    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bbkh\" (UniqueName: \"kubernetes.io/projected/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-kube-api-access-7bbkh\") pod \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\" (UID: \"fb636eff-f69d-4a66-b9c1-8fae9c66dfec\") "
Jul 09 15:00:31.294405 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.294217    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fb636eff-f69d-4a66-b9c1-8fae9c66dfec" (UID: "fb636eff-f69d-4a66-b9c1-8fae9c66dfec"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:00:31.294405 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.294314    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-home" (OuterVolumeSpecName: "home") pod "fb636eff-f69d-4a66-b9c1-8fae9c66dfec" (UID: "fb636eff-f69d-4a66-b9c1-8fae9c66dfec"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:00:31.294405 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.294394    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-model-cache" (OuterVolumeSpecName: "model-cache") pod "fb636eff-f69d-4a66-b9c1-8fae9c66dfec" (UID: "fb636eff-f69d-4a66-b9c1-8fae9c66dfec"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:00:31.294731 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.294559    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-model-cache\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 15:00:31.294731 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.294597    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-tmp-dir\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 15:00:31.294731 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.294609    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-home\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 15:00:31.296562 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.296538    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-kube-api-access-7bbkh" (OuterVolumeSpecName: "kube-api-access-7bbkh") pod "fb636eff-f69d-4a66-b9c1-8fae9c66dfec" (UID: "fb636eff-f69d-4a66-b9c1-8fae9c66dfec"). InnerVolumeSpecName "kube-api-access-7bbkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:00:31.296849 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.296826    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fb636eff-f69d-4a66-b9c1-8fae9c66dfec" (UID: "fb636eff-f69d-4a66-b9c1-8fae9c66dfec"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:00:31.296949 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.296826    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-dshm" (OuterVolumeSpecName: "dshm") pod "fb636eff-f69d-4a66-b9c1-8fae9c66dfec" (UID: "fb636eff-f69d-4a66-b9c1-8fae9c66dfec"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:00:31.395610 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.395574    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-tls-certs\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 15:00:31.395610 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.395605    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-dshm\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 15:00:31.395610 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:31.395619    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bbkh\" (UniqueName: \"kubernetes.io/projected/fb636eff-f69d-4a66-b9c1-8fae9c66dfec-kube-api-access-7bbkh\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 15:00:32.009632 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:32.009599    2563 generic.go:356] "Generic (PLEG): container finished" podID="fb636eff-f69d-4a66-b9c1-8fae9c66dfec" containerID="6287e60dc66b645527169bef6bedced0430d8abde02ef9de8297fa5699cc2a8c" exitCode=0
Jul 09 15:00:32.009632 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:32.009636    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"
Jul 09 15:00:32.009853 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:32.009680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj" event={"ID":"fb636eff-f69d-4a66-b9c1-8fae9c66dfec","Type":"ContainerDied","Data":"6287e60dc66b645527169bef6bedced0430d8abde02ef9de8297fa5699cc2a8c"}
Jul 09 15:00:32.009853 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:32.009721    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj" event={"ID":"fb636eff-f69d-4a66-b9c1-8fae9c66dfec","Type":"ContainerDied","Data":"febdb92292617a66e4e24497a05e51cd987a53ff14510ffa58b03f5b4b2f87c0"}
Jul 09 15:00:32.009853 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:32.009739    2563 scope.go:117] "RemoveContainer" containerID="6287e60dc66b645527169bef6bedced0430d8abde02ef9de8297fa5699cc2a8c"
Jul 09 15:00:32.019477 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:32.019324    2563 scope.go:117] "RemoveContainer" containerID="6287e60dc66b645527169bef6bedced0430d8abde02ef9de8297fa5699cc2a8c"
Jul 09 15:00:32.019699 ip-10-0-140-234 kubenswrapper[2563]: E0709 15:00:32.019594    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6287e60dc66b645527169bef6bedced0430d8abde02ef9de8297fa5699cc2a8c\": container with ID starting with 6287e60dc66b645527169bef6bedced0430d8abde02ef9de8297fa5699cc2a8c not found: ID does not exist" containerID="6287e60dc66b645527169bef6bedced0430d8abde02ef9de8297fa5699cc2a8c"
Jul 09 15:00:32.019699 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:32.019618    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6287e60dc66b645527169bef6bedced0430d8abde02ef9de8297fa5699cc2a8c"} err="failed to get container status \"6287e60dc66b645527169bef6bedced0430d8abde02ef9de8297fa5699cc2a8c\": rpc error: code = NotFound desc = could not find container \"6287e60dc66b645527169bef6bedced0430d8abde02ef9de8297fa5699cc2a8c\": container with ID starting with 6287e60dc66b645527169bef6bedced0430d8abde02ef9de8297fa5699cc2a8c not found: ID does not exist"
Jul 09 15:00:32.031345 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:32.031325    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"]
Jul 09 15:00:32.034988 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:32.034967    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/sub-test-model-d74e21-kserve-6d874b7d5-s84gj"]
Jul 09 15:00:32.460350 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:32.460321    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb636eff-f69d-4a66-b9c1-8fae9c66dfec" path="/var/lib/kubelet/pods/fb636eff-f69d-4a66-b9c1-8fae9c66dfec/volumes"
Jul 09 15:00:36.708140 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:36.708104    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 15:00:41.763401 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.763366    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"]
Jul 09 15:00:41.763844 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.763831    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb636eff-f69d-4a66-b9c1-8fae9c66dfec" containerName="main"
Jul 09 15:00:41.763906 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.763846    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb636eff-f69d-4a66-b9c1-8fae9c66dfec" containerName="main"
Jul 09 15:00:41.763940 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.763910    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb636eff-f69d-4a66-b9c1-8fae9c66dfec" containerName="main"
Jul 09 15:00:41.772041 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.772021    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:41.775632 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.775603    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d74e21\"/\"openshift-service-ca.crt\""
Jul 09 15:00:41.775767 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.775603    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d74e21\"/\"rate-test-model-d74e21-kserve-self-signed-certs\""
Jul 09 15:00:41.775767 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.775653    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d74e21\"/\"default-dockercfg-sccsf\""
Jul 09 15:00:41.775767 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.775617    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d74e21\"/\"kube-root-ca.crt\""
Jul 09 15:00:41.782037 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.782016    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"]
Jul 09 15:00:41.812116 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.812084    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:41.898360 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.898325    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-dshm\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:41.898531 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.898366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-model-cache\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:41.898531 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.898439    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-home\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:41.898531 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.898479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddaa04b8-49c5-448e-a585-317c53843e8a-tls-certs\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:41.898531 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.898499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-tmp-dir\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:41.898691 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.898536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms8tm\" (UniqueName: \"kubernetes.io/projected/ddaa04b8-49c5-448e-a585-317c53843e8a-kube-api-access-ms8tm\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:41.999251 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.999211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-dshm\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:41.999251 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.999258    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-model-cache\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:41.999494 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.999310    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-home\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:41.999494 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.999339    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddaa04b8-49c5-448e-a585-317c53843e8a-tls-certs\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:41.999494 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.999357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-tmp-dir\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:41.999494 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.999404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms8tm\" (UniqueName: \"kubernetes.io/projected/ddaa04b8-49c5-448e-a585-317c53843e8a-kube-api-access-ms8tm\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:41.999843 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.999820    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-model-cache\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:41.999925 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.999838    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-home\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:41.999925 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:41.999850    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-tmp-dir\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:42.001688 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:42.001669    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-dshm\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:42.001952 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:42.001936    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddaa04b8-49c5-448e-a585-317c53843e8a-tls-certs\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:42.010028 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:42.010006    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms8tm\" (UniqueName: \"kubernetes.io/projected/ddaa04b8-49c5-448e-a585-317c53843e8a-kube-api-access-ms8tm\") pod \"rate-test-model-d74e21-kserve-7cf7d98779-d96zn\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") " pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:42.082165 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:42.082068    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:42.222180 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:42.222154    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"]
Jul 09 15:00:42.224667 ip-10-0-140-234 kubenswrapper[2563]: W0709 15:00:42.224630    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddaa04b8_49c5_448e_a585_317c53843e8a.slice/crio-4cf2b532268b6180a7a7bd0b9690441f03e3e4f1ca448f09a764aef996869442 WatchSource:0}: Error finding container 4cf2b532268b6180a7a7bd0b9690441f03e3e4f1ca448f09a764aef996869442: Status 404 returned error can't find the container with id 4cf2b532268b6180a7a7bd0b9690441f03e3e4f1ca448f09a764aef996869442
Jul 09 15:00:43.066402 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:43.066364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn" event={"ID":"ddaa04b8-49c5-448e-a585-317c53843e8a","Type":"ContainerStarted","Data":"7d30d2f07319c9de4d9f2206f48ad31284d9f2572fff5a2da136956e16b8aadb"}
Jul 09 15:00:43.066758 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:43.066414    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn" event={"ID":"ddaa04b8-49c5-448e-a585-317c53843e8a","Type":"ContainerStarted","Data":"4cf2b532268b6180a7a7bd0b9690441f03e3e4f1ca448f09a764aef996869442"}
Jul 09 15:00:43.083513 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:43.083364    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn" podStartSLOduration=2.083345241 podStartE2EDuration="2.083345241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:00:43.082968492 +0000 UTC m=+2387.110062873" watchObservedRunningTime="2026-07-09 15:00:43.083345241 +0000 UTC m=+2387.110439624"
Jul 09 15:00:48.904202 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:48.904159    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 15:00:52.082935 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:52.082890    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:52.083328 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:52.082959    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:52.095472 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:52.095444    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:52.130158 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:52.130124    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:00:56.513659 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:56.513629    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 15:00:56.536319 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:00:56.536293    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 15:01:00.011442 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:00.011406    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v"]
Jul 09 15:01:00.011970 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:00.011640    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v" podUID="5d578ba8-6aa3-42f8-b179-fff8a253c98e" containerName="cleanup" containerID="cri-o://23de4d9c438362824dbe373d7289d743ab81bdab5cceeb13c812a0dadc266cee" gracePeriod=30
Jul 09 15:01:00.013516 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:00.013494    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q"]
Jul 09 15:01:00.013757 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:00.013712    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q" podUID="eead84e9-e770-4d21-bf11-e92868a6cde7" containerName="cleanup" containerID="cri-o://3d8a739fd81997fdfdc29f2577816876dcf10b7afd1f0ee35f6d6a9853bf0449" gracePeriod=30
Jul 09 15:01:00.015145 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:00.015111    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg"]
Jul 09 15:01:00.015366 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:00.015324    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg" podUID="8ae3a942-1c62-481b-a676-8b6855dc73bd" containerName="cleanup" containerID="cri-o://c3923cecf3f5db02592750a1e3a522dd2bafe5a2552df159c1b488f3dd9c1204" gracePeriod=30
Jul 09 15:01:09.244707 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:09.244669    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:14.202151 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:14.202118    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 15:01:14.731831 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:14.731760    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:16.071593 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:16.071553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:16.172660 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:16.172625    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:30.224196 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.224171    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v"
Jul 09 15:01:30.250039 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.250015    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q"
Jul 09 15:01:30.253246 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.253223    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg"
Jul 09 15:01:30.324833 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.324713    2563 generic.go:356] "Generic (PLEG): container finished" podID="eead84e9-e770-4d21-bf11-e92868a6cde7" containerID="3d8a739fd81997fdfdc29f2577816876dcf10b7afd1f0ee35f6d6a9853bf0449" exitCode=137
Jul 09 15:01:30.324833 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.324777    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q"
Jul 09 15:01:30.325138 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.324828    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q" event={"ID":"eead84e9-e770-4d21-bf11-e92868a6cde7","Type":"ContainerDied","Data":"3d8a739fd81997fdfdc29f2577816876dcf10b7afd1f0ee35f6d6a9853bf0449"}
Jul 09 15:01:30.325138 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.324927    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q" event={"ID":"eead84e9-e770-4d21-bf11-e92868a6cde7","Type":"ContainerDied","Data":"8218a2d9b63aaebfdad0891682f6ead979ff2a151dd0a678c1ef66e5ba6e1328"}
Jul 09 15:01:30.325138 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.324955    2563 scope.go:117] "RemoveContainer" containerID="3d8a739fd81997fdfdc29f2577816876dcf10b7afd1f0ee35f6d6a9853bf0449"
Jul 09 15:01:30.326319 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.326281    2563 generic.go:356] "Generic (PLEG): container finished" podID="5d578ba8-6aa3-42f8-b179-fff8a253c98e" containerID="23de4d9c438362824dbe373d7289d743ab81bdab5cceeb13c812a0dadc266cee" exitCode=137
Jul 09 15:01:30.326450 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.326349    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v"
Jul 09 15:01:30.326450 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.326370    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v" event={"ID":"5d578ba8-6aa3-42f8-b179-fff8a253c98e","Type":"ContainerDied","Data":"23de4d9c438362824dbe373d7289d743ab81bdab5cceeb13c812a0dadc266cee"}
Jul 09 15:01:30.326450 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.326424    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v" event={"ID":"5d578ba8-6aa3-42f8-b179-fff8a253c98e","Type":"ContainerDied","Data":"95f811cc5220a3a8e58891e75e6da4ae5fa56d263e71df6b93669891c93f294b"}
Jul 09 15:01:30.327716 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.327690    2563 generic.go:356] "Generic (PLEG): container finished" podID="8ae3a942-1c62-481b-a676-8b6855dc73bd" containerID="c3923cecf3f5db02592750a1e3a522dd2bafe5a2552df159c1b488f3dd9c1204" exitCode=137
Jul 09 15:01:30.327838 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.327733    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg"
Jul 09 15:01:30.327838 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.327766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg" event={"ID":"8ae3a942-1c62-481b-a676-8b6855dc73bd","Type":"ContainerDied","Data":"c3923cecf3f5db02592750a1e3a522dd2bafe5a2552df159c1b488f3dd9c1204"}
Jul 09 15:01:30.327838 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.327818    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg" event={"ID":"8ae3a942-1c62-481b-a676-8b6855dc73bd","Type":"ContainerDied","Data":"6f93bb7fd01802140952e8aec8ae9c77fabd1d973cda29c6523ce1e7ed96867a"}
Jul 09 15:01:30.333720 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.333706    2563 scope.go:117] "RemoveContainer" containerID="3d8a739fd81997fdfdc29f2577816876dcf10b7afd1f0ee35f6d6a9853bf0449"
Jul 09 15:01:30.334017 ip-10-0-140-234 kubenswrapper[2563]: E0709 15:01:30.333981    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d8a739fd81997fdfdc29f2577816876dcf10b7afd1f0ee35f6d6a9853bf0449\": container with ID starting with 3d8a739fd81997fdfdc29f2577816876dcf10b7afd1f0ee35f6d6a9853bf0449 not found: ID does not exist" containerID="3d8a739fd81997fdfdc29f2577816876dcf10b7afd1f0ee35f6d6a9853bf0449"
Jul 09 15:01:30.334117 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.334024    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d8a739fd81997fdfdc29f2577816876dcf10b7afd1f0ee35f6d6a9853bf0449"} err="failed to get container status \"3d8a739fd81997fdfdc29f2577816876dcf10b7afd1f0ee35f6d6a9853bf0449\": rpc error: code = NotFound desc = could not find container \"3d8a739fd81997fdfdc29f2577816876dcf10b7afd1f0ee35f6d6a9853bf0449\": container with ID starting with 3d8a739fd81997fdfdc29f2577816876dcf10b7afd1f0ee35f6d6a9853bf0449 not found: ID does not exist"
Jul 09 15:01:30.334117 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.334040    2563 scope.go:117] "RemoveContainer" containerID="23de4d9c438362824dbe373d7289d743ab81bdab5cceeb13c812a0dadc266cee"
Jul 09 15:01:30.341664 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.341645    2563 scope.go:117] "RemoveContainer" containerID="23de4d9c438362824dbe373d7289d743ab81bdab5cceeb13c812a0dadc266cee"
Jul 09 15:01:30.341922 ip-10-0-140-234 kubenswrapper[2563]: E0709 15:01:30.341903    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23de4d9c438362824dbe373d7289d743ab81bdab5cceeb13c812a0dadc266cee\": container with ID starting with 23de4d9c438362824dbe373d7289d743ab81bdab5cceeb13c812a0dadc266cee not found: ID does not exist" containerID="23de4d9c438362824dbe373d7289d743ab81bdab5cceeb13c812a0dadc266cee"
Jul 09 15:01:30.342009 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.341931    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23de4d9c438362824dbe373d7289d743ab81bdab5cceeb13c812a0dadc266cee"} err="failed to get container status \"23de4d9c438362824dbe373d7289d743ab81bdab5cceeb13c812a0dadc266cee\": rpc error: code = NotFound desc = could not find container \"23de4d9c438362824dbe373d7289d743ab81bdab5cceeb13c812a0dadc266cee\": container with ID starting with 23de4d9c438362824dbe373d7289d743ab81bdab5cceeb13c812a0dadc266cee not found: ID does not exist"
Jul 09 15:01:30.342009 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.341953    2563 scope.go:117] "RemoveContainer" containerID="c3923cecf3f5db02592750a1e3a522dd2bafe5a2552df159c1b488f3dd9c1204"
Jul 09 15:01:30.349499 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.349481    2563 scope.go:117] "RemoveContainer" containerID="c3923cecf3f5db02592750a1e3a522dd2bafe5a2552df159c1b488f3dd9c1204"
Jul 09 15:01:30.349742 ip-10-0-140-234 kubenswrapper[2563]: E0709 15:01:30.349724    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3923cecf3f5db02592750a1e3a522dd2bafe5a2552df159c1b488f3dd9c1204\": container with ID starting with c3923cecf3f5db02592750a1e3a522dd2bafe5a2552df159c1b488f3dd9c1204 not found: ID does not exist" containerID="c3923cecf3f5db02592750a1e3a522dd2bafe5a2552df159c1b488f3dd9c1204"
Jul 09 15:01:30.349820 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.349752    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3923cecf3f5db02592750a1e3a522dd2bafe5a2552df159c1b488f3dd9c1204"} err="failed to get container status \"c3923cecf3f5db02592750a1e3a522dd2bafe5a2552df159c1b488f3dd9c1204\": rpc error: code = NotFound desc = could not find container \"c3923cecf3f5db02592750a1e3a522dd2bafe5a2552df159c1b488f3dd9c1204\": container with ID starting with c3923cecf3f5db02592750a1e3a522dd2bafe5a2552df159c1b488f3dd9c1204 not found: ID does not exist"
Jul 09 15:01:30.386138 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.386113    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfqx2\" (UniqueName: \"kubernetes.io/projected/5d578ba8-6aa3-42f8-b179-fff8a253c98e-kube-api-access-jfqx2\") pod \"5d578ba8-6aa3-42f8-b179-fff8a253c98e\" (UID: \"5d578ba8-6aa3-42f8-b179-fff8a253c98e\") "
Jul 09 15:01:30.386239 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.386159    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtswh\" (UniqueName: \"kubernetes.io/projected/8ae3a942-1c62-481b-a676-8b6855dc73bd-kube-api-access-wtswh\") pod \"8ae3a942-1c62-481b-a676-8b6855dc73bd\" (UID: \"8ae3a942-1c62-481b-a676-8b6855dc73bd\") "
Jul 09 15:01:30.386239 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.386197    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8t2h\" (UniqueName: \"kubernetes.io/projected/eead84e9-e770-4d21-bf11-e92868a6cde7-kube-api-access-z8t2h\") pod \"eead84e9-e770-4d21-bf11-e92868a6cde7\" (UID: \"eead84e9-e770-4d21-bf11-e92868a6cde7\") "
Jul 09 15:01:30.388493 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.388469    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ae3a942-1c62-481b-a676-8b6855dc73bd-kube-api-access-wtswh" (OuterVolumeSpecName: "kube-api-access-wtswh") pod "8ae3a942-1c62-481b-a676-8b6855dc73bd" (UID: "8ae3a942-1c62-481b-a676-8b6855dc73bd"). InnerVolumeSpecName "kube-api-access-wtswh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:01:30.388570 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.388522    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eead84e9-e770-4d21-bf11-e92868a6cde7-kube-api-access-z8t2h" (OuterVolumeSpecName: "kube-api-access-z8t2h") pod "eead84e9-e770-4d21-bf11-e92868a6cde7" (UID: "eead84e9-e770-4d21-bf11-e92868a6cde7"). InnerVolumeSpecName "kube-api-access-z8t2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:01:30.388570 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.388548    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d578ba8-6aa3-42f8-b179-fff8a253c98e-kube-api-access-jfqx2" (OuterVolumeSpecName: "kube-api-access-jfqx2") pod "5d578ba8-6aa3-42f8-b179-fff8a253c98e" (UID: "5d578ba8-6aa3-42f8-b179-fff8a253c98e"). InnerVolumeSpecName "kube-api-access-jfqx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:01:30.487207 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.487184    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfqx2\" (UniqueName: \"kubernetes.io/projected/5d578ba8-6aa3-42f8-b179-fff8a253c98e-kube-api-access-jfqx2\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 15:01:30.487207 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.487209    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtswh\" (UniqueName: \"kubernetes.io/projected/8ae3a942-1c62-481b-a676-8b6855dc73bd-kube-api-access-wtswh\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 15:01:30.487349 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.487219    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8t2h\" (UniqueName: \"kubernetes.io/projected/eead84e9-e770-4d21-bf11-e92868a6cde7-kube-api-access-z8t2h\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 15:01:30.643184 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.643097    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v"]
Jul 09 15:01:30.647418 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.647391    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0d877f-29726820-tv29v"]
Jul 09 15:01:30.659004 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.658973    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q"]
Jul 09 15:01:30.665481 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.665459    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726820-b684q"]
Jul 09 15:01:30.676362 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.676331    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg"]
Jul 09 15:01:30.680741 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:30.680720    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d74e21-29726820-d29vg"]
Jul 09 15:01:32.459671 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:32.459639    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d578ba8-6aa3-42f8-b179-fff8a253c98e" path="/var/lib/kubelet/pods/5d578ba8-6aa3-42f8-b179-fff8a253c98e/volumes"
Jul 09 15:01:32.460054 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:32.460007    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ae3a942-1c62-481b-a676-8b6855dc73bd" path="/var/lib/kubelet/pods/8ae3a942-1c62-481b-a676-8b6855dc73bd/volumes"
Jul 09 15:01:32.460306 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:32.460293    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eead84e9-e770-4d21-bf11-e92868a6cde7" path="/var/lib/kubelet/pods/eead84e9-e770-4d21-bf11-e92868a6cde7/volumes"
Jul 09 15:01:37.396820 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:37.396754    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 15:01:41.702940 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:41.702897    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:42.702684 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:42.702653    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"]
Jul 09 15:01:42.725413 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:42.725374    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:48.794191 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:48.794158    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 15:01:57.723958 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:57.723917    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn" podUID="ddaa04b8-49c5-448e-a585-317c53843e8a" containerName="main" containerID="cri-o://7d30d2f07319c9de4d9f2206f48ad31284d9f2572fff5a2da136956e16b8aadb" gracePeriod=45
Jul 09 15:01:57.976664 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:57.976608    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:01:58.050062 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.050028    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-model-cache\") pod \"ddaa04b8-49c5-448e-a585-317c53843e8a\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") "
Jul 09 15:01:58.050218 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.050071    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-home\") pod \"ddaa04b8-49c5-448e-a585-317c53843e8a\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") "
Jul 09 15:01:58.050218 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.050119    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-dshm\") pod \"ddaa04b8-49c5-448e-a585-317c53843e8a\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") "
Jul 09 15:01:58.050218 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.050172    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms8tm\" (UniqueName: \"kubernetes.io/projected/ddaa04b8-49c5-448e-a585-317c53843e8a-kube-api-access-ms8tm\") pod \"ddaa04b8-49c5-448e-a585-317c53843e8a\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") "
Jul 09 15:01:58.050218 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.050199    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddaa04b8-49c5-448e-a585-317c53843e8a-tls-certs\") pod \"ddaa04b8-49c5-448e-a585-317c53843e8a\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") "
Jul 09 15:01:58.050450 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.050257    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-tmp-dir\") pod \"ddaa04b8-49c5-448e-a585-317c53843e8a\" (UID: \"ddaa04b8-49c5-448e-a585-317c53843e8a\") "
Jul 09 15:01:58.050450 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.050420    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-home" (OuterVolumeSpecName: "home") pod "ddaa04b8-49c5-448e-a585-317c53843e8a" (UID: "ddaa04b8-49c5-448e-a585-317c53843e8a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:01:58.050643 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.050624    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ddaa04b8-49c5-448e-a585-317c53843e8a" (UID: "ddaa04b8-49c5-448e-a585-317c53843e8a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:01:58.050705 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.050645    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-home\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 15:01:58.050705 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.050680    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-model-cache" (OuterVolumeSpecName: "model-cache") pod "ddaa04b8-49c5-448e-a585-317c53843e8a" (UID: "ddaa04b8-49c5-448e-a585-317c53843e8a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:01:58.052511 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.052482    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-dshm" (OuterVolumeSpecName: "dshm") pod "ddaa04b8-49c5-448e-a585-317c53843e8a" (UID: "ddaa04b8-49c5-448e-a585-317c53843e8a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:01:58.052620 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.052538    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddaa04b8-49c5-448e-a585-317c53843e8a-kube-api-access-ms8tm" (OuterVolumeSpecName: "kube-api-access-ms8tm") pod "ddaa04b8-49c5-448e-a585-317c53843e8a" (UID: "ddaa04b8-49c5-448e-a585-317c53843e8a"). InnerVolumeSpecName "kube-api-access-ms8tm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:01:58.052785 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.052770    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddaa04b8-49c5-448e-a585-317c53843e8a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ddaa04b8-49c5-448e-a585-317c53843e8a" (UID: "ddaa04b8-49c5-448e-a585-317c53843e8a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:01:58.151590 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.151548    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms8tm\" (UniqueName: \"kubernetes.io/projected/ddaa04b8-49c5-448e-a585-317c53843e8a-kube-api-access-ms8tm\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 15:01:58.151590 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.151583    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddaa04b8-49c5-448e-a585-317c53843e8a-tls-certs\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 15:01:58.151833 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.151615    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-tmp-dir\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 15:01:58.151833 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.151624    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-model-cache\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 15:01:58.151833 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.151632    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddaa04b8-49c5-448e-a585-317c53843e8a-dshm\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 15:01:58.469864 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.469835    2563 generic.go:356] "Generic (PLEG): container finished" podID="ddaa04b8-49c5-448e-a585-317c53843e8a" containerID="7d30d2f07319c9de4d9f2206f48ad31284d9f2572fff5a2da136956e16b8aadb" exitCode=0
Jul 09 15:01:58.470015 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.469868    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn" event={"ID":"ddaa04b8-49c5-448e-a585-317c53843e8a","Type":"ContainerDied","Data":"7d30d2f07319c9de4d9f2206f48ad31284d9f2572fff5a2da136956e16b8aadb"}
Jul 09 15:01:58.470015 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.469893    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"
Jul 09 15:01:58.470015 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.469910    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn" event={"ID":"ddaa04b8-49c5-448e-a585-317c53843e8a","Type":"ContainerDied","Data":"4cf2b532268b6180a7a7bd0b9690441f03e3e4f1ca448f09a764aef996869442"}
Jul 09 15:01:58.470015 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.469926    2563 scope.go:117] "RemoveContainer" containerID="7d30d2f07319c9de4d9f2206f48ad31284d9f2572fff5a2da136956e16b8aadb"
Jul 09 15:01:58.478602 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.478582    2563 scope.go:117] "RemoveContainer" containerID="7d30d2f07319c9de4d9f2206f48ad31284d9f2572fff5a2da136956e16b8aadb"
Jul 09 15:01:58.478880 ip-10-0-140-234 kubenswrapper[2563]: E0709 15:01:58.478858    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d30d2f07319c9de4d9f2206f48ad31284d9f2572fff5a2da136956e16b8aadb\": container with ID starting with 7d30d2f07319c9de4d9f2206f48ad31284d9f2572fff5a2da136956e16b8aadb not found: ID does not exist" containerID="7d30d2f07319c9de4d9f2206f48ad31284d9f2572fff5a2da136956e16b8aadb"
Jul 09 15:01:58.478959 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.478889    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d30d2f07319c9de4d9f2206f48ad31284d9f2572fff5a2da136956e16b8aadb"} err="failed to get container status \"7d30d2f07319c9de4d9f2206f48ad31284d9f2572fff5a2da136956e16b8aadb\": rpc error: code = NotFound desc = could not find container \"7d30d2f07319c9de4d9f2206f48ad31284d9f2572fff5a2da136956e16b8aadb\": container with ID starting with 7d30d2f07319c9de4d9f2206f48ad31284d9f2572fff5a2da136956e16b8aadb not found: ID does not exist"
Jul 09 15:01:58.491270 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.491243    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"]
Jul 09 15:01:58.494950 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:58.494931    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d74e21/rate-test-model-d74e21-kserve-7cf7d98779-d96zn"]
Jul 09 15:01:59.292658 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.292618    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7425-139773530487952"]
Jul 09 15:01:59.293223 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.293202    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d578ba8-6aa3-42f8-b179-fff8a253c98e" containerName="cleanup"
Jul 09 15:01:59.293306 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.293226    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d578ba8-6aa3-42f8-b179-fff8a253c98e" containerName="cleanup"
Jul 09 15:01:59.293306 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.293256    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eead84e9-e770-4d21-bf11-e92868a6cde7" containerName="cleanup"
Jul 09 15:01:59.293306 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.293264    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eead84e9-e770-4d21-bf11-e92868a6cde7" containerName="cleanup"
Jul 09 15:01:59.293306 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.293291    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ae3a942-1c62-481b-a676-8b6855dc73bd" containerName="cleanup"
Jul 09 15:01:59.293306 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.293299    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ae3a942-1c62-481b-a676-8b6855dc73bd" containerName="cleanup"
Jul 09 15:01:59.293564 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.293312    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddaa04b8-49c5-448e-a585-317c53843e8a" containerName="main"
Jul 09 15:01:59.293564 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.293321    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddaa04b8-49c5-448e-a585-317c53843e8a" containerName="main"
Jul 09 15:01:59.293564 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.293413    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ae3a942-1c62-481b-a676-8b6855dc73bd" containerName="cleanup"
Jul 09 15:01:59.293564 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.293425    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="eead84e9-e770-4d21-bf11-e92868a6cde7" containerName="cleanup"
Jul 09 15:01:59.293564 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.293435    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d578ba8-6aa3-42f8-b179-fff8a253c98e" containerName="cleanup"
Jul 09 15:01:59.293564 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.293444    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddaa04b8-49c5-448e-a585-317c53843e8a" containerName="main"
Jul 09 15:01:59.298238 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.298214    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7425-139773530487952"
Jul 09 15:01:59.299300 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.299270    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7425-139773530487952"]
Jul 09 15:01:59.300689 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.300658    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-dwnwr\""
Jul 09 15:01:59.363515 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.363475    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf4jj\" (UniqueName: \"kubernetes.io/projected/39da3308-ffed-4fdf-8a78-3682516c4695-kube-api-access-hf4jj\") pod \"test-curl-7425-139773530487952\" (UID: \"39da3308-ffed-4fdf-8a78-3682516c4695\") " pod="openshift-ingress/test-curl-7425-139773530487952"
Jul 09 15:01:59.464668 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.464626    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf4jj\" (UniqueName: \"kubernetes.io/projected/39da3308-ffed-4fdf-8a78-3682516c4695-kube-api-access-hf4jj\") pod \"test-curl-7425-139773530487952\" (UID: \"39da3308-ffed-4fdf-8a78-3682516c4695\") " pod="openshift-ingress/test-curl-7425-139773530487952"
Jul 09 15:01:59.473583 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.473556    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf4jj\" (UniqueName: \"kubernetes.io/projected/39da3308-ffed-4fdf-8a78-3682516c4695-kube-api-access-hf4jj\") pod \"test-curl-7425-139773530487952\" (UID: \"39da3308-ffed-4fdf-8a78-3682516c4695\") " pod="openshift-ingress/test-curl-7425-139773530487952"
Jul 09 15:01:59.607968 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.607877    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7425-139773530487952"
Jul 09 15:01:59.741846 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:01:59.741819    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7425-139773530487952"]
Jul 09 15:01:59.744409 ip-10-0-140-234 kubenswrapper[2563]: W0709 15:01:59.744384    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39da3308_ffed_4fdf_8a78_3682516c4695.slice/crio-720c89ea0fa9ccef79bd698d427dc18d61d90058c5f128ff31a27a0441be4d83 WatchSource:0}: Error finding container 720c89ea0fa9ccef79bd698d427dc18d61d90058c5f128ff31a27a0441be4d83: Status 404 returned error can't find the container with id 720c89ea0fa9ccef79bd698d427dc18d61d90058c5f128ff31a27a0441be4d83
Jul 09 15:02:00.460972 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:00.460948    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddaa04b8-49c5-448e-a585-317c53843e8a" path="/var/lib/kubelet/pods/ddaa04b8-49c5-448e-a585-317c53843e8a/volumes"
Jul 09 15:02:00.481792 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:00.481760    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7425-139773530487952" event={"ID":"39da3308-ffed-4fdf-8a78-3682516c4695","Type":"ContainerStarted","Data":"720c89ea0fa9ccef79bd698d427dc18d61d90058c5f128ff31a27a0441be4d83"}
Jul 09 15:02:01.488725 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:01.488696    2563 generic.go:356] "Generic (PLEG): container finished" podID="39da3308-ffed-4fdf-8a78-3682516c4695" containerID="e704c3b07d159e610f87aad12791752bee48f27d00a0bfeb01bae5792723ccff" exitCode=0
Jul 09 15:02:01.489156 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:01.488794    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7425-139773530487952" event={"ID":"39da3308-ffed-4fdf-8a78-3682516c4695","Type":"ContainerDied","Data":"e704c3b07d159e610f87aad12791752bee48f27d00a0bfeb01bae5792723ccff"}
Jul 09 15:02:02.636353 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:02.636323    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7425-139773530487952"
Jul 09 15:02:02.657189 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:02.657157    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7425-139773530487952_39da3308-ffed-4fdf-8a78-3682516c4695/test-curl-7425-139773530487952/0.log"
Jul 09 15:02:02.683457 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:02.683371    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7425-139773530487952"]
Jul 09 15:02:02.685014 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:02.684989    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7425-139773530487952"]
Jul 09 15:02:02.693229 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:02.693208    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hf4jj\" (UniqueName: \"kubernetes.io/projected/39da3308-ffed-4fdf-8a78-3682516c4695-kube-api-access-hf4jj\") pod \"39da3308-ffed-4fdf-8a78-3682516c4695\" (UID: \"39da3308-ffed-4fdf-8a78-3682516c4695\") "
Jul 09 15:02:02.695423 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:02.695398    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39da3308-ffed-4fdf-8a78-3682516c4695-kube-api-access-hf4jj" (OuterVolumeSpecName: "kube-api-access-hf4jj") pod "39da3308-ffed-4fdf-8a78-3682516c4695" (UID: "39da3308-ffed-4fdf-8a78-3682516c4695"). InnerVolumeSpecName "kube-api-access-hf4jj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:02:02.795158 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:02.795062    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf4jj\" (UniqueName: \"kubernetes.io/projected/39da3308-ffed-4fdf-8a78-3682516c4695-kube-api-access-hf4jj\") on node \"ip-10-0-140-234.ec2.internal\" DevicePath \"\""
Jul 09 15:02:02.924395 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:02.924346    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:03.326463 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:03.326418    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:03.426711 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:03.426654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:03.500926 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:03.500899    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="720c89ea0fa9ccef79bd698d427dc18d61d90058c5f128ff31a27a0441be4d83"
Jul 09 15:02:03.501105 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:03.500984    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7425-139773530487952"
Jul 09 15:02:03.511571 ip-10-0-140-234 kubenswrapper[2563]: E0709 15:02:03.511534    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7425-139773530487952\" is forbidden: User \"system:node:ip-10-0-140-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-234.ec2.internal' and this object" podUID="39da3308-ffed-4fdf-8a78-3682516c4695" pod="openshift-ingress/test-curl-7425-139773530487952"
Jul 09 15:02:03.526329 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:03.526298    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:03.608131 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:03.608040    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:04.460236 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:04.460206    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39da3308-ffed-4fdf-8a78-3682516c4695" path="/var/lib/kubelet/pods/39da3308-ffed-4fdf-8a78-3682516c4695/volumes"
Jul 09 15:02:06.801147 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:06.801114    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 15:02:09.421589 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:09.421550    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:09.484775 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:09.484733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:09.704911 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:09.704822    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:09.927713 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:09.927671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:10.113601 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:10.113562    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:10.521918 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:10.521886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:10.624568 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:10.624540    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:10.720499 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:10.720452    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:10.849795 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:10.849702    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:16.637880 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:16.637838    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:16.713962 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:16.713927    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:16.910455 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:16.910356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:17.571538 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:17.571501    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65565996b4-v7kwz_f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd/authorino/0.log"
Jul 09 15:02:18.136713 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:18.136650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:19.598446 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:19.598411    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq8jd"]
Jul 09 15:02:23.438490 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:23.438461    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c7757d956-r6vtl_cad06a14-7315-4ad8-9e44-f8beaf5d52de/copy-manifests/0.log"
Jul 09 15:02:23.448263 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:23.448224    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c7757d956-r6vtl_cad06a14-7315-4ad8-9e44-f8beaf5d52de/manager/0.log"
Jul 09 15:02:25.236879 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:25.236847    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65565996b4-v7kwz_f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd/authorino/0.log"
Jul 09 15:02:25.949590 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:25.949559    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mq8jd_05b30786-830a-45b3-ae68-8b05baf51fdc/limitador/0.log"
Jul 09 15:02:26.785276 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:26.785237    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77975789f4-n6vr6_698a5cf2-8ed4-4a74-811e-a3da96df2688/kube-auth-proxy/0.log"
Jul 09 15:02:26.911313 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:26.911274    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qwhmj_76a0ea55-242c-483c-893a-259a723e16f9/istio-proxy/1.log"
Jul 09 15:02:27.835749 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:27.835708    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-tn7k6_288b33b8-7047-4482-b786-c302024c8e3b/main/0.log"
Jul 09 15:02:28.177232 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:28.177143    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-8dkxt_ded52ace-b59c-4d1d-8efa-20439d922a5d/main/0.log"
Jul 09 15:02:32.028189 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.028157    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ltzpn/must-gather-vc22k"]
Jul 09 15:02:32.028661 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.028615    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39da3308-ffed-4fdf-8a78-3682516c4695" containerName="test-curl-7425-139773530487952"
Jul 09 15:02:32.028661 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.028645    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="39da3308-ffed-4fdf-8a78-3682516c4695" containerName="test-curl-7425-139773530487952"
Jul 09 15:02:32.028863 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.028745    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="39da3308-ffed-4fdf-8a78-3682516c4695" containerName="test-curl-7425-139773530487952"
Jul 09 15:02:32.034190 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.034171    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ltzpn/must-gather-vc22k"
Jul 09 15:02:32.036657 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.036639    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ltzpn\"/\"openshift-service-ca.crt\""
Jul 09 15:02:32.036770 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.036736    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ltzpn\"/\"kube-root-ca.crt\""
Jul 09 15:02:32.037476 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.037462    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ltzpn\"/\"default-dockercfg-pdr4l\""
Jul 09 15:02:32.043200 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.043175    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ltzpn/must-gather-vc22k"]
Jul 09 15:02:32.047382 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.047350    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:32.070059 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.070026    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgcmq\" (UniqueName: \"kubernetes.io/projected/de3904f8-bdd2-47ad-967e-54a0d264afda-kube-api-access-mgcmq\") pod \"must-gather-vc22k\" (UID: \"de3904f8-bdd2-47ad-967e-54a0d264afda\") " pod="openshift-must-gather-ltzpn/must-gather-vc22k"
Jul 09 15:02:32.070174 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.070144    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/de3904f8-bdd2-47ad-967e-54a0d264afda-must-gather-output\") pod \"must-gather-vc22k\" (UID: \"de3904f8-bdd2-47ad-967e-54a0d264afda\") " pod="openshift-must-gather-ltzpn/must-gather-vc22k"
Jul 09 15:02:32.146251 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.146218    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:32.171469 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.171434    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/de3904f8-bdd2-47ad-967e-54a0d264afda-must-gather-output\") pod \"must-gather-vc22k\" (UID: \"de3904f8-bdd2-47ad-967e-54a0d264afda\") " pod="openshift-must-gather-ltzpn/must-gather-vc22k"
Jul 09 15:02:32.171623 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.171497    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgcmq\" (UniqueName: \"kubernetes.io/projected/de3904f8-bdd2-47ad-967e-54a0d264afda-kube-api-access-mgcmq\") pod \"must-gather-vc22k\" (UID: \"de3904f8-bdd2-47ad-967e-54a0d264afda\") " pod="openshift-must-gather-ltzpn/must-gather-vc22k"
Jul 09 15:02:32.171780 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.171762    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/de3904f8-bdd2-47ad-967e-54a0d264afda-must-gather-output\") pod \"must-gather-vc22k\" (UID: \"de3904f8-bdd2-47ad-967e-54a0d264afda\") " pod="openshift-must-gather-ltzpn/must-gather-vc22k"
Jul 09 15:02:32.184216 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.184189    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgcmq\" (UniqueName: \"kubernetes.io/projected/de3904f8-bdd2-47ad-967e-54a0d264afda-kube-api-access-mgcmq\") pod \"must-gather-vc22k\" (UID: \"de3904f8-bdd2-47ad-967e-54a0d264afda\") " pod="openshift-must-gather-ltzpn/must-gather-vc22k"
Jul 09 15:02:32.344703 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.344616    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ltzpn/must-gather-vc22k"
Jul 09 15:02:32.479963 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.479940    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ltzpn/must-gather-vc22k"]
Jul 09 15:02:32.482669 ip-10-0-140-234 kubenswrapper[2563]: W0709 15:02:32.482643    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde3904f8_bdd2_47ad_967e_54a0d264afda.slice/crio-23eb7e16f646ea4a26d29250579f38bc0c6c529751b856dde047f2ba1a158f75 WatchSource:0}: Error finding container 23eb7e16f646ea4a26d29250579f38bc0c6c529751b856dde047f2ba1a158f75: Status 404 returned error can't find the container with id 23eb7e16f646ea4a26d29250579f38bc0c6c529751b856dde047f2ba1a158f75
Jul 09 15:02:32.643218 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:32.643134    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ltzpn/must-gather-vc22k" event={"ID":"de3904f8-bdd2-47ad-967e-54a0d264afda","Type":"ContainerStarted","Data":"23eb7e16f646ea4a26d29250579f38bc0c6c529751b856dde047f2ba1a158f75"}
Jul 09 15:02:33.652592 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:33.652545    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ltzpn/must-gather-vc22k" event={"ID":"de3904f8-bdd2-47ad-967e-54a0d264afda","Type":"ContainerStarted","Data":"010c313b3380a68a3dca2e4cc2c7241bd8f3a90a7e37fb2569b439db8ee04526"}
Jul 09 15:02:33.653109 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:33.652607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ltzpn/must-gather-vc22k" event={"ID":"de3904f8-bdd2-47ad-967e-54a0d264afda","Type":"ContainerStarted","Data":"34f416b6c0e6838ba0f8a811e29e1365e2c51ca9a76e0f750278eebf9d6630ca"}
Jul 09 15:02:33.670618 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:33.670551    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ltzpn/must-gather-vc22k" podStartSLOduration=1.029523639 podStartE2EDuration="1.670530805s" totalImagesPullingTime="641.007166ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:02:33.66952134 +0000 UTC m=+2497.696615722" watchObservedRunningTime="2026-07-09 15:02:33.670530805 +0000 UTC m=+2497.697625186"
Jul 09 15:02:34.720407 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:34.720356    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7jk5k_9753f0f7-1409-4552-aaad-995fd401dd48/global-pull-secret-syncer/0.log"
Jul 09 15:02:34.865411 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:34.865380    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hwjfl_4385d404-cc52-49a6-984e-7417a0d63935/konnectivity-agent/0.log"
Jul 09 15:02:35.001896 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:35.001818    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-234.ec2.internal_27720bce3ffdbdb8ce1870f3c11220d9/haproxy/0.log"
Jul 09 15:02:40.542832 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:40.541914    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65565996b4-v7kwz_f7b64e8c-be7b-4390-92d4-0c3e3f8ae0cd/authorino/0.log"
Jul 09 15:02:40.835551 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:40.835471    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mq8jd_05b30786-830a-45b3-ae68-8b05baf51fdc/limitador/0.log"
Jul 09 15:02:42.496715 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:42.496677    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3/alertmanager/0.log"
Jul 09 15:02:42.525595 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:42.525564    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3/config-reloader/0.log"
Jul 09 15:02:42.559142 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:42.559107    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3/kube-rbac-proxy-web/0.log"
Jul 09 15:02:42.592259 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:42.592226    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3/kube-rbac-proxy/0.log"
Jul 09 15:02:42.619594 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:42.619555    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3/kube-rbac-proxy-metric/0.log"
Jul 09 15:02:42.668828 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:42.668583    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3/prom-label-proxy/0.log"
Jul 09 15:02:42.694007 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:42.693961    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc85dc7a-a2a2-4fc6-9ec0-06d260187bb3/init-config-reloader/0.log"
Jul 09 15:02:42.774060 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:42.774025    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-v77lv_7aae19e5-0c9c-472d-951f-988c66993c8c/kube-state-metrics/0.log"
Jul 09 15:02:42.801724 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:42.801682    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-v77lv_7aae19e5-0c9c-472d-951f-988c66993c8c/kube-rbac-proxy-main/0.log"
Jul 09 15:02:42.831059 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:42.830971    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-v77lv_7aae19e5-0c9c-472d-951f-988c66993c8c/kube-rbac-proxy-self/0.log"
Jul 09 15:02:42.867735 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:42.867675    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6959b9ffdf-8fmqt_869b12f3-6f25-4c1a-aa88-1d3674d98128/metrics-server/0.log"
Jul 09 15:02:42.901119 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:42.901041    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-gqwvt_55a4e26d-6533-4c88-80b6-2ee579f3fc8f/monitoring-plugin/0.log"
Jul 09 15:02:42.940951 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:42.940913    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f49d7_592b9d09-4aec-4a6f-aac6-de38c842f029/node-exporter/0.log"
Jul 09 15:02:42.966572 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:42.966528    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f49d7_592b9d09-4aec-4a6f-aac6-de38c842f029/kube-rbac-proxy/0.log"
Jul 09 15:02:42.996302 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:42.996269    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f49d7_592b9d09-4aec-4a6f-aac6-de38c842f029/init-textfile/0.log"
Jul 09 15:02:43.240824 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.240778    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-w7rg4_fb80d955-2bd8-412f-91dd-9e7d76ae0dc0/kube-rbac-proxy-main/0.log"
Jul 09 15:02:43.270037 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.270005    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-w7rg4_fb80d955-2bd8-412f-91dd-9e7d76ae0dc0/kube-rbac-proxy-self/0.log"
Jul 09 15:02:43.298493 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.298462    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-w7rg4_fb80d955-2bd8-412f-91dd-9e7d76ae0dc0/openshift-state-metrics/0.log"
Jul 09 15:02:43.348781 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.348699    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cfef937c-1f64-4c12-90c3-d3d48217a818/prometheus/0.log"
Jul 09 15:02:43.377090 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.377060    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cfef937c-1f64-4c12-90c3-d3d48217a818/config-reloader/0.log"
Jul 09 15:02:43.409057 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.409027    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cfef937c-1f64-4c12-90c3-d3d48217a818/thanos-sidecar/0.log"
Jul 09 15:02:43.437109 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.437074    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cfef937c-1f64-4c12-90c3-d3d48217a818/kube-rbac-proxy-web/0.log"
Jul 09 15:02:43.466557 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.466530    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cfef937c-1f64-4c12-90c3-d3d48217a818/kube-rbac-proxy/0.log"
Jul 09 15:02:43.505147 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.505106    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cfef937c-1f64-4c12-90c3-d3d48217a818/kube-rbac-proxy-thanos/0.log"
Jul 09 15:02:43.539432 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.539403    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cfef937c-1f64-4c12-90c3-d3d48217a818/init-config-reloader/0.log"
Jul 09 15:02:43.576563 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.576537    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-57c4w_31d73e06-2694-497b-a269-80126723727e/prometheus-operator/0.log"
Jul 09 15:02:43.600238 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.600129    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-57c4w_31d73e06-2694-497b-a269-80126723727e/kube-rbac-proxy/0.log"
Jul 09 15:02:43.631780 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.631743    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-dqpls_1959c0e8-7101-40bc-bdf9-fcd7b748320d/prometheus-operator-admission-webhook/0.log"
Jul 09 15:02:43.667136 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.667089    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5445c9b998-cxks4_df5d743a-8637-4223-9b54-800c6ea97956/telemeter-client/0.log"
Jul 09 15:02:43.695943 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.695912    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5445c9b998-cxks4_df5d743a-8637-4223-9b54-800c6ea97956/reload/0.log"
Jul 09 15:02:43.725072 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.725044    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5445c9b998-cxks4_df5d743a-8637-4223-9b54-800c6ea97956/kube-rbac-proxy/0.log"
Jul 09 15:02:43.759152 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.759119    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-544f5d846b-kcd4v_319ef20b-efae-4f45-abd8-346dc7fe5f5f/thanos-query/0.log"
Jul 09 15:02:43.785638 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.785592    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-544f5d846b-kcd4v_319ef20b-efae-4f45-abd8-346dc7fe5f5f/kube-rbac-proxy-web/0.log"
Jul 09 15:02:43.821276 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.821246    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-544f5d846b-kcd4v_319ef20b-efae-4f45-abd8-346dc7fe5f5f/kube-rbac-proxy/0.log"
Jul 09 15:02:43.848736 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.848707    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-544f5d846b-kcd4v_319ef20b-efae-4f45-abd8-346dc7fe5f5f/prom-label-proxy/0.log"
Jul 09 15:02:43.879245 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.879159    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-544f5d846b-kcd4v_319ef20b-efae-4f45-abd8-346dc7fe5f5f/kube-rbac-proxy-rules/0.log"
Jul 09 15:02:43.908178 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:43.908142    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-544f5d846b-kcd4v_319ef20b-efae-4f45-abd8-346dc7fe5f5f/kube-rbac-proxy-metrics/0.log"
Jul 09 15:02:46.880226 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:46.880191    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"]
Jul 09 15:02:46.888616 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:46.888592    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:46.893536 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:46.893512    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"]
Jul 09 15:02:46.953137 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:46.953102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xnsc\" (UniqueName: \"kubernetes.io/projected/fd9eddac-0aeb-468c-bbed-8f81719e94a0-kube-api-access-4xnsc\") pod \"perf-node-gather-daemonset-gjnwc\" (UID: \"fd9eddac-0aeb-468c-bbed-8f81719e94a0\") " pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:46.953322 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:46.953155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd9eddac-0aeb-468c-bbed-8f81719e94a0-lib-modules\") pod \"perf-node-gather-daemonset-gjnwc\" (UID: \"fd9eddac-0aeb-468c-bbed-8f81719e94a0\") " pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:46.953322 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:46.953187    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd9eddac-0aeb-468c-bbed-8f81719e94a0-podres\") pod \"perf-node-gather-daemonset-gjnwc\" (UID: \"fd9eddac-0aeb-468c-bbed-8f81719e94a0\") " pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:46.953322 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:46.953278    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd9eddac-0aeb-468c-bbed-8f81719e94a0-sys\") pod \"perf-node-gather-daemonset-gjnwc\" (UID: \"fd9eddac-0aeb-468c-bbed-8f81719e94a0\") " pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:46.953450 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:46.953332    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd9eddac-0aeb-468c-bbed-8f81719e94a0-proc\") pod \"perf-node-gather-daemonset-gjnwc\" (UID: \"fd9eddac-0aeb-468c-bbed-8f81719e94a0\") " pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:47.054092 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:47.054009    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd9eddac-0aeb-468c-bbed-8f81719e94a0-sys\") pod \"perf-node-gather-daemonset-gjnwc\" (UID: \"fd9eddac-0aeb-468c-bbed-8f81719e94a0\") " pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:47.054092 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:47.054083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd9eddac-0aeb-468c-bbed-8f81719e94a0-proc\") pod \"perf-node-gather-daemonset-gjnwc\" (UID: \"fd9eddac-0aeb-468c-bbed-8f81719e94a0\") " pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:47.054326 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:47.054151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd9eddac-0aeb-468c-bbed-8f81719e94a0-sys\") pod \"perf-node-gather-daemonset-gjnwc\" (UID: \"fd9eddac-0aeb-468c-bbed-8f81719e94a0\") " pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:47.054326 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:47.054162    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xnsc\" (UniqueName: \"kubernetes.io/projected/fd9eddac-0aeb-468c-bbed-8f81719e94a0-kube-api-access-4xnsc\") pod \"perf-node-gather-daemonset-gjnwc\" (UID: \"fd9eddac-0aeb-468c-bbed-8f81719e94a0\") " pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:47.054326 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:47.054215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd9eddac-0aeb-468c-bbed-8f81719e94a0-lib-modules\") pod \"perf-node-gather-daemonset-gjnwc\" (UID: \"fd9eddac-0aeb-468c-bbed-8f81719e94a0\") " pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:47.054326 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:47.054245    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd9eddac-0aeb-468c-bbed-8f81719e94a0-podres\") pod \"perf-node-gather-daemonset-gjnwc\" (UID: \"fd9eddac-0aeb-468c-bbed-8f81719e94a0\") " pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:47.054326 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:47.054294    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd9eddac-0aeb-468c-bbed-8f81719e94a0-proc\") pod \"perf-node-gather-daemonset-gjnwc\" (UID: \"fd9eddac-0aeb-468c-bbed-8f81719e94a0\") " pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:47.054577 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:47.054406    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd9eddac-0aeb-468c-bbed-8f81719e94a0-podres\") pod \"perf-node-gather-daemonset-gjnwc\" (UID: \"fd9eddac-0aeb-468c-bbed-8f81719e94a0\") " pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:47.054577 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:47.054548    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd9eddac-0aeb-468c-bbed-8f81719e94a0-lib-modules\") pod \"perf-node-gather-daemonset-gjnwc\" (UID: \"fd9eddac-0aeb-468c-bbed-8f81719e94a0\") " pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:47.063119 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:47.063091    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xnsc\" (UniqueName: \"kubernetes.io/projected/fd9eddac-0aeb-468c-bbed-8f81719e94a0-kube-api-access-4xnsc\") pod \"perf-node-gather-daemonset-gjnwc\" (UID: \"fd9eddac-0aeb-468c-bbed-8f81719e94a0\") " pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:47.203049 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:47.202952    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:47.394647 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:47.394549    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"]
Jul 09 15:02:47.397961 ip-10-0-140-234 kubenswrapper[2563]: W0709 15:02:47.397883    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfd9eddac_0aeb_468c_bbed_8f81719e94a0.slice/crio-f7f7f7bc0f3471b9b882ec76f94b5c76377952a0c166061beeaf95eca638aec4 WatchSource:0}: Error finding container f7f7f7bc0f3471b9b882ec76f94b5c76377952a0c166061beeaf95eca638aec4: Status 404 returned error can't find the container with id f7f7f7bc0f3471b9b882ec76f94b5c76377952a0c166061beeaf95eca638aec4
Jul 09 15:02:47.766274 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:47.766168    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc" event={"ID":"fd9eddac-0aeb-468c-bbed-8f81719e94a0","Type":"ContainerStarted","Data":"231953af2f9056b0df3e8eeada5d5f9705be7db018d509900195327e95bf308b"}
Jul 09 15:02:47.766274 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:47.766251    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc" event={"ID":"fd9eddac-0aeb-468c-bbed-8f81719e94a0","Type":"ContainerStarted","Data":"f7f7f7bc0f3471b9b882ec76f94b5c76377952a0c166061beeaf95eca638aec4"}
Jul 09 15:02:47.766605 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:47.766571    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:47.785217 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:47.784326    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc" podStartSLOduration=1.7843066269999999 podStartE2EDuration="1.784306627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:02:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:02:47.783182987 +0000 UTC m=+2511.810277369" watchObservedRunningTime="2026-07-09 15:02:47.784306627 +0000 UTC m=+2511.811401011"
Jul 09 15:02:48.034843 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:48.034726    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m7gnx_ffd14b51-df34-4e09-95e0-44e398a6d76c/dns/0.log"
Jul 09 15:02:48.057382 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:48.057352    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m7gnx_ffd14b51-df34-4e09-95e0-44e398a6d76c/kube-rbac-proxy/0.log"
Jul 09 15:02:48.081596 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:48.081565    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kqqjk_a5a824f4-706d-4a1a-b5a1-edd1b60054ac/dns-node-resolver/0.log"
Jul 09 15:02:48.791674 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:48.791647    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g6w9d_a909f8f0-7545-4d48-96ee-43c5641a5e3d/node-ca/0.log"
Jul 09 15:02:49.905006 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:49.904978    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77975789f4-n6vr6_698a5cf2-8ed4-4a74-811e-a3da96df2688/kube-auth-proxy/0.log"
Jul 09 15:02:49.935693 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:49.935657    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qwhmj_76a0ea55-242c-483c-893a-259a723e16f9/istio-proxy/0.log"
Jul 09 15:02:50.001843 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:50.001790    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qwhmj_76a0ea55-242c-483c-893a-259a723e16f9/istio-proxy/1.log"
Jul 09 15:02:50.830026 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:50.829984    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nlk2n_1b949d69-8e9e-4973-b66e-08caf0dee278/serve-healthcheck-canary/0.log"
Jul 09 15:02:51.518446 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:51.518419    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lhc8l_3ab41c18-0f1e-43de-aadc-2a2995247e18/kube-rbac-proxy/0.log"
Jul 09 15:02:51.540504 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:51.540481    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lhc8l_3ab41c18-0f1e-43de-aadc-2a2995247e18/exporter/0.log"
Jul 09 15:02:51.565343 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:51.565311    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lhc8l_3ab41c18-0f1e-43de-aadc-2a2995247e18/extractor/0.log"
Jul 09 15:02:53.783358 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:53.783329    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ltzpn/perf-node-gather-daemonset-gjnwc"
Jul 09 15:02:54.281938 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:54.281908    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c7757d956-r6vtl_cad06a14-7315-4ad8-9e44-f8beaf5d52de/manager/0.log"
Jul 09 15:02:54.305310 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:54.305277    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c7757d956-r6vtl_cad06a14-7315-4ad8-9e44-f8beaf5d52de/copy-manifests/0.log"
Jul 09 15:02:55.213725 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:55.213698    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77975789f4-n6vr6_698a5cf2-8ed4-4a74-811e-a3da96df2688/kube-auth-proxy/0.log"
Jul 09 15:02:55.236602 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:55.236562    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qwhmj_76a0ea55-242c-483c-893a-259a723e16f9/istio-proxy/0.log"
Jul 09 15:02:55.290231 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:55.290194    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qwhmj_76a0ea55-242c-483c-893a-259a723e16f9/istio-proxy/1.log"
Jul 09 15:02:55.627699 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:55.627613    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7988959d95-b7jk9_3a795d76-3d08-48a2-9253-20ce9c9606a2/manager/0.log"
Jul 09 15:02:56.885792 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:56.885757    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77975789f4-n6vr6_698a5cf2-8ed4-4a74-811e-a3da96df2688/kube-auth-proxy/0.log"
Jul 09 15:02:56.910745 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:56.910716    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qwhmj_76a0ea55-242c-483c-893a-259a723e16f9/istio-proxy/0.log"
Jul 09 15:02:56.975146 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:02:56.975108    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qwhmj_76a0ea55-242c-483c-893a-259a723e16f9/istio-proxy/1.log"
Jul 09 15:03:02.643423 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:02.643393    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xjl9r_fffb39dc-5682-4ec0-9eb0-86bec13ce105/kube-multus-additional-cni-plugins/0.log"
Jul 09 15:03:02.666936 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:02.666902    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xjl9r_fffb39dc-5682-4ec0-9eb0-86bec13ce105/egress-router-binary-copy/0.log"
Jul 09 15:03:02.688910 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:02.688889    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xjl9r_fffb39dc-5682-4ec0-9eb0-86bec13ce105/cni-plugins/0.log"
Jul 09 15:03:02.713191 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:02.713166    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xjl9r_fffb39dc-5682-4ec0-9eb0-86bec13ce105/bond-cni-plugin/0.log"
Jul 09 15:03:02.734893 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:02.734865    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xjl9r_fffb39dc-5682-4ec0-9eb0-86bec13ce105/routeoverride-cni/0.log"
Jul 09 15:03:02.757825 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:02.757787    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xjl9r_fffb39dc-5682-4ec0-9eb0-86bec13ce105/whereabouts-cni-bincopy/0.log"
Jul 09 15:03:02.784223 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:02.784189    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xjl9r_fffb39dc-5682-4ec0-9eb0-86bec13ce105/whereabouts-cni/0.log"
Jul 09 15:03:02.856349 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:02.856320    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fg6l6_e47b991c-2c73-4bbd-a267-d6a5583a8994/kube-multus/0.log"
Jul 09 15:03:02.911936 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:02.911852    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b4crp_82480873-c990-49f3-a16b-a961f1d330d9/network-metrics-daemon/0.log"
Jul 09 15:03:02.932939 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:02.932911    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b4crp_82480873-c990-49f3-a16b-a961f1d330d9/kube-rbac-proxy/0.log"
Jul 09 15:03:03.875334 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:03.875304    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-controller/0.log"
Jul 09 15:03:03.892382 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:03.892352    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/0.log"
Jul 09 15:03:03.892533 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:03.892491    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovn-acl-logging/1.log"
Jul 09 15:03:03.911199 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:03.911173    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/kube-rbac-proxy-node/0.log"
Jul 09 15:03:03.935398 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:03.935371    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/kube-rbac-proxy-ovn-metrics/0.log"
Jul 09 15:03:03.957867 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:03.957840    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/northd/0.log"
Jul 09 15:03:03.980360 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:03.980330    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/nbdb/0.log"
Jul 09 15:03:04.003479 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:04.003453    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/sbdb/0.log"
Jul 09 15:03:04.082026 ip-10-0-140-234 kubenswrapper[2563]: I0709 15:03:04.081929    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dhnz_09b35b94-8922-4ff4-aa77-c987bd7beacc/ovnkube-controller/0.log"