Sep 09 23:01:46.773832 ip-10-0-131-73 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 09 23:01:46.773845 ip-10-0-131-73 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 09 23:01:46.773855 ip-10-0-131-73 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 09 23:01:46.774004 ip-10-0-131-73 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 09 23:01:56.956688 ip-10-0-131-73 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 09 23:01:56.956707 ip-10-0-131-73 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 68e0d6528d494c3cab7d8485b174d590 --
Sep 09 23:03:35.111620 ip-10-0-131-73 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 23:03:35.495105 ip-10-0-131-73 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 23:03:35.495105 ip-10-0-131-73 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 23:03:35.495105 ip-10-0-131-73 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 23:03:35.495105 ip-10-0-131-73 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 23:03:35.495105 ip-10-0-131-73 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 23:03:35.496160 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.496074    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 23:03:35.503268 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503245    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:03:35.503268 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503264    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:03:35.503268 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503271    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503276    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503282    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503286    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503289    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503294    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503298    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503302    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503306    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503310    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503316    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503325    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503330    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503333    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503337    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503341    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503361    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503364    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503368    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:03:35.503508 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503372    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503377    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503381    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503385    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503388    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503392    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503396    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503400    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503404    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503407    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503412    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503416    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503420    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503424    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503429    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503434    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503439    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503443    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503447    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503451    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:03:35.504254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503456    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503460    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503464    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503468    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503472    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503478    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503482    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503487    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503491    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503495    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503499    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503504    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503507    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503511    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503518    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503524    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503529    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503533    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503537    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:03:35.504777 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503541    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503546    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503550    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503555    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503559    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503563    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503568    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503572    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503578    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503582    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503587    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503592    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503597    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503601    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503605    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503609    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503613    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503618    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503622    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503626    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:03:35.505456 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503630    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503634    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503639    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503643    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503647    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503651    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503657    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503661    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503666    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503670    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503674    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503679    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503683    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503687    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503692    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503696    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503700    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503704    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.503708    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505744    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:03:35.506295 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505755    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505762    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505767    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505771    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505777    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505782    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505786    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505790    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505794    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505798    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505802    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505806    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505810    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505814    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505819    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505823    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505827    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505831    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505836    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505839    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505843    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:03:35.507071 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505848    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505852    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505859    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505865    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505869    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505874    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505879    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505886    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505891    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505896    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505904    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505911    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505916    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505920    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505925    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505930    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505936    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505940    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:03:35.507619 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505944    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505949    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505953    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505957    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505961    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505967    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505971    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505976    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505980    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505984    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505988    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505992    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.505996    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506001    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506005    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506009    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506013    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506017    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506021    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506025    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:03:35.508059 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506030    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506034    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506038    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506042    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506047    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506052    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506057    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506061    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506065    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506069    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506073    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506078    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506082    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506086    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506090    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506095    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506099    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506103    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506107    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506111    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:03:35.508586 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506115    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506119    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506123    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506129    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506133    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506137    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506141    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506145    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506149    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506154    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506158    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506162    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506166    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506170    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506174    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506178    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506183    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506187    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506192    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506779    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:03:35.509076 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506788    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506793    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506798    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506803    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506807    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506812    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506816    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506821    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506825    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506828    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506833    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506837    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506841    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506845    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506849    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506853    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506858    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506862    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506866    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506871    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:03:35.509662 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506875    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506882    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506887    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506891    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506899    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506932    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506949    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506953    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506956    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506959    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506962    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506968    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506970    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506973    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506976    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506978    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506981    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506984    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506987    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506990    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:03:35.510175 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506992    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.506995    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507001    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507004    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507006    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507010    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507015    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507019    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507022    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507026    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507030    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507033    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507036    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507039    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507042    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507045    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507048    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507051    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507055    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:03:35.510677 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507058    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507061    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507063    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507066    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507069    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507072    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507075    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507078    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507081    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507083    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507086    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507089    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507092    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507095    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507097    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507100    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507103    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507105    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507108    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:03:35.511138 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507110    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507113    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507115    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507120    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507123    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507125    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507128    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507131    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507134    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507136    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507140    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507142    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507145    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507148    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507151    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507154    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507157    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507160    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507162    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507165    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:03:35.511609 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507245    2562 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507282    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507289    2562 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507294    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507298    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507301    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507306    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507310    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507314    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507317    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507321    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507325    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507328    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507331    2562 flags.go:64] FLAG: --cgroup-root=""
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507334    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507337    2562 flags.go:64] FLAG: --client-ca-file=""
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507340    2562 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507356    2562 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507361    2562 flags.go:64] FLAG: --cluster-domain=""
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507364    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507367    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507370    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507374    2562 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507378    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 23:03:35.512129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507381    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507384    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507388    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507391    2562 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507395    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507398    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507401    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507403    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507408    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507411    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507414    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507417    2562 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507420    2562 flags.go:64] FLAG: --enable-server="true"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507423    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507428    2562 flags.go:64] FLAG: --event-burst="100"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507431    2562 flags.go:64] FLAG: --event-qps="50"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507434    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507437    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507440    2562 flags.go:64] FLAG: --eviction-hard=""
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507444    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507447    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507451    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507454    2562 flags.go:64] FLAG: --eviction-soft=""
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507457    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507461    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 23:03:35.512750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507464    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507466    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507470    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507472    2562 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507476    2562 flags.go:64] FLAG: --feature-gates=""
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507483    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507486    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507489    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507492    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507495    2562 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507499    2562 flags.go:64] FLAG: --help="false"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507502    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-131-73.ec2.internal"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507505    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507508    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507511    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507515    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507518    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507521    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507524    2562 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507527    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507530    2562 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507533    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507536    2562 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507539    2562 flags.go:64] FLAG: --kube-reserved=""
Sep 09 23:03:35.513400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507542    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507545    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507548    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507551    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507554    2562 flags.go:64] FLAG: --lock-file=""
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507557    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507560    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507563    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507572    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507575    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507578    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507581    2562 flags.go:64] FLAG: --logging-format="text"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507584    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507589    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507592    2562 flags.go:64] FLAG: --manifest-url=""
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507595    2562 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507600    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507603    2562 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507607    2562 flags.go:64] FLAG: --max-pods="110"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507611    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507614    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507617    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507620    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507623    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507626    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 23:03:35.513984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507629    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507637    2562 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507640    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507643    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507646    2562 flags.go:64] FLAG: --pod-cidr=""
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507649    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507655    2562 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507658    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507660    2562 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507663    2562 flags.go:64] FLAG: --port="10250"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507667    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507672    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01325174bd1992e05"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507675    2562 flags.go:64] FLAG: --qos-reserved=""
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507678    2562 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507681    2562 flags.go:64] FLAG: --register-node="true"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507684    2562 flags.go:64] FLAG: --register-with-taints=""
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507688    2562 flags.go:64] FLAG: --registry-burst="10"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507691    2562 flags.go:64] FLAG: --registry-qps="5"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507694    2562 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507696    2562 flags.go:64] FLAG: --reserved-memory=""
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507700    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507704    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507707    2562 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507709    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507712    2562 flags.go:64] FLAG: --runonce="false"
Sep 09 23:03:35.514663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507715    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507718    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507721    2562 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507724    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507727    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507730    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507734    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507737    2562 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507740    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507743    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507746    2562 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507748    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507751    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507754    2562 flags.go:64] FLAG: --system-cgroups=""
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507757    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507763    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507766    2562 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507768    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507774    2562 flags.go:64] FLAG: --tls-min-version=""
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507777    2562 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507780    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507783    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507786    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507789    2562 flags.go:64] FLAG: --v="2"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507793    2562 flags.go:64] FLAG: --version="false"
Sep 09 23:03:35.515288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507797    2562 flags.go:64] FLAG: --vmodule=""
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507800    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.507803    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507940    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507943    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507946    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507949    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507952    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507955    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507958    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507962    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507964    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507967    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507970    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507972    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507975    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507977    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507980    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507983    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507985    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:03:35.515957 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507988    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507990    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507993    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507996    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.507998    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508002    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508005    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508007    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508010    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508012    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508016    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508018    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508021    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508024    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508026    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508029    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508031    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508034    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508036    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508039    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:03:35.516487 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508041    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508044    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508046    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508049    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508052    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508054    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508057    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508060    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508063    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508066    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508068    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508071    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508074    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508076    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508079    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508081    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508084    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508087    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508090    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508092    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:03:35.516958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508095    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508098    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508101    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508105    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508109    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508112    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508115    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508117    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508120    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508122    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508125    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508127    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508130    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508133    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508135    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508139    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508143    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508146    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508149    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:03:35.517518 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508152    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508154    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508157    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508160    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508163    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508166    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508170    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508173    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508176    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508179    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508182    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508185    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508188    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508190    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508194    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508197    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508200    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508202    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508205    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:03:35.517979 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508208    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:03:35.518460 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508210    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:03:35.518460 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508213    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:03:35.518460 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.508215    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:03:35.518460 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.508221    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 23:03:35.518460 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.516252    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 23:03:35.518460 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.516267    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 23:03:35.518460 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.517164    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 23:03:35.518460 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.517172    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 23:03:35.518460 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517251    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:03:35.518460 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517257    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:03:35.518460 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517260    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:03:35.518460 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517263    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:03:35.518460 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517266    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:03:35.518460 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517269    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517271    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517280    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517283    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517286    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517289    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517291    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517300    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517303    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517306    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517308    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517311    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517314    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517316    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517319    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517322    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517324    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517327    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517331    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:03:35.518812 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517335    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517338    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517340    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517362    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517365    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517368    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517372    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517374    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517377    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517380    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517383    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517387    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517390    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517394    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517398    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517401    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517410    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517413    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517416    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:03:35.519300 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517419    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517422    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517425    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517427    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517430    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517432    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517435    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517437    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517440    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517442    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517445    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517447    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517450    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517452    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517455    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517458    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517460    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517463    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517466    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517469    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:03:35.519775 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517472    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517474    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517477    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517479    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517482    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517484    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517487    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517489    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517492    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517495    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517503    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517505    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517508    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517510    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517513    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517515    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517518    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517521    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517523    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517526    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:03:35.520238 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517528    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:03:35.520737 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517531    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:03:35.520737 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517534    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:03:35.520737 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517536    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:03:35.520737 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517538    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:03:35.520737 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517541    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:03:35.520737 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517543    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:03:35.520737 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517547    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:03:35.520737 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517549    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:03:35.520737 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517551    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:03:35.520737 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517555    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:03:35.520737 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517558    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:03:35.520737 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517560    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:03:35.520737 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517563    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:03:35.520737 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517565    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:03:35.520737 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517568    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:03:35.521108 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.517573    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 23:03:35.521108 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517730    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:03:35.521108 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517734    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:03:35.521108 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517737    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:03:35.521108 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517740    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:03:35.521108 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517743    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:03:35.521108 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517746    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:03:35.521108 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517754    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:03:35.521108 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517757    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:03:35.521108 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517760    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:03:35.521108 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517763    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:03:35.521108 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517765    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:03:35.521108 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517768    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:03:35.521108 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517770    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:03:35.521108 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517773    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517776    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517778    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517781    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517783    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517786    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517788    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517791    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517793    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517795    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517798    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517800    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517803    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517806    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517808    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517811    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517813    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517816    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517818    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517821    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:03:35.521489 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517825    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517828    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517831    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517834    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517837    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517841    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517849    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517852    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517855    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517858    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517861    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517864    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517866    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517868    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517871    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517874    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517876    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517879    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517882    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:03:35.521975 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517884    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517887    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517889    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517892    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517894    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517898    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517900    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517902    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517905    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517908    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517911    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517913    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517916    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517918    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517921    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517923    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517926    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517928    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517931    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:03:35.522451 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517933    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517941    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517944    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517947    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517949    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517952    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517954    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517956    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517959    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517961    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517964    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517966    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517969    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517971    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517974    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517976    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517979    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517981    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517984    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517987    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:03:35.522928 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517989    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:03:35.523431 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517992    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:03:35.523431 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517995    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:03:35.523431 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.517997    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:03:35.523431 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.518000    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:03:35.523431 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.518002    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:03:35.523431 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.518005    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:03:35.523431 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:35.518007    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:03:35.523431 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.518012    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 23:03:35.523431 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.518116    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 23:03:35.523431 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.522203    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 23:03:35.523431 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.523371    2562 server.go:1019] "Starting client certificate rotation"
Sep 09 23:03:35.523867 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.523478    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 23:03:35.523867 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.523518    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 23:03:35.526360 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.526330    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 23:03:35.530375 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.530332    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 23:03:35.540703 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.540682    2562 log.go:25] "Validated CRI v1 runtime API"
Sep 09 23:03:35.545499 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.545482    2562 log.go:25] "Validated CRI v1 image API"
Sep 09 23:03:35.546465 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.546442    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 23:03:35.549075 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.549056    2562 fs.go:135] Filesystem UUIDs: map[18c0c17f-1f38-47ab-aa90-24e4d99ccfb3:/dev/nvme0n1p4 5c29c652-9233-4aff-aee9-c7cf5ab5daa0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 09 23:03:35.549121 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.549075    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 23:03:35.554257 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.554140    2562 manager.go:216] Machine: {Timestamp:2026-09-09 23:03:35.552731566 +0000 UTC m=+0.335771941 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110389 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f2a0f3f4f727a13949400cbee0fde SystemUUID:ec2f2a0f-3f4f-727a-1394-9400cbee0fde BootID:68e0d652-8d49-4c3c-ab7d-8485b174d590 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:44:ca:71:1f:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:44:ca:71:1f:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:b8:97:9b:82:37 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 23:03:35.554257 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.554245    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 23:03:35.554402 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.554325    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 23:03:35.555511 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.555496    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 23:03:35.558099 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.558078    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 23:03:35.558232 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.558102    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-73.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 23:03:35.558946 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.558936    2562 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 23:03:35.558985 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.558949    2562 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 23:03:35.558985 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.558957    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 23:03:35.559789 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.559779    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 23:03:35.561718 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.561707    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 23:03:35.566307 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.566296    2562 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 23:03:35.566433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.566423    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 23:03:35.566474 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.566452    2562 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 23:03:35.566474 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.566463    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 23:03:35.566545 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.566478    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 23:03:35.566545 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.566487    2562 kubelet.go:398] "Adding apiserver pod source"
Sep 09 23:03:35.566545 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.566497    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 23:03:35.566865 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.566852    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 23:03:35.566899 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.566874    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 23:03:35.569828 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.569812    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 23:03:35.572776 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.572762    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 23:03:35.572830 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.572792    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 23:03:35.572940 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.572930    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 23:03:35.572977 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.572952    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 23:03:35.572977 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.572958    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 23:03:35.572977 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.572963    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 23:03:35.572977 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.572971    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 23:03:35.572977 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.572976    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 23:03:35.573646 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.573634    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 23:03:35.573646 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.573646    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 23:03:35.573711 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.573654    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 23:03:35.573711 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.573659    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 23:03:35.573711 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.573672    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 23:03:35.573711 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.573680    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 23:03:35.575365 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.575340    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 23:03:35.575365 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.575361    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 23:03:35.577587 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.577398    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 23:03:35.577679 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.577518    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 23:03:35.579845 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.579828    2562 server.go:1268] "Started kubelet"
Sep 09 23:03:35.579986 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.579924    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 23:03:35.580085 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.580006    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 23:03:35.580085 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.579936    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 23:03:35.580831 ip-10-0-131-73 systemd[1]: Started Kubernetes Kubelet.
Sep 09 23:03:35.581870 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.581428    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 23:03:35.581995 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.581975    2562 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 23:03:35.586981 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.586959    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 23:03:35.587386 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.587370    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 23:03:35.588150 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.588132    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 23:03:35.588262 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.588243    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-73.ec2.internal\" not found"
Sep 09 23:03:35.589006 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.588991    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 23:03:35.589006 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.588993    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 23:03:35.589135 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.589019    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 23:03:35.589135 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.589065    2562 factory.go:153] Registering CRI-O factory
Sep 09 23:03:35.589135 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.589084    2562 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 23:03:35.589135 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.589090    2562 factory.go:223] Registration of the crio container factory successfully
Sep 09 23:03:35.589135 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.589094    2562 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 23:03:35.589135 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.589131    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 23:03:35.589432 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.589146    2562 factory.go:55] Registering systemd factory
Sep 09 23:03:35.589432 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.589151    2562 factory.go:223] Registration of the systemd container factory successfully
Sep 09 23:03:35.589432 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.589163    2562 factory.go:103] Registering Raw factory
Sep 09 23:03:35.589432 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.589173    2562 manager.go:1196] Started watching for new ooms in manager
Sep 09 23:03:35.589626 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.589439    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-73.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 23:03:35.589626 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.589571    2562 manager.go:349] Starting recovery of all containers
Sep 09 23:03:35.590546 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.589449    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-73.ec2.internal.18d3c97cf893eccb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-73.ec2.internal,UID:ip-10-0-131-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-73.ec2.internal,},FirstTimestamp:2026-09-09 23:03:35.579790539 +0000 UTC m=+0.362830913,LastTimestamp:2026-09-09 23:03:35.579790539 +0000 UTC m=+0.362830913,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-73.ec2.internal,}"
Sep 09 23:03:35.594093 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.594064    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 23:03:35.594196 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.594152    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 23:03:35.599242 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.599083    2562 manager.go:354] Recovery completed
Sep 09 23:03:35.600158 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.600134    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bnjf4"
Sep 09 23:03:35.605326 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.605314    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:03:35.606809 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.606793    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bnjf4"
Sep 09 23:03:35.608202 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.608183    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:03:35.608282 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.608211    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:03:35.608282 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.608222    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:03:35.608802 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.608787    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 23:03:35.608802 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.608799    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 23:03:35.608910 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.608814    2562 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 23:03:35.608910 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.608826    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:03:35.610167 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.610107    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-73.ec2.internal.18d3c97cfa456887  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-73.ec2.internal,UID:ip-10-0-131-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-73.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-73.ec2.internal,},FirstTimestamp:2026-09-09 23:03:35.608199303 +0000 UTC m=+0.391239678,LastTimestamp:2026-09-09 23:03:35.608199303 +0000 UTC m=+0.391239678,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-73.ec2.internal,}"
Sep 09 23:03:35.610751 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.610740    2562 policy_none.go:49] "None policy: Start"
Sep 09 23:03:35.610803 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.610755    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 23:03:35.610803 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.610765    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 23:03:35.612675 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.612664    2562 policy_none.go:47] "Start"
Sep 09 23:03:35.614028 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.614012    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:03:35.614109 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.614037    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:03:35.614109 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.614050    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:03:35.652926 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.652910    2562 manager.go:337] "Starting Device Plugin manager"
Sep 09 23:03:35.671242 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.652950    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 23:03:35.671242 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.652964    2562 server.go:87] "Starting device plugin registration server"
Sep 09 23:03:35.671242 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.653259    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 23:03:35.671242 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.653272    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 23:03:35.671242 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.653387    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 23:03:35.671242 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.653464    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 23:03:35.671242 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.653471    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 23:03:35.671242 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.655318    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 23:03:35.671242 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.655391    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-73.ec2.internal\" not found"
Sep 09 23:03:35.714801 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.714770    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 23:03:35.715946 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.715921    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 23:03:35.716047 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.715978    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 23:03:35.716047 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.716011    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 23:03:35.716144 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.716099    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 23:03:35.718273 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.718254    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:03:35.754265 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.754168    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:03:35.755142 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.755125    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:03:35.755218 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.755156    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:03:35.755218 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.755170    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:03:35.755218 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.755196    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-73.ec2.internal"
Sep 09 23:03:35.763626 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.763611    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-73.ec2.internal"
Sep 09 23:03:35.763679 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.763633    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-73.ec2.internal\": node \"ip-10-0-131-73.ec2.internal\" not found"
Sep 09 23:03:35.789413 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.789395    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-73.ec2.internal\" not found"
Sep 09 23:03:35.816831 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.816811    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-73.ec2.internal"]
Sep 09 23:03:35.816893 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.816871    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:03:35.817770 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.817752    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:03:35.817837 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.817781    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:03:35.817837 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.817793    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:03:35.820103 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.820091    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:03:35.820210 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.820185    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal"
Sep 09 23:03:35.820210 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.820207    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:03:35.820875 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.820858    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:03:35.820961 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.820879    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:03:35.820961 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.820889    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:03:35.820961 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.820915    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:03:35.820961 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.820937    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:03:35.820961 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.820951    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:03:35.823133 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.823116    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-73.ec2.internal"
Sep 09 23:03:35.823205 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.823145    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:03:35.823862 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.823844    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:03:35.823945 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.823874    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:03:35.823945 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.823890    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:03:35.842983 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.842962    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-73.ec2.internal\" not found" node="ip-10-0-131-73.ec2.internal"
Sep 09 23:03:35.847266 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.847251    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-73.ec2.internal\" not found" node="ip-10-0-131-73.ec2.internal"
Sep 09 23:03:35.890359 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.890326    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-73.ec2.internal\" not found"
Sep 09 23:03:35.890490 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.890412    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b5ca6b5d6434f57b84c52cbf979bd78-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal\" (UID: \"7b5ca6b5d6434f57b84c52cbf979bd78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal"
Sep 09 23:03:35.890490 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.890432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b5ca6b5d6434f57b84c52cbf979bd78-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal\" (UID: \"7b5ca6b5d6434f57b84c52cbf979bd78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal"
Sep 09 23:03:35.890490 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.890449    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/afe036642cdfcb6c198b1022c1ca77eb-config\") pod \"kube-apiserver-proxy-ip-10-0-131-73.ec2.internal\" (UID: \"afe036642cdfcb6c198b1022c1ca77eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-73.ec2.internal"
Sep 09 23:03:35.991104 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:35.991058    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-73.ec2.internal\" not found"
Sep 09 23:03:35.991104 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.991084    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b5ca6b5d6434f57b84c52cbf979bd78-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal\" (UID: \"7b5ca6b5d6434f57b84c52cbf979bd78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal"
Sep 09 23:03:35.991104 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.991111    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b5ca6b5d6434f57b84c52cbf979bd78-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal\" (UID: \"7b5ca6b5d6434f57b84c52cbf979bd78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal"
Sep 09 23:03:35.991325 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.991123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b5ca6b5d6434f57b84c52cbf979bd78-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal\" (UID: \"7b5ca6b5d6434f57b84c52cbf979bd78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal"
Sep 09 23:03:35.991325 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.991140    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/afe036642cdfcb6c198b1022c1ca77eb-config\") pod \"kube-apiserver-proxy-ip-10-0-131-73.ec2.internal\" (UID: \"afe036642cdfcb6c198b1022c1ca77eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-73.ec2.internal"
Sep 09 23:03:35.991325 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.991165    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/afe036642cdfcb6c198b1022c1ca77eb-config\") pod \"kube-apiserver-proxy-ip-10-0-131-73.ec2.internal\" (UID: \"afe036642cdfcb6c198b1022c1ca77eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-73.ec2.internal"
Sep 09 23:03:35.991325 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:35.991167    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b5ca6b5d6434f57b84c52cbf979bd78-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal\" (UID: \"7b5ca6b5d6434f57b84c52cbf979bd78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal"
Sep 09 23:03:36.091840 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:36.091761    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-73.ec2.internal\" not found"
Sep 09 23:03:36.145943 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:36.145917    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal"
Sep 09 23:03:36.150259 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:36.150240    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-73.ec2.internal"
Sep 09 23:03:36.192319 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:36.192286    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-73.ec2.internal\" not found"
Sep 09 23:03:36.292405 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:36.292381    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-73.ec2.internal\" not found"
Sep 09 23:03:36.393257 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:36.393188    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-73.ec2.internal\" not found"
Sep 09 23:03:36.494025 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:36.493991    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-73.ec2.internal\" not found"
Sep 09 23:03:36.523362 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:36.523328    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 23:03:36.523764 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:36.523453    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 23:03:36.523764 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:36.523496    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:03:36.594556 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:36.594528    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-73.ec2.internal\" not found"
Sep 09 23:03:36.597485 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:36.597468    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:03:36.609439 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:36.609404    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 22:58:36 +0000 UTC" deadline="2028-05-07 22:08:26.764862835 +0000 UTC"
Sep 09 23:03:36.609439 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:36.609435    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14543h4m50.155430974s"
Sep 09 23:03:36.690804 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:36.690722    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal"
Sep 09 23:03:36.704031 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:36.704009    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 23:03:36.705912 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:36.705897    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-73.ec2.internal"
Sep 09 23:03:36.714546 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:36.714531    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 23:03:36.928486 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:36.928458    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:03:36.967591 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:36.967542    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b5ca6b5d6434f57b84c52cbf979bd78.slice/crio-ce374bd89464a73fb37dbcc35be4b413807834d2178d30ebf5a6cc8e25e75864 WatchSource:0}: Error finding container ce374bd89464a73fb37dbcc35be4b413807834d2178d30ebf5a6cc8e25e75864: Status 404 returned error can't find the container with id ce374bd89464a73fb37dbcc35be4b413807834d2178d30ebf5a6cc8e25e75864
Sep 09 23:03:36.967862 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:36.967842    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe036642cdfcb6c198b1022c1ca77eb.slice/crio-ab0393ef4865718373625913616d2ec94302d60fc61007ed939b31a6aba6db19 WatchSource:0}: Error finding container ab0393ef4865718373625913616d2ec94302d60fc61007ed939b31a6aba6db19: Status 404 returned error can't find the container with id ab0393ef4865718373625913616d2ec94302d60fc61007ed939b31a6aba6db19
Sep 09 23:03:36.971397 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:36.971382    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:03:37.363730 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.363631    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:03:37.569899 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.569852    2562 apiserver.go:52] "Watching apiserver"
Sep 09 23:03:37.578345 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.578319    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 23:03:37.580249 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.580225    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5","openshift-cluster-node-tuning-operator/tuned-mvjpb","openshift-dns/node-resolver-5sd94","openshift-image-registry/node-ca-chj99","openshift-network-operator/iptables-alerter-vrrd5","kube-system/global-pull-secret-syncer-tblgp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal","openshift-multus/multus-additional-cni-plugins-rwl6c","openshift-multus/multus-h6244","openshift-multus/network-metrics-daemon-dwb45","openshift-network-diagnostics/network-check-target-rbfm8","openshift-ovn-kubernetes/ovnkube-node-ffztl","kube-system/konnectivity-agent-5rbbz","kube-system/kube-apiserver-proxy-ip-10-0-131-73.ec2.internal"]
Sep 09 23:03:37.584231 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.584208    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:37.584331 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:37.584312    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:03:37.586432 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.586407    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:37.586477 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:37.586461    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:03:37.587858 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.587834    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 23:03:37.588699 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.588681    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5sd94"
Sep 09 23:03:37.590952 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.590930    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 23:03:37.591055 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.591038    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 23:03:37.591117 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.591038    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jmczk\""
Sep 09 23:03:37.591117 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.591082    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-chj99"
Sep 09 23:03:37.593480 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.593459    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.593815 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.593698    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-g6vml\""
Sep 09 23:03:37.593815 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.593750    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 23:03:37.593994 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.593825    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 23:03:37.594307 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.594292    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 23:03:37.595768 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.595739    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xxvbn\""
Sep 09 23:03:37.595842 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.595813    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 23:03:37.596247 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.595745    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:37.596247 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:37.595968    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:03:37.596247 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.596045    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 23:03:37.596247 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.596133    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 23:03:37.596247 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.596172    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 23:03:37.596759 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.596736    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 23:03:37.599607 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.599587    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 23:03:37.600191 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.600162    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llsmm\" (UniqueName: \"kubernetes.io/projected/e6ce54c2-4e66-4b37-96fe-d348247d7628-kube-api-access-llsmm\") pod \"node-ca-chj99\" (UID: \"e6ce54c2-4e66-4b37-96fe-d348247d7628\") " pod="openshift-image-registry/node-ca-chj99"
Sep 09 23:03:37.600282 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.600213    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8bfn\" (UniqueName: \"kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn\") pod \"network-check-target-rbfm8\" (UID: \"93c766f9-7d3d-472f-ac3e-232f9b925b1a\") " pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:37.600282 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.600241    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6397c170-a04a-4a23-8705-2d1033baca7e-hosts-file\") pod \"node-resolver-5sd94\" (UID: \"6397c170-a04a-4a23-8705-2d1033baca7e\") " pod="openshift-dns/node-resolver-5sd94"
Sep 09 23:03:37.600391 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.600281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx9z4\" (UniqueName: \"kubernetes.io/projected/6397c170-a04a-4a23-8705-2d1033baca7e-kube-api-access-sx9z4\") pod \"node-resolver-5sd94\" (UID: \"6397c170-a04a-4a23-8705-2d1033baca7e\") " pod="openshift-dns/node-resolver-5sd94"
Sep 09 23:03:37.600391 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.600317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs\") pod \"network-metrics-daemon-dwb45\" (UID: \"c31b5254-ff30-4381-bcbd-d09e9d6fd177\") " pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:37.600391 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.600350    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47qdf\" (UniqueName: \"kubernetes.io/projected/c31b5254-ff30-4381-bcbd-d09e9d6fd177-kube-api-access-47qdf\") pod \"network-metrics-daemon-dwb45\" (UID: \"c31b5254-ff30-4381-bcbd-d09e9d6fd177\") " pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:37.600391 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.600382    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6397c170-a04a-4a23-8705-2d1033baca7e-tmp-dir\") pod \"node-resolver-5sd94\" (UID: \"6397c170-a04a-4a23-8705-2d1033baca7e\") " pod="openshift-dns/node-resolver-5sd94"
Sep 09 23:03:37.600580 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.600407    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6ce54c2-4e66-4b37-96fe-d348247d7628-host\") pod \"node-ca-chj99\" (UID: \"e6ce54c2-4e66-4b37-96fe-d348247d7628\") " pod="openshift-image-registry/node-ca-chj99"
Sep 09 23:03:37.600580 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.600450    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.600580 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.600488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6ce54c2-4e66-4b37-96fe-d348247d7628-serviceca\") pod \"node-ca-chj99\" (UID: \"e6ce54c2-4e66-4b37-96fe-d348247d7628\") " pod="openshift-image-registry/node-ca-chj99"
Sep 09 23:03:37.602774 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.602756    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5rbbz"
Sep 09 23:03:37.602860 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.602849    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 23:03:37.602921 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.602881    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zq6sg\""
Sep 09 23:03:37.604958 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.604939    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bdx42\""
Sep 09 23:03:37.605182 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.605161    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 23:03:37.605182 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.605165    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.605378 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.605220    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 23:03:37.607349 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.607328    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pxz5c\""
Sep 09 23:03:37.607474 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.607394    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 23:03:37.607552 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.607482    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:03:37.607746 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.607728    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.610188 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.610171    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.610285 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.610177    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9dgfn\""
Sep 09 23:03:37.610349 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.610336    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 23:03:37.610442 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.610428    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 23:03:37.610625 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.610605    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 23:03:37.612821 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.612800    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vrrd5"
Sep 09 23:03:37.612914 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.612902    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 23:03:37.612980 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.612917    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rjx5p\""
Sep 09 23:03:37.613268 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.613241    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 23:03:37.613268 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.613252    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 23:03:37.613268 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.613269    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 23:03:37.613522 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.613421    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 23:03:37.613614 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.613598    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 23:03:37.615596 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.615549    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cq98b\""
Sep 09 23:03:37.615681 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.615660    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 23:03:37.615754 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.615707    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:03:37.615934 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.615918    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 23:03:37.617908 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.617893    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xn2xd"
Sep 09 23:03:37.625401 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.625368    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xn2xd"
Sep 09 23:03:37.689843 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.689810    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 23:03:37.700667 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.700636    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/276a69fc-219e-4197-95e9-9de1e887a864-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.700797 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.700667    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-systemd\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.700797 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.700707    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-var-lib-kubelet\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.700797 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.700732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-multus-cni-dir\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.700797 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.700756    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-var-lib-cni-bin\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.700797 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.700783    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-cni-netd\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.701028 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.700816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx9z4\" (UniqueName: \"kubernetes.io/projected/6397c170-a04a-4a23-8705-2d1033baca7e-kube-api-access-sx9z4\") pod \"node-resolver-5sd94\" (UID: \"6397c170-a04a-4a23-8705-2d1033baca7e\") " pod="openshift-dns/node-resolver-5sd94"
Sep 09 23:03:37.701028 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.700878    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret\") pod \"global-pull-secret-syncer-tblgp\" (UID: \"b32f3790-a36e-4aeb-ac84-96e6ce77d480\") " pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:37.701028 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.700910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-sysctl-conf\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.701028 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.700935    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-run-systemd\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.701028 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.700962    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6ce54c2-4e66-4b37-96fe-d348247d7628-serviceca\") pod \"node-ca-chj99\" (UID: \"e6ce54c2-4e66-4b37-96fe-d348247d7628\") " pod="openshift-image-registry/node-ca-chj99"
Sep 09 23:03:37.701028 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.700980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-device-dir\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.701028 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-systemd-units\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.701354 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701041    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-node-log\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.701354 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701069    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bfn\" (UniqueName: \"kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn\") pod \"network-check-target-rbfm8\" (UID: \"93c766f9-7d3d-472f-ac3e-232f9b925b1a\") " pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:37.701354 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/276a69fc-219e-4197-95e9-9de1e887a864-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.701354 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-sys\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.701354 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701144    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv8m4\" (UniqueName: \"kubernetes.io/projected/0ea771b6-3bb4-4c69-953c-8505f76b3642-kube-api-access-dv8m4\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.701354 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701167    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtr5w\" (UniqueName: \"kubernetes.io/projected/e4de158d-eae6-4f19-9c0c-7c3d2758c188-kube-api-access-jtr5w\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.701354 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-var-lib-openvswitch\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.701354 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701236    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47qdf\" (UniqueName: \"kubernetes.io/projected/c31b5254-ff30-4381-bcbd-d09e9d6fd177-kube-api-access-47qdf\") pod \"network-metrics-daemon-dwb45\" (UID: \"c31b5254-ff30-4381-bcbd-d09e9d6fd177\") " pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:37.701354 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701254    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-sysctl-d\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.701354 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701279    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-run\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.701354 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-host\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.701354 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701338    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-multus-socket-dir-parent\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.702032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701376    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-run-k8s-cni-cncf-io\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.702032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701426    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-multus-daemon-config\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.702032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-kubelet-dir\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.702032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701478    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea-konnectivity-ca\") pod \"konnectivity-agent-5rbbz\" (UID: \"fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea\") " pod="kube-system/konnectivity-agent-5rbbz"
Sep 09 23:03:37.702032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ea771b6-3bb4-4c69-953c-8505f76b3642-tmp\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.702032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701528    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-etc-selinux\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.702032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-run-openvswitch\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.702032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701609    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs\") pod \"network-metrics-daemon-dwb45\" (UID: \"c31b5254-ff30-4381-bcbd-d09e9d6fd177\") " pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:37.702032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llsmm\" (UniqueName: \"kubernetes.io/projected/e6ce54c2-4e66-4b37-96fe-d348247d7628-kube-api-access-llsmm\") pod \"node-ca-chj99\" (UID: \"e6ce54c2-4e66-4b37-96fe-d348247d7628\") " pod="openshift-image-registry/node-ca-chj99"
Sep 09 23:03:37.702032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-kubernetes\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.702032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701718    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmvcl\" (UniqueName: \"kubernetes.io/projected/77e2c92a-84a7-43d7-adca-a801a8d698ec-kube-api-access-bmvcl\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.702032 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:37.701732    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:03:37.702032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701766    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/276a69fc-219e-4197-95e9-9de1e887a864-system-cni-dir\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.702032 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:37.701863    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs podName:c31b5254-ff30-4381-bcbd-d09e9d6fd177 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:38.201813833 +0000 UTC m=+2.984854214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs") pod "network-metrics-daemon-dwb45" (UID: "c31b5254-ff30-4381-bcbd-d09e9d6fd177") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:03:37.702032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701894    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/276a69fc-219e-4197-95e9-9de1e887a864-cni-binary-copy\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.702032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-hostroot\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-registration-dir\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701975    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-kubelet\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.701995    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-etc-openvswitch\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702020    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77e2c92a-84a7-43d7-adca-a801a8d698ec-ovnkube-script-lib\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skswr\" (UniqueName: \"kubernetes.io/projected/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-kube-api-access-skswr\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6ce54c2-4e66-4b37-96fe-d348247d7628-host\") pod \"node-ca-chj99\" (UID: \"e6ce54c2-4e66-4b37-96fe-d348247d7628\") " pod="openshift-image-registry/node-ca-chj99"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702084    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-slash\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702103    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-run-ovn\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702139    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6ce54c2-4e66-4b37-96fe-d348247d7628-host\") pod \"node-ca-chj99\" (UID: \"e6ce54c2-4e66-4b37-96fe-d348247d7628\") " pod="openshift-image-registry/node-ca-chj99"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702150    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6ce54c2-4e66-4b37-96fe-d348247d7628-serviceca\") pod \"node-ca-chj99\" (UID: \"e6ce54c2-4e66-4b37-96fe-d348247d7628\") " pod="openshift-image-registry/node-ca-chj99"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-cni-bin\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702226    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77e2c92a-84a7-43d7-adca-a801a8d698ec-env-overrides\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e2a5084a-7d0d-495a-a7b3-63c8701a0569-iptables-alerter-script\") pod \"iptables-alerter-vrrd5\" (UID: \"e2a5084a-7d0d-495a-a7b3-63c8701a0569\") " pod="openshift-network-operator/iptables-alerter-vrrd5"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702339    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b32f3790-a36e-4aeb-ac84-96e6ce77d480-dbus\") pod \"global-pull-secret-syncer-tblgp\" (UID: \"b32f3790-a36e-4aeb-ac84-96e6ce77d480\") " pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702395    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-sysconfig\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702423    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-tuned\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.702787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702493    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-var-lib-kubelet\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.703696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702515    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-run-multus-certs\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.703696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fhmr\" (UniqueName: \"kubernetes.io/projected/e2a5084a-7d0d-495a-a7b3-63c8701a0569-kube-api-access-7fhmr\") pod \"iptables-alerter-vrrd5\" (UID: \"e2a5084a-7d0d-495a-a7b3-63c8701a0569\") " pod="openshift-network-operator/iptables-alerter-vrrd5"
Sep 09 23:03:37.703696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702592    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-modprobe-d\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.703696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702621    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-socket-dir\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.703696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702648    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-sys-fs\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.703696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702667    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2a5084a-7d0d-495a-a7b3-63c8701a0569-host-slash\") pod \"iptables-alerter-vrrd5\" (UID: \"e2a5084a-7d0d-495a-a7b3-63c8701a0569\") " pod="openshift-network-operator/iptables-alerter-vrrd5"
Sep 09 23:03:37.703696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/276a69fc-219e-4197-95e9-9de1e887a864-cnibin\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.703696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702702    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea-agent-certs\") pod \"konnectivity-agent-5rbbz\" (UID: \"fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea\") " pod="kube-system/konnectivity-agent-5rbbz"
Sep 09 23:03:37.703696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-lib-modules\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.703696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702770    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-system-cni-dir\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.703696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702784    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-var-lib-cni-multus\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.703696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702800    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-etc-kubernetes\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.703696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702836    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77e2c92a-84a7-43d7-adca-a801a8d698ec-ovnkube-config\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.703696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702870    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/276a69fc-219e-4197-95e9-9de1e887a864-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.703696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702898    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plzf4\" (UniqueName: \"kubernetes.io/projected/276a69fc-219e-4197-95e9-9de1e887a864-kube-api-access-plzf4\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.703696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702924    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-cnibin\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.704221 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-cni-binary-copy\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.704221 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.702973    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-run-netns\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.704221 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.703045    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-run-netns\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.704221 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.703083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-log-socket\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.704221 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.703119    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.704221 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.703152    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6397c170-a04a-4a23-8705-2d1033baca7e-hosts-file\") pod \"node-resolver-5sd94\" (UID: \"6397c170-a04a-4a23-8705-2d1033baca7e\") " pod="openshift-dns/node-resolver-5sd94"
Sep 09 23:03:37.704221 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.703179    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b32f3790-a36e-4aeb-ac84-96e6ce77d480-kubelet-config\") pod \"global-pull-secret-syncer-tblgp\" (UID: \"b32f3790-a36e-4aeb-ac84-96e6ce77d480\") " pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:37.704221 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.703205    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-multus-conf-dir\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.704221 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.703245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.704221 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.703270    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77e2c92a-84a7-43d7-adca-a801a8d698ec-ovn-node-metrics-cert\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.704221 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.703297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6397c170-a04a-4a23-8705-2d1033baca7e-tmp-dir\") pod \"node-resolver-5sd94\" (UID: \"6397c170-a04a-4a23-8705-2d1033baca7e\") " pod="openshift-dns/node-resolver-5sd94"
Sep 09 23:03:37.704221 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.703296    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6397c170-a04a-4a23-8705-2d1033baca7e-hosts-file\") pod \"node-resolver-5sd94\" (UID: \"6397c170-a04a-4a23-8705-2d1033baca7e\") " pod="openshift-dns/node-resolver-5sd94"
Sep 09 23:03:37.704221 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.703692    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6397c170-a04a-4a23-8705-2d1033baca7e-tmp-dir\") pod \"node-resolver-5sd94\" (UID: \"6397c170-a04a-4a23-8705-2d1033baca7e\") " pod="openshift-dns/node-resolver-5sd94"
Sep 09 23:03:37.709195 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.709164    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 23:03:37.709384 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:37.709366    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:03:37.709471 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:37.709391    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:03:37.709471 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:37.709405    2562 projected.go:196] Error preparing data for projected volume kube-api-access-n8bfn for pod openshift-network-diagnostics/network-check-target-rbfm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:03:37.709582 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:37.709480    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn podName:93c766f9-7d3d-472f-ac3e-232f9b925b1a nodeName:}" failed. No retries permitted until 2026-09-09 23:03:38.209462393 +0000 UTC m=+2.992502764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n8bfn" (UniqueName: "kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn") pod "network-check-target-rbfm8" (UID: "93c766f9-7d3d-472f-ac3e-232f9b925b1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:03:37.713382 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.713347    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llsmm\" (UniqueName: \"kubernetes.io/projected/e6ce54c2-4e66-4b37-96fe-d348247d7628-kube-api-access-llsmm\") pod \"node-ca-chj99\" (UID: \"e6ce54c2-4e66-4b37-96fe-d348247d7628\") " pod="openshift-image-registry/node-ca-chj99"
Sep 09 23:03:37.713476 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.713351    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx9z4\" (UniqueName: \"kubernetes.io/projected/6397c170-a04a-4a23-8705-2d1033baca7e-kube-api-access-sx9z4\") pod \"node-resolver-5sd94\" (UID: \"6397c170-a04a-4a23-8705-2d1033baca7e\") " pod="openshift-dns/node-resolver-5sd94"
Sep 09 23:03:37.713529 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.713488    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47qdf\" (UniqueName: \"kubernetes.io/projected/c31b5254-ff30-4381-bcbd-d09e9d6fd177-kube-api-access-47qdf\") pod \"network-metrics-daemon-dwb45\" (UID: \"c31b5254-ff30-4381-bcbd-d09e9d6fd177\") " pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:37.721372 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.721322    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-73.ec2.internal" event={"ID":"afe036642cdfcb6c198b1022c1ca77eb","Type":"ContainerStarted","Data":"ab0393ef4865718373625913616d2ec94302d60fc61007ed939b31a6aba6db19"}
Sep 09 23:03:37.722679 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.722656    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal" event={"ID":"7b5ca6b5d6434f57b84c52cbf979bd78","Type":"ContainerStarted","Data":"ce374bd89464a73fb37dbcc35be4b413807834d2178d30ebf5a6cc8e25e75864"}
Sep 09 23:03:37.803896 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.803863    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/276a69fc-219e-4197-95e9-9de1e887a864-cnibin\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.804026 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.803908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea-agent-certs\") pod \"konnectivity-agent-5rbbz\" (UID: \"fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea\") " pod="kube-system/konnectivity-agent-5rbbz"
Sep 09 23:03:37.804026 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.803936    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-lib-modules\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.804026 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.803942    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/276a69fc-219e-4197-95e9-9de1e887a864-cnibin\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.804026 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.803962    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-system-cni-dir\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.804026 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804002    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-var-lib-cni-multus\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.804026 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804026    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-etc-kubernetes\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.804347 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804050    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77e2c92a-84a7-43d7-adca-a801a8d698ec-ovnkube-config\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.804347 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804077    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/276a69fc-219e-4197-95e9-9de1e887a864-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.804347 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804088    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-lib-modules\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.804347 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804105    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plzf4\" (UniqueName: \"kubernetes.io/projected/276a69fc-219e-4197-95e9-9de1e887a864-kube-api-access-plzf4\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.804347 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-cnibin\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.804347 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804133    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-var-lib-cni-multus\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.804347 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804144    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-etc-kubernetes\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.804347 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804156    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-cni-binary-copy\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.804347 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804177    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-system-cni-dir\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.804347 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804211    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-cnibin\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.804347 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804248    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-run-netns\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.804347 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804277    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-run-netns\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.804347 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804303    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-log-socket\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.804347 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804309    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-run-netns\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.804347 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804330    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804374    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-run-netns\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804363    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b32f3790-a36e-4aeb-ac84-96e6ce77d480-kubelet-config\") pod \"global-pull-secret-syncer-tblgp\" (UID: \"b32f3790-a36e-4aeb-ac84-96e6ce77d480\") " pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804408    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-multus-conf-dir\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804414    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-log-socket\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804419    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804442    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804464    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-multus-conf-dir\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77e2c92a-84a7-43d7-adca-a801a8d698ec-ovn-node-metrics-cert\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804476    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b32f3790-a36e-4aeb-ac84-96e6ce77d480-kubelet-config\") pod \"global-pull-secret-syncer-tblgp\" (UID: \"b32f3790-a36e-4aeb-ac84-96e6ce77d480\") " pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804497    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/276a69fc-219e-4197-95e9-9de1e887a864-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804503    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-run-ovn-kubernetes\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-systemd\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804547    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-var-lib-kubelet\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804570    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-multus-cni-dir\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804592    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-var-lib-cni-bin\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804617    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-cni-netd\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.805111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret\") pod \"global-pull-secret-syncer-tblgp\" (UID: \"b32f3790-a36e-4aeb-ac84-96e6ce77d480\") " pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804667    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-sysctl-conf\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804671    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/276a69fc-219e-4197-95e9-9de1e887a864-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-run-systemd\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804721    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-var-lib-cni-bin\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804722    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-device-dir\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804763    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-systemd-units\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804776    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-device-dir\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-node-log\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804820    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-cni-netd\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804827    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/276a69fc-219e-4197-95e9-9de1e887a864-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804832    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/276a69fc-219e-4197-95e9-9de1e887a864-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804853    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77e2c92a-84a7-43d7-adca-a801a8d698ec-ovnkube-config\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804872    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-cni-binary-copy\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-sys\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804900    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-sys\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:37.804904    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804908    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-node-log\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.805936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804929    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv8m4\" (UniqueName: \"kubernetes.io/projected/0ea771b6-3bb4-4c69-953c-8505f76b3642-kube-api-access-dv8m4\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804949    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-var-lib-kubelet\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804952    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-systemd-units\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:37.804974    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret podName:b32f3790-a36e-4aeb-ac84-96e6ce77d480 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:38.304956153 +0000 UTC m=+3.087996537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret") pod "global-pull-secret-syncer-tblgp" (UID: "b32f3790-a36e-4aeb-ac84-96e6ce77d480") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.804995    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtr5w\" (UniqueName: \"kubernetes.io/projected/e4de158d-eae6-4f19-9c0c-7c3d2758c188-kube-api-access-jtr5w\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805012    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-multus-cni-dir\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805001    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-run-systemd\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805016    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-systemd\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805034    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-var-lib-openvswitch\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805035    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-sysctl-conf\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805337    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-var-lib-openvswitch\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805390    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-sysctl-d\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805416    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-run\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-host\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805466    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-multus-socket-dir-parent\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805489    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-run-k8s-cni-cncf-io\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805501    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-run\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.806900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-multus-daemon-config\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805530    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-sysctl-d\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-kubelet-dir\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805559    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-run-k8s-cni-cncf-io\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805579    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-multus-socket-dir-parent\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805591    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-kubelet-dir\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805582    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea-konnectivity-ca\") pod \"konnectivity-agent-5rbbz\" (UID: \"fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea\") " pod="kube-system/konnectivity-agent-5rbbz"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805612    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-host\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805645    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/276a69fc-219e-4197-95e9-9de1e887a864-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ea771b6-3bb4-4c69-953c-8505f76b3642-tmp\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-etc-selinux\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-run-openvswitch\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805940    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-etc-selinux\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.805938    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-run-openvswitch\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-kubernetes\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmvcl\" (UniqueName: \"kubernetes.io/projected/77e2c92a-84a7-43d7-adca-a801a8d698ec-kube-api-access-bmvcl\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806143    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/276a69fc-219e-4197-95e9-9de1e887a864-system-cni-dir\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.807783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/276a69fc-219e-4197-95e9-9de1e887a864-cni-binary-copy\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806174    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-multus-daemon-config\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806177    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea-konnectivity-ca\") pod \"konnectivity-agent-5rbbz\" (UID: \"fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea\") " pod="kube-system/konnectivity-agent-5rbbz"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-hostroot\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-registration-dir\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806256    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-kubelet\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806259    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/276a69fc-219e-4197-95e9-9de1e887a864-system-cni-dir\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-etc-openvswitch\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806309    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-hostroot\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77e2c92a-84a7-43d7-adca-a801a8d698ec-ovnkube-script-lib\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806350    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skswr\" (UniqueName: \"kubernetes.io/projected/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-kube-api-access-skswr\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806404    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-slash\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-run-ovn\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806464    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-cni-bin\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806497    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77e2c92a-84a7-43d7-adca-a801a8d698ec-env-overrides\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806523    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e2a5084a-7d0d-495a-a7b3-63c8701a0569-iptables-alerter-script\") pod \"iptables-alerter-vrrd5\" (UID: \"e2a5084a-7d0d-495a-a7b3-63c8701a0569\") " pod="openshift-network-operator/iptables-alerter-vrrd5"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806528    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-kubernetes\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b32f3790-a36e-4aeb-ac84-96e6ce77d480-dbus\") pod \"global-pull-secret-syncer-tblgp\" (UID: \"b32f3790-a36e-4aeb-ac84-96e6ce77d480\") " pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:37.808433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806571    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-sysconfig\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-tuned\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806638    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-var-lib-kubelet\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806667    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-run-multus-certs\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fhmr\" (UniqueName: \"kubernetes.io/projected/e2a5084a-7d0d-495a-a7b3-63c8701a0569-kube-api-access-7fhmr\") pod \"iptables-alerter-vrrd5\" (UID: \"e2a5084a-7d0d-495a-a7b3-63c8701a0569\") " pod="openshift-network-operator/iptables-alerter-vrrd5"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-modprobe-d\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806749    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-socket-dir\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806778    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-sys-fs\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806799    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-registration-dir\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806804    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2a5084a-7d0d-495a-a7b3-63c8701a0569-host-slash\") pod \"iptables-alerter-vrrd5\" (UID: \"e2a5084a-7d0d-495a-a7b3-63c8701a0569\") " pod="openshift-network-operator/iptables-alerter-vrrd5"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806858    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2a5084a-7d0d-495a-a7b3-63c8701a0569-host-slash\") pod \"iptables-alerter-vrrd5\" (UID: \"e2a5084a-7d0d-495a-a7b3-63c8701a0569\") " pod="openshift-network-operator/iptables-alerter-vrrd5"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806860    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/276a69fc-219e-4197-95e9-9de1e887a864-cni-binary-copy\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806914    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-slash\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806917    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-etc-openvswitch\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806929    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-kubelet\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.806958    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-run-ovn\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.807000    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-var-lib-kubelet\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.808949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.807034    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b32f3790-a36e-4aeb-ac84-96e6ce77d480-dbus\") pod \"global-pull-secret-syncer-tblgp\" (UID: \"b32f3790-a36e-4aeb-ac84-96e6ce77d480\") " pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:37.809455 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.807103    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-sysconfig\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.809455 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.807153    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77e2c92a-84a7-43d7-adca-a801a8d698ec-host-cni-bin\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.809455 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.807187    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea-agent-certs\") pod \"konnectivity-agent-5rbbz\" (UID: \"fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea\") " pod="kube-system/konnectivity-agent-5rbbz"
Sep 09 23:03:37.809455 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.807240    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-modprobe-d\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.809455 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.807303    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-host-run-multus-certs\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.809455 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.807383    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-socket-dir\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.809455 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.807474    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4de158d-eae6-4f19-9c0c-7c3d2758c188-sys-fs\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.809455 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.807499    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77e2c92a-84a7-43d7-adca-a801a8d698ec-ovnkube-script-lib\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.809455 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.807549    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e2a5084a-7d0d-495a-a7b3-63c8701a0569-iptables-alerter-script\") pod \"iptables-alerter-vrrd5\" (UID: \"e2a5084a-7d0d-495a-a7b3-63c8701a0569\") " pod="openshift-network-operator/iptables-alerter-vrrd5"
Sep 09 23:03:37.809455 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.807732    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77e2c92a-84a7-43d7-adca-a801a8d698ec-env-overrides\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.809455 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.808163    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77e2c92a-84a7-43d7-adca-a801a8d698ec-ovn-node-metrics-cert\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.809455 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.808315    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ea771b6-3bb4-4c69-953c-8505f76b3642-tmp\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.809838 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.809610    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ea771b6-3bb4-4c69-953c-8505f76b3642-etc-tuned\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.816458 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.816387    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skswr\" (UniqueName: \"kubernetes.io/projected/3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba-kube-api-access-skswr\") pod \"multus-h6244\" (UID: \"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba\") " pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.816458 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.816407    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmvcl\" (UniqueName: \"kubernetes.io/projected/77e2c92a-84a7-43d7-adca-a801a8d698ec-kube-api-access-bmvcl\") pod \"ovnkube-node-ffztl\" (UID: \"77e2c92a-84a7-43d7-adca-a801a8d698ec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.816630 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.816519    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtr5w\" (UniqueName: \"kubernetes.io/projected/e4de158d-eae6-4f19-9c0c-7c3d2758c188-kube-api-access-jtr5w\") pod \"aws-ebs-csi-driver-node-svgx5\" (UID: \"e4de158d-eae6-4f19-9c0c-7c3d2758c188\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.816630 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.816449    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv8m4\" (UniqueName: \"kubernetes.io/projected/0ea771b6-3bb4-4c69-953c-8505f76b3642-kube-api-access-dv8m4\") pod \"tuned-mvjpb\" (UID: \"0ea771b6-3bb4-4c69-953c-8505f76b3642\") " pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.816944 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.816923    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plzf4\" (UniqueName: \"kubernetes.io/projected/276a69fc-219e-4197-95e9-9de1e887a864-kube-api-access-plzf4\") pod \"multus-additional-cni-plugins-rwl6c\" (UID: \"276a69fc-219e-4197-95e9-9de1e887a864\") " pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.817145 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.817122    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fhmr\" (UniqueName: \"kubernetes.io/projected/e2a5084a-7d0d-495a-a7b3-63c8701a0569-kube-api-access-7fhmr\") pod \"iptables-alerter-vrrd5\" (UID: \"e2a5084a-7d0d-495a-a7b3-63c8701a0569\") " pod="openshift-network-operator/iptables-alerter-vrrd5"
Sep 09 23:03:37.900701 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.900616    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5sd94"
Sep 09 23:03:37.907610 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.907580    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-chj99"
Sep 09 23:03:37.913336 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:37.913302    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6397c170_a04a_4a23_8705_2d1033baca7e.slice/crio-19e33990a69e0abc9c021430a4bf7ae3380181332d87e579243c8bf4aa40652b WatchSource:0}: Error finding container 19e33990a69e0abc9c021430a4bf7ae3380181332d87e579243c8bf4aa40652b: Status 404 returned error can't find the container with id 19e33990a69e0abc9c021430a4bf7ae3380181332d87e579243c8bf4aa40652b
Sep 09 23:03:37.916629 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.916583    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h6244"
Sep 09 23:03:37.918254 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:37.918227    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ce54c2_4e66_4b37_96fe_d348247d7628.slice/crio-57bcbca1b6cd59c6b642f12a11b0e26231f579f26f53fb0aad08d02800c13f70 WatchSource:0}: Error finding container 57bcbca1b6cd59c6b642f12a11b0e26231f579f26f53fb0aad08d02800c13f70: Status 404 returned error can't find the container with id 57bcbca1b6cd59c6b642f12a11b0e26231f579f26f53fb0aad08d02800c13f70
Sep 09 23:03:37.921717 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.921643    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rwl6c"
Sep 09 23:03:37.928654 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:37.928631    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2eed98_b9e8_4d97_92d6_51d5d3e9d0ba.slice/crio-d24bab74473e87d13a581992265652cbb3736a6bb411b9bc2e1c2da8ad8f9f33 WatchSource:0}: Error finding container d24bab74473e87d13a581992265652cbb3736a6bb411b9bc2e1c2da8ad8f9f33: Status 404 returned error can't find the container with id d24bab74473e87d13a581992265652cbb3736a6bb411b9bc2e1c2da8ad8f9f33
Sep 09 23:03:37.928898 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.928687    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5rbbz"
Sep 09 23:03:37.933125 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:37.933081    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod276a69fc_219e_4197_95e9_9de1e887a864.slice/crio-0ad2b089a05b74ef31f5f3d2e074346ec84962120f1ccf01e36013ee0ac16064 WatchSource:0}: Error finding container 0ad2b089a05b74ef31f5f3d2e074346ec84962120f1ccf01e36013ee0ac16064: Status 404 returned error can't find the container with id 0ad2b089a05b74ef31f5f3d2e074346ec84962120f1ccf01e36013ee0ac16064
Sep 09 23:03:37.935810 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.935783    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mvjpb"
Sep 09 23:03:37.939045 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:37.939021    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbd95d9_1df0_4a1d_a42e_e1c93b3c5bea.slice/crio-310a99f294aab3a8f757198fe98a10451eac3583f1e9ea132aa9958652b58a09 WatchSource:0}: Error finding container 310a99f294aab3a8f757198fe98a10451eac3583f1e9ea132aa9958652b58a09: Status 404 returned error can't find the container with id 310a99f294aab3a8f757198fe98a10451eac3583f1e9ea132aa9958652b58a09
Sep 09 23:03:37.943288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.943265    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5"
Sep 09 23:03:37.947205 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:37.947181    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea771b6_3bb4_4c69_953c_8505f76b3642.slice/crio-0cebce18602a2ef1377ff33d4978e296260dbba991f2b95bb2a915b8736d9781 WatchSource:0}: Error finding container 0cebce18602a2ef1377ff33d4978e296260dbba991f2b95bb2a915b8736d9781: Status 404 returned error can't find the container with id 0cebce18602a2ef1377ff33d4978e296260dbba991f2b95bb2a915b8736d9781
Sep 09 23:03:37.949733 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.949621    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:03:37.954187 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:37.954162    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4de158d_eae6_4f19_9c0c_7c3d2758c188.slice/crio-e34bce6331e9450e5d9830ae5a85fc2f977e2a7d697f9b777d528196eedc979f WatchSource:0}: Error finding container e34bce6331e9450e5d9830ae5a85fc2f977e2a7d697f9b777d528196eedc979f: Status 404 returned error can't find the container with id e34bce6331e9450e5d9830ae5a85fc2f977e2a7d697f9b777d528196eedc979f
Sep 09 23:03:37.956127 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:37.956101    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vrrd5"
Sep 09 23:03:37.961527 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:37.961499    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77e2c92a_84a7_43d7_adca_a801a8d698ec.slice/crio-d77d797aeccb687c984592dd37daa76a0b58652aaa6085d520db5ec37ba1095d WatchSource:0}: Error finding container d77d797aeccb687c984592dd37daa76a0b58652aaa6085d520db5ec37ba1095d: Status 404 returned error can't find the container with id d77d797aeccb687c984592dd37daa76a0b58652aaa6085d520db5ec37ba1095d
Sep 09 23:03:37.967056 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:03:37.967028    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a5084a_7d0d_495a_a7b3_63c8701a0569.slice/crio-95318af11256f20350d2260399a259631e44edb6af242e709814a6349a78a062 WatchSource:0}: Error finding container 95318af11256f20350d2260399a259631e44edb6af242e709814a6349a78a062: Status 404 returned error can't find the container with id 95318af11256f20350d2260399a259631e44edb6af242e709814a6349a78a062
Sep 09 23:03:38.210041 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:38.209939    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bfn\" (UniqueName: \"kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn\") pod \"network-check-target-rbfm8\" (UID: \"93c766f9-7d3d-472f-ac3e-232f9b925b1a\") " pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:38.210041 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:38.210012    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs\") pod \"network-metrics-daemon-dwb45\" (UID: \"c31b5254-ff30-4381-bcbd-d09e9d6fd177\") " pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:38.210276 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:38.210131    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:03:38.210276 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:38.210152    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:03:38.210276 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:38.210164    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:03:38.210276 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:38.210179    2562 projected.go:196] Error preparing data for projected volume kube-api-access-n8bfn for pod openshift-network-diagnostics/network-check-target-rbfm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:03:38.210276 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:38.210227    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs podName:c31b5254-ff30-4381-bcbd-d09e9d6fd177 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:39.210205909 +0000 UTC m=+3.993246275 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs") pod "network-metrics-daemon-dwb45" (UID: "c31b5254-ff30-4381-bcbd-d09e9d6fd177") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:03:38.210276 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:38.210247    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn podName:93c766f9-7d3d-472f-ac3e-232f9b925b1a nodeName:}" failed. No retries permitted until 2026-09-09 23:03:39.210236198 +0000 UTC m=+3.993276569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8bfn" (UniqueName: "kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn") pod "network-check-target-rbfm8" (UID: "93c766f9-7d3d-472f-ac3e-232f9b925b1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:03:38.310895 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:38.310850    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret\") pod \"global-pull-secret-syncer-tblgp\" (UID: \"b32f3790-a36e-4aeb-ac84-96e6ce77d480\") " pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:38.311081 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:38.310988    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:03:38.311081 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:38.311075    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret podName:b32f3790-a36e-4aeb-ac84-96e6ce77d480 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:39.311052027 +0000 UTC m=+4.094092410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret") pod "global-pull-secret-syncer-tblgp" (UID: "b32f3790-a36e-4aeb-ac84-96e6ce77d480") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:03:38.628523 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:38.628424    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 22:58:38 +0000 UTC" deadline="2028-04-20 23:21:35.885752341 +0000 UTC"
Sep 09 23:03:38.628523 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:38.628470    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14136h17m57.257285004s"
Sep 09 23:03:38.726332 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:38.726290    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5sd94" event={"ID":"6397c170-a04a-4a23-8705-2d1033baca7e","Type":"ContainerStarted","Data":"19e33990a69e0abc9c021430a4bf7ae3380181332d87e579243c8bf4aa40652b"}
Sep 09 23:03:38.728108 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:38.728076    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl" event={"ID":"77e2c92a-84a7-43d7-adca-a801a8d698ec","Type":"ContainerStarted","Data":"d77d797aeccb687c984592dd37daa76a0b58652aaa6085d520db5ec37ba1095d"}
Sep 09 23:03:38.729740 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:38.729708    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5" event={"ID":"e4de158d-eae6-4f19-9c0c-7c3d2758c188","Type":"ContainerStarted","Data":"e34bce6331e9450e5d9830ae5a85fc2f977e2a7d697f9b777d528196eedc979f"}
Sep 09 23:03:38.731433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:38.731406    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mvjpb" event={"ID":"0ea771b6-3bb4-4c69-953c-8505f76b3642","Type":"ContainerStarted","Data":"0cebce18602a2ef1377ff33d4978e296260dbba991f2b95bb2a915b8736d9781"}
Sep 09 23:03:38.732838 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:38.732814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwl6c" event={"ID":"276a69fc-219e-4197-95e9-9de1e887a864","Type":"ContainerStarted","Data":"0ad2b089a05b74ef31f5f3d2e074346ec84962120f1ccf01e36013ee0ac16064"}
Sep 09 23:03:38.734404 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:38.734378    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-chj99" event={"ID":"e6ce54c2-4e66-4b37-96fe-d348247d7628","Type":"ContainerStarted","Data":"57bcbca1b6cd59c6b642f12a11b0e26231f579f26f53fb0aad08d02800c13f70"}
Sep 09 23:03:38.735883 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:38.735859    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vrrd5" event={"ID":"e2a5084a-7d0d-495a-a7b3-63c8701a0569","Type":"ContainerStarted","Data":"95318af11256f20350d2260399a259631e44edb6af242e709814a6349a78a062"}
Sep 09 23:03:38.737338 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:38.737309    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5rbbz" event={"ID":"fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea","Type":"ContainerStarted","Data":"310a99f294aab3a8f757198fe98a10451eac3583f1e9ea132aa9958652b58a09"}
Sep 09 23:03:38.738652 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:38.738626    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h6244" event={"ID":"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba","Type":"ContainerStarted","Data":"d24bab74473e87d13a581992265652cbb3736a6bb411b9bc2e1c2da8ad8f9f33"}
Sep 09 23:03:39.219738 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:39.219689    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs\") pod \"network-metrics-daemon-dwb45\" (UID: \"c31b5254-ff30-4381-bcbd-d09e9d6fd177\") " pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:39.219922 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:39.219774    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bfn\" (UniqueName: \"kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn\") pod \"network-check-target-rbfm8\" (UID: \"93c766f9-7d3d-472f-ac3e-232f9b925b1a\") " pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:39.219922 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:39.219916    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:03:39.220057 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:39.219939    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:03:39.220057 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:39.219953    2562 projected.go:196] Error preparing data for projected volume kube-api-access-n8bfn for pod openshift-network-diagnostics/network-check-target-rbfm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:03:39.220057 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:39.220015    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn podName:93c766f9-7d3d-472f-ac3e-232f9b925b1a nodeName:}" failed. No retries permitted until 2026-09-09 23:03:41.219996302 +0000 UTC m=+6.003036683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8bfn" (UniqueName: "kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn") pod "network-check-target-rbfm8" (UID: "93c766f9-7d3d-472f-ac3e-232f9b925b1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:03:39.220487 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:39.220467    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:03:39.220589 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:39.220529    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs podName:c31b5254-ff30-4381-bcbd-d09e9d6fd177 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:41.22051074 +0000 UTC m=+6.003551103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs") pod "network-metrics-daemon-dwb45" (UID: "c31b5254-ff30-4381-bcbd-d09e9d6fd177") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:03:39.320583 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:39.320540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret\") pod \"global-pull-secret-syncer-tblgp\" (UID: \"b32f3790-a36e-4aeb-ac84-96e6ce77d480\") " pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:39.320768 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:39.320697    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:03:39.320847 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:39.320769    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret podName:b32f3790-a36e-4aeb-ac84-96e6ce77d480 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:41.320748116 +0000 UTC m=+6.103788484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret") pod "global-pull-secret-syncer-tblgp" (UID: "b32f3790-a36e-4aeb-ac84-96e6ce77d480") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:03:39.629376 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:39.629281    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 22:58:38 +0000 UTC" deadline="2028-04-08 20:14:31.75103534 +0000 UTC"
Sep 09 23:03:39.629376 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:39.629327    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13845h10m52.121713556s"
Sep 09 23:03:39.719102 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:39.719025    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:39.719278 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:39.719165    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:03:39.719653 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:39.719607    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:39.719759 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:39.719708    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:03:39.719842 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:39.719787    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:39.719904 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:39.719865    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:03:41.237931 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:41.237841    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bfn\" (UniqueName: \"kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn\") pod \"network-check-target-rbfm8\" (UID: \"93c766f9-7d3d-472f-ac3e-232f9b925b1a\") " pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:41.237931 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:41.237907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs\") pod \"network-metrics-daemon-dwb45\" (UID: \"c31b5254-ff30-4381-bcbd-d09e9d6fd177\") " pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:41.238673 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:41.238080    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:03:41.238673 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:41.238147    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs podName:c31b5254-ff30-4381-bcbd-d09e9d6fd177 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:45.238128844 +0000 UTC m=+10.021169211 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs") pod "network-metrics-daemon-dwb45" (UID: "c31b5254-ff30-4381-bcbd-d09e9d6fd177") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:03:41.243874 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:41.243822    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:03:41.243874 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:41.243868    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:03:41.244108 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:41.243883    2562 projected.go:196] Error preparing data for projected volume kube-api-access-n8bfn for pod openshift-network-diagnostics/network-check-target-rbfm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:03:41.244108 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:41.243953    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn podName:93c766f9-7d3d-472f-ac3e-232f9b925b1a nodeName:}" failed. No retries permitted until 2026-09-09 23:03:45.243935169 +0000 UTC m=+10.026975547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8bfn" (UniqueName: "kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn") pod "network-check-target-rbfm8" (UID: "93c766f9-7d3d-472f-ac3e-232f9b925b1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:03:41.338362 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:41.338316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret\") pod \"global-pull-secret-syncer-tblgp\" (UID: \"b32f3790-a36e-4aeb-ac84-96e6ce77d480\") " pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:41.338571 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:41.338550    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:03:41.338642 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:41.338617    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret podName:b32f3790-a36e-4aeb-ac84-96e6ce77d480 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:45.338598715 +0000 UTC m=+10.121639086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret") pod "global-pull-secret-syncer-tblgp" (UID: "b32f3790-a36e-4aeb-ac84-96e6ce77d480") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:03:41.719804 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:41.717376    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:41.719804 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:41.717424    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:41.719804 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:41.717376    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:41.719804 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:41.717518    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:03:41.719804 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:41.717603    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:03:41.719804 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:41.717675    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:03:42.768393 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:42.768269    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal" event={"ID":"7b5ca6b5d6434f57b84c52cbf979bd78","Type":"ContainerStarted","Data":"8b7586a2311cece6c974317c1abef985b16d4ebe5a0e03960cd535c601d52785"}
Sep 09 23:03:43.717064 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:43.717030    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:43.717249 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:43.717171    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:03:43.717249 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:43.717181    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:43.717249 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:43.717209    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:43.717452 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:43.717353    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:03:43.717514 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:43.717467    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:03:43.772941 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:43.772901    2562 generic.go:356] "Generic (PLEG): container finished" podID="7b5ca6b5d6434f57b84c52cbf979bd78" containerID="8b7586a2311cece6c974317c1abef985b16d4ebe5a0e03960cd535c601d52785" exitCode=0
Sep 09 23:03:43.773437 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:43.772955    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal" event={"ID":"7b5ca6b5d6434f57b84c52cbf979bd78","Type":"ContainerDied","Data":"8b7586a2311cece6c974317c1abef985b16d4ebe5a0e03960cd535c601d52785"}
Sep 09 23:03:45.270528 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:45.270487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bfn\" (UniqueName: \"kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn\") pod \"network-check-target-rbfm8\" (UID: \"93c766f9-7d3d-472f-ac3e-232f9b925b1a\") " pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:45.271029 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:45.270554    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs\") pod \"network-metrics-daemon-dwb45\" (UID: \"c31b5254-ff30-4381-bcbd-d09e9d6fd177\") " pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:45.271029 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:45.270697    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:03:45.271029 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:45.270755    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs podName:c31b5254-ff30-4381-bcbd-d09e9d6fd177 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:53.27073592 +0000 UTC m=+18.053776287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs") pod "network-metrics-daemon-dwb45" (UID: "c31b5254-ff30-4381-bcbd-d09e9d6fd177") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:03:45.271314 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:45.271203    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:03:45.271314 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:45.271225    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:03:45.271314 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:45.271239    2562 projected.go:196] Error preparing data for projected volume kube-api-access-n8bfn for pod openshift-network-diagnostics/network-check-target-rbfm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:03:45.271314 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:45.271284    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn podName:93c766f9-7d3d-472f-ac3e-232f9b925b1a nodeName:}" failed. No retries permitted until 2026-09-09 23:03:53.271268806 +0000 UTC m=+18.054309185 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8bfn" (UniqueName: "kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn") pod "network-check-target-rbfm8" (UID: "93c766f9-7d3d-472f-ac3e-232f9b925b1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:03:45.370997 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:45.370958    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret\") pod \"global-pull-secret-syncer-tblgp\" (UID: \"b32f3790-a36e-4aeb-ac84-96e6ce77d480\") " pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:45.371199 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:45.371145    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:03:45.371267 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:45.371215    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret podName:b32f3790-a36e-4aeb-ac84-96e6ce77d480 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:53.371193054 +0000 UTC m=+18.154233419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret") pod "global-pull-secret-syncer-tblgp" (UID: "b32f3790-a36e-4aeb-ac84-96e6ce77d480") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:03:45.717665 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:45.717622    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:45.717863 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:45.717752    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:03:45.718238 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:45.718212    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:45.718363 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:45.718331    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:03:45.718513 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:45.718490    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:45.718654 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:45.718581    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:03:47.716848 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:47.716810    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:47.717425 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:47.716812    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:47.717425 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:47.716954    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:03:47.717425 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:47.716810    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:47.717425 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:47.717039    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:03:47.717425 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:47.717101    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:03:49.716953 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:49.716917    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:49.717410 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:49.716920    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:49.717410 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:49.717066    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:03:49.717410 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:49.716930    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:49.717410 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:49.717158    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:03:49.717410 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:49.717193    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:03:51.716402 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:51.716370    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:51.716864 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:51.716370    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:51.716864 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:51.716495    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:03:51.716864 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:51.716384    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:51.716864 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:51.716571    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:03:51.716864 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:51.716652    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:03:53.330104 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:53.330068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bfn\" (UniqueName: \"kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn\") pod \"network-check-target-rbfm8\" (UID: \"93c766f9-7d3d-472f-ac3e-232f9b925b1a\") " pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:53.330593 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:53.330119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs\") pod \"network-metrics-daemon-dwb45\" (UID: \"c31b5254-ff30-4381-bcbd-d09e9d6fd177\") " pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:53.330593 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:53.330212    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:03:53.330593 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:53.330263    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:03:53.330593 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:53.330290    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:03:53.330593 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:53.330307    2562 projected.go:196] Error preparing data for projected volume kube-api-access-n8bfn for pod openshift-network-diagnostics/network-check-target-rbfm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:03:53.330593 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:53.330272    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs podName:c31b5254-ff30-4381-bcbd-d09e9d6fd177 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:09.330254108 +0000 UTC m=+34.113294474 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs") pod "network-metrics-daemon-dwb45" (UID: "c31b5254-ff30-4381-bcbd-d09e9d6fd177") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:03:53.330593 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:53.330390    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn podName:93c766f9-7d3d-472f-ac3e-232f9b925b1a nodeName:}" failed. No retries permitted until 2026-09-09 23:04:09.330373632 +0000 UTC m=+34.113413993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8bfn" (UniqueName: "kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn") pod "network-check-target-rbfm8" (UID: "93c766f9-7d3d-472f-ac3e-232f9b925b1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:03:53.430671 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:53.430638    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret\") pod \"global-pull-secret-syncer-tblgp\" (UID: \"b32f3790-a36e-4aeb-ac84-96e6ce77d480\") " pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:53.430852 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:53.430797    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:03:53.430900 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:53.430875    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret podName:b32f3790-a36e-4aeb-ac84-96e6ce77d480 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:09.430852232 +0000 UTC m=+34.213892608 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret") pod "global-pull-secret-syncer-tblgp" (UID: "b32f3790-a36e-4aeb-ac84-96e6ce77d480") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:03:53.716810 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:53.716771    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:53.716993 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:53.716771    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:53.716993 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:53.716912    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:03:53.716993 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:53.716775    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:53.717155 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:53.716994    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:03:53.717155 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:53.717068    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:03:55.717305 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:55.717271    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:55.717758 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:55.717392    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:55.717758 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:55.717388    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:03:55.717758 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:55.717522    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:03:55.717758 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:55.717544    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:55.717758 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:55.717646    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:03:57.716502 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.716315    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:57.717043 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.716315    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:57.717043 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:57.716584    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:03:57.717043 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:57.716695    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:03:57.717043 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.716321    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:57.717043 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:57.716808    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:03:57.801082 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.801045    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5" event={"ID":"e4de158d-eae6-4f19-9c0c-7c3d2758c188","Type":"ContainerStarted","Data":"6d4178c257a32b0f2bef7e4fa8cc464dc47a548472d33551f97fd7b4af06a4af"}
Sep 09 23:03:57.802741 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.802708    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mvjpb" event={"ID":"0ea771b6-3bb4-4c69-953c-8505f76b3642","Type":"ContainerStarted","Data":"f7549529d2e1709bbdd5da348a44ac9aeeb8fd8f5e95e6cf765a4a174bbe4f2d"}
Sep 09 23:03:57.804478 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.804450    2562 generic.go:356] "Generic (PLEG): container finished" podID="276a69fc-219e-4197-95e9-9de1e887a864" containerID="a6644e590337115d95aa9bf8d4ef57786ff56f4e51000ff790e948a80d74ccbb" exitCode=0
Sep 09 23:03:57.804598 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.804530    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwl6c" event={"ID":"276a69fc-219e-4197-95e9-9de1e887a864","Type":"ContainerDied","Data":"a6644e590337115d95aa9bf8d4ef57786ff56f4e51000ff790e948a80d74ccbb"}
Sep 09 23:03:57.806217 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.806191    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-chj99" event={"ID":"e6ce54c2-4e66-4b37-96fe-d348247d7628","Type":"ContainerStarted","Data":"8e34d12f22730e2daf84941a9239f5bcaef231d6ed81a3bd12ddfb65ff476633"}
Sep 09 23:03:57.808031 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.808001    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-73.ec2.internal" event={"ID":"afe036642cdfcb6c198b1022c1ca77eb","Type":"ContainerStarted","Data":"808b0b63171c405422ec75583386945b4957b1c845e09b2a29e51fca85281363"}
Sep 09 23:03:57.810118 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.810094    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal" event={"ID":"7b5ca6b5d6434f57b84c52cbf979bd78","Type":"ContainerStarted","Data":"77b9b7ff3421a6170bbdf470cd00e426d4349929aebf453da9ba75bc6b6e1b7f"}
Sep 09 23:03:57.811845 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.811822    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5rbbz" event={"ID":"fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea","Type":"ContainerStarted","Data":"cb4d17eb8796bc7f872a3e96c6a8d1a3ee0db1bb984846cca16c22e5ed906e1c"}
Sep 09 23:03:57.813906 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.813883    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h6244" event={"ID":"3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba","Type":"ContainerStarted","Data":"4028086accd1fdd972687e93f9f68646dbfb0072dc6ef4003d604e12a0f56df6"}
Sep 09 23:03:57.815510 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.815467    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5sd94" event={"ID":"6397c170-a04a-4a23-8705-2d1033baca7e","Type":"ContainerStarted","Data":"28ba8b16a9848708cb264eb4f64d0d069b33a2d63cccebd17168c764ff907059"}
Sep 09 23:03:57.819877 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.819849    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl" event={"ID":"77e2c92a-84a7-43d7-adca-a801a8d698ec","Type":"ContainerStarted","Data":"ed064dc72fc5e31bd8859e2425c0d5638968a7c15e08f116dc2157b97e76a087"}
Sep 09 23:03:57.819994 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.819976    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl" event={"ID":"77e2c92a-84a7-43d7-adca-a801a8d698ec","Type":"ContainerStarted","Data":"7c7c36d5d7d61ff328af4e579b617d090d03090b0397c9376ced41865c93c8fd"}
Sep 09 23:03:57.820056 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.820045    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl" event={"ID":"77e2c92a-84a7-43d7-adca-a801a8d698ec","Type":"ContainerStarted","Data":"54c8920ef86df19a1af727f03996ec8427b91a622758b9a7a5a81d9a9b4a492f"}
Sep 09 23:03:57.820121 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.820109    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl" event={"ID":"77e2c92a-84a7-43d7-adca-a801a8d698ec","Type":"ContainerStarted","Data":"ebe9fee96d7a63b1f024c011a1d68bf5ace0e57723bf442642f39b9155fcf23e"}
Sep 09 23:03:57.820184 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.820172    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl" event={"ID":"77e2c92a-84a7-43d7-adca-a801a8d698ec","Type":"ContainerStarted","Data":"602880e09debf4c12c3ff05e9ad4f38c6b6f7589e89c309e90f0951ccc6a654f"}
Sep 09 23:03:57.820245 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.820233    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl" event={"ID":"77e2c92a-84a7-43d7-adca-a801a8d698ec","Type":"ContainerStarted","Data":"d7af75ebccf5c34514ccbe1035a693e3b63968b013b7c2471a240c3a3054e68d"}
Sep 09 23:03:57.825517 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.825469    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mvjpb" podStartSLOduration=2.921256735 podStartE2EDuration="21.825436311s" totalImagesPullingTime="18.904179576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:57.825415559 +0000 UTC m=+22.608455943" watchObservedRunningTime="2026-09-09 23:03:57.825436311 +0000 UTC m=+22.608476678"
Sep 09 23:03:57.838386 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.838315    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5sd94" podStartSLOduration=2.899571873 podStartE2EDuration="21.838296819s" totalImagesPullingTime="18.938724946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:57.83829108 +0000 UTC m=+22.621331464" watchObservedRunningTime="2026-09-09 23:03:57.838296819 +0000 UTC m=+22.621337204"
Sep 09 23:03:57.873922 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.873876    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-chj99" podStartSLOduration=2.941269714 podStartE2EDuration="21.87385946s" totalImagesPullingTime="18.932589746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:57.859081983 +0000 UTC m=+22.642122367" watchObservedRunningTime="2026-09-09 23:03:57.87385946 +0000 UTC m=+22.656899844"
Sep 09 23:03:57.874148 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.874126    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h6244" podStartSLOduration=2.907119419 podStartE2EDuration="21.874119976s" totalImagesPullingTime="18.967000557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:57.873844586 +0000 UTC m=+22.656884974" watchObservedRunningTime="2026-09-09 23:03:57.874119976 +0000 UTC m=+22.657160360"
Sep 09 23:03:57.910377 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.910274    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5rbbz" podStartSLOduration=7.107363047 podStartE2EDuration="21.910259s" totalImagesPullingTime="14.802895953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:57.910037241 +0000 UTC m=+22.693077627" watchObservedRunningTime="2026-09-09 23:03:57.910259 +0000 UTC m=+22.693299392"
Sep 09 23:03:57.931956 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.931901    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-73.ec2.internal" podStartSLOduration=20.931885545 podStartE2EDuration="20.931885545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:57.931614167 +0000 UTC m=+22.714654550" watchObservedRunningTime="2026-09-09 23:03:57.931885545 +0000 UTC m=+22.714925928"
Sep 09 23:03:57.944072 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:57.944026    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-73.ec2.internal" podStartSLOduration=20.944010783 podStartE2EDuration="20.944010783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:57.943827528 +0000 UTC m=+22.726867905" watchObservedRunningTime="2026-09-09 23:03:57.944010783 +0000 UTC m=+22.727051166"
Sep 09 23:03:58.655889 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:58.655689    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 23:03:58.666525 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:58.666428    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T23:03:58.655879313Z","UUID":"36bcd9fe-1a16-463f-8b25-a7cc89da741b","Handler":null,"Name":"","Endpoint":""}
Sep 09 23:03:58.667968 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:58.667947    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 23:03:58.668064 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:58.667984    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 23:03:58.824796 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:58.824696    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5" event={"ID":"e4de158d-eae6-4f19-9c0c-7c3d2758c188","Type":"ContainerStarted","Data":"b08b039b74b9f732de55595b9d2ded9a1ec51d8845e22cad1a598d5ea5ddc6a3"}
Sep 09 23:03:58.826550 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:58.826501    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vrrd5" event={"ID":"e2a5084a-7d0d-495a-a7b3-63c8701a0569","Type":"ContainerStarted","Data":"5dd50f91134b5b0d6d27719b4797034ee25885be75fa78b5821b340d0e27809a"}
Sep 09 23:03:58.842925 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:58.842881    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vrrd5" podStartSLOduration=2.959492312 podStartE2EDuration="21.842866356s" totalImagesPullingTime="18.883374044s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:58.842385738 +0000 UTC m=+23.625426122" watchObservedRunningTime="2026-09-09 23:03:58.842866356 +0000 UTC m=+23.625906740"
Sep 09 23:03:59.718842 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:59.716793    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:03:59.718842 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:59.716831    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:03:59.718842 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:59.716808    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:03:59.718842 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:59.716936    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:03:59.718842 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:59.717036    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:03:59.718842 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:03:59.717112    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:03:59.833479 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:03:59.833384    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl" event={"ID":"77e2c92a-84a7-43d7-adca-a801a8d698ec","Type":"ContainerStarted","Data":"0b3b78d8d1122059fc5491bb249e0235bfbf16efc1cfb04c8d9bf75749e4dca3"}
Sep 09 23:04:00.838062 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:00.838025    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5" event={"ID":"e4de158d-eae6-4f19-9c0c-7c3d2758c188","Type":"ContainerStarted","Data":"42a52708923804a0f5ee477061b17aae86977f78493d13a3288fccb8640191ce"}
Sep 09 23:04:00.857500 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:00.857449    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-svgx5" podStartSLOduration=3.322561912 podStartE2EDuration="24.857434047s" totalImagesPullingTime="21.534872135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:00.856973818 +0000 UTC m=+25.640014206" watchObservedRunningTime="2026-09-09 23:04:00.857434047 +0000 UTC m=+25.640474431"
Sep 09 23:04:01.716939 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:01.716906    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:04:01.717123 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:01.716907    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:04:01.717123 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:01.717032    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:04:01.717219 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:01.717131    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:04:01.717219 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:01.716908    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:04:01.717288 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:01.717247    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:04:02.502305 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:02.502271    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5rbbz"
Sep 09 23:04:02.503235 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:02.503211    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5rbbz"
Sep 09 23:04:02.846827 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:02.846798    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl" event={"ID":"77e2c92a-84a7-43d7-adca-a801a8d698ec","Type":"ContainerStarted","Data":"909f2714cd69e1269a4aa68ae100aaaf721f2660899000ff00a7937aee3c1fbe"}
Sep 09 23:04:02.847105 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:02.847066    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:04:02.847371 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:02.847146    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:04:02.849513 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:02.849285    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5rbbz"
Sep 09 23:04:02.849805 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:02.849765    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5rbbz"
Sep 09 23:04:02.862917 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:02.862891    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:04:02.871098 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:02.871042    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl" podStartSLOduration=7.823868915 podStartE2EDuration="26.87102193s" totalImagesPullingTime="19.047153015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:02.870028296 +0000 UTC m=+27.653068680" watchObservedRunningTime="2026-09-09 23:04:02.87102193 +0000 UTC m=+27.654062314"
Sep 09 23:04:03.717002 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:03.716966    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:04:03.717557 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:03.716973    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:04:03.717557 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:03.717070    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:04:03.717557 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:03.717097    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:04:03.717557 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:03.717198    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:04:03.717557 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:03.717290    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:04:03.853341 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:03.853310    2562 generic.go:356] "Generic (PLEG): container finished" podID="276a69fc-219e-4197-95e9-9de1e887a864" containerID="3335e42a2a966fb2c6776a606616a374137da0420e8358ea4a85a7841be3e24b" exitCode=0
Sep 09 23:04:03.853507 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:03.853394    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwl6c" event={"ID":"276a69fc-219e-4197-95e9-9de1e887a864","Type":"ContainerDied","Data":"3335e42a2a966fb2c6776a606616a374137da0420e8358ea4a85a7841be3e24b"}
Sep 09 23:04:03.854562 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:03.854016    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:04:03.869064 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:03.869045    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:04:04.639102 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:04.639066    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rbfm8"]
Sep 09 23:04:04.639359 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:04.639240    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:04:04.639444 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:04.639357    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:04:04.640691 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:04.640665    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tblgp"]
Sep 09 23:04:04.640816 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:04.640779    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:04:04.640900 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:04.640877    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:04:04.650216 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:04.650189    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dwb45"]
Sep 09 23:04:04.650358 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:04.650312    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:04:04.650486 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:04.650462    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:04:05.718312 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:05.718075    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:04:05.719100 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:05.718431    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:04:05.859166 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:05.859134    2562 generic.go:356] "Generic (PLEG): container finished" podID="276a69fc-219e-4197-95e9-9de1e887a864" containerID="05f940d000ce41ad54aca7af10bf33c959b030f832047a747accad7b2c3f18fc" exitCode=0
Sep 09 23:04:05.859329 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:05.859224    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwl6c" event={"ID":"276a69fc-219e-4197-95e9-9de1e887a864","Type":"ContainerDied","Data":"05f940d000ce41ad54aca7af10bf33c959b030f832047a747accad7b2c3f18fc"}
Sep 09 23:04:06.716904 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:06.716864    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:04:06.716904 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:06.716900    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:04:06.717280 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:06.716990    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:04:06.717280 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:06.717096    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:04:06.863615 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:06.863540    2562 generic.go:356] "Generic (PLEG): container finished" podID="276a69fc-219e-4197-95e9-9de1e887a864" containerID="c7e09281bd421519dc2cb6f4030f48b15333f487cf5cdccb35b5daa4d2c70d7f" exitCode=0
Sep 09 23:04:06.863615 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:06.863583    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwl6c" event={"ID":"276a69fc-219e-4197-95e9-9de1e887a864","Type":"ContainerDied","Data":"c7e09281bd421519dc2cb6f4030f48b15333f487cf5cdccb35b5daa4d2c70d7f"}
Sep 09 23:04:07.717254 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:07.717218    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:04:07.717447 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:07.717372    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:04:08.716796 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:08.716713    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:04:08.717149 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:08.716713    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:04:08.717149 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:08.716830    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:04:08.717149 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:08.716914    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:04:09.339640 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:09.339604    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bfn\" (UniqueName: \"kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn\") pod \"network-check-target-rbfm8\" (UID: \"93c766f9-7d3d-472f-ac3e-232f9b925b1a\") " pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:04:09.339877 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:09.339668    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs\") pod \"network-metrics-daemon-dwb45\" (UID: \"c31b5254-ff30-4381-bcbd-d09e9d6fd177\") " pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:04:09.339877 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:09.339756    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:04:09.339877 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:09.339787    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:04:09.339877 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:09.339801    2562 projected.go:196] Error preparing data for projected volume kube-api-access-n8bfn for pod openshift-network-diagnostics/network-check-target-rbfm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:04:09.339877 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:09.339840    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:04:09.339877 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:09.339872    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn podName:93c766f9-7d3d-472f-ac3e-232f9b925b1a nodeName:}" failed. No retries permitted until 2026-09-09 23:04:41.339851633 +0000 UTC m=+66.122892001 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n8bfn" (UniqueName: "kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn") pod "network-check-target-rbfm8" (UID: "93c766f9-7d3d-472f-ac3e-232f9b925b1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:04:09.340110 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:09.339901    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs podName:c31b5254-ff30-4381-bcbd-d09e9d6fd177 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:41.339883889 +0000 UTC m=+66.122924273 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs") pod "network-metrics-daemon-dwb45" (UID: "c31b5254-ff30-4381-bcbd-d09e9d6fd177") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:04:09.440529 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:09.440468    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret\") pod \"global-pull-secret-syncer-tblgp\" (UID: \"b32f3790-a36e-4aeb-ac84-96e6ce77d480\") " pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:04:09.440793 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:09.440676    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:04:09.440793 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:09.440731    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret podName:b32f3790-a36e-4aeb-ac84-96e6ce77d480 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:41.440716004 +0000 UTC m=+66.223756366 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret") pod "global-pull-secret-syncer-tblgp" (UID: "b32f3790-a36e-4aeb-ac84-96e6ce77d480") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:04:09.716452 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:09.716420    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:04:09.716648 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:09.716574    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:04:10.717039 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:10.716948    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:04:10.717039 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:10.716988    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:04:10.717504 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:10.717085    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbfm8" podUID="93c766f9-7d3d-472f-ac3e-232f9b925b1a"
Sep 09 23:04:10.717504 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:10.717222    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tblgp" podUID="b32f3790-a36e-4aeb-ac84-96e6ce77d480"
Sep 09 23:04:11.002201 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.002113    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-73.ec2.internal" event="NodeReady"
Sep 09 23:04:11.002386 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.002265    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 23:04:11.035151 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.035121    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7878fd6c5b-ffwd9"]
Sep 09 23:04:11.065471 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.065438    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-2rs4x"]
Sep 09 23:04:11.065640 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.065576    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.068302 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.068279    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 23:04:11.068596 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.068549    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 23:04:11.068596 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.068562    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-699nw\""
Sep 09 23:04:11.068788 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.068634    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 23:04:11.073265 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.073233    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 23:04:11.078959 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.078939    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-2rs4x"]
Sep 09 23:04:11.079086 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.078975    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v4q9p"]
Sep 09 23:04:11.079086 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.079072    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:04:11.081850 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.081829    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 09 23:04:11.081850 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.081837    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 09 23:04:11.081850 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.081848    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6mtf5\""
Sep 09 23:04:11.097082 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.097056    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7878fd6c5b-ffwd9"]
Sep 09 23:04:11.097216 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.097097    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hrpfl"]
Sep 09 23:04:11.097216 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.097174    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:11.099692 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.099664    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 23:04:11.099692 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.099688    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jj6sk\""
Sep 09 23:04:11.099850 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.099673    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 23:04:11.123143 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.123117    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v4q9p"]
Sep 09 23:04:11.123286 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.123167    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hrpfl"]
Sep 09 23:04:11.123286 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.123260    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hrpfl"
Sep 09 23:04:11.125576 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.125547    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 23:04:11.125729 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.125551    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 23:04:11.125853 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.125834    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 23:04:11.126486 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.126461    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cc82g\""
Sep 09 23:04:11.152416 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.152385    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2rs4x\" (UID: \"31ee7939-0118-47d2-8a82-21f99709bf37\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:04:11.152550 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.152433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0fb09c39-00c7-4de0-bdbe-35cadac25075-image-registry-private-configuration\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.152550 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.152467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1fe099-faf9-4290-a81b-824f9630f31c-config-volume\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:11.152550 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.152499    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-certificates\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.152550 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.152531    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh48n\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-kube-api-access-bh48n\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.152713 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.152600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/31ee7939-0118-47d2-8a82-21f99709bf37-nginx-conf\") pod \"networking-console-plugin-79977f9844-2rs4x\" (UID: \"31ee7939-0118-47d2-8a82-21f99709bf37\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:04:11.152713 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.152623    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0fb09c39-00c7-4de0-bdbe-35cadac25075-trusted-ca\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.152713 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.152679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0fb09c39-00c7-4de0-bdbe-35cadac25075-installation-pull-secrets\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.152824 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.152715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd1fe099-faf9-4290-a81b-824f9630f31c-tmp-dir\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:11.152824 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.152738    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j4sj\" (UniqueName: \"kubernetes.io/projected/bd1fe099-faf9-4290-a81b-824f9630f31c-kube-api-access-2j4sj\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:11.152824 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.152763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:11.152824 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.152785    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.152824 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.152808    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-bound-sa-token\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.152987 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.152873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0fb09c39-00c7-4de0-bdbe-35cadac25075-ca-trust-extracted\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.210700 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.210659    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:11.253714 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.253630    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcb7g\" (UniqueName: \"kubernetes.io/projected/0c3b7480-0c2a-4f3d-97af-ad331496274a-kube-api-access-hcb7g\") pod \"ingress-canary-hrpfl\" (UID: \"0c3b7480-0c2a-4f3d-97af-ad331496274a\") " pod="openshift-ingress-canary/ingress-canary-hrpfl"
Sep 09 23:04:11.253714 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.253673    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2rs4x\" (UID: \"31ee7939-0118-47d2-8a82-21f99709bf37\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:04:11.253714 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.253695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0fb09c39-00c7-4de0-bdbe-35cadac25075-image-registry-private-configuration\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.253714 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.253714    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1fe099-faf9-4290-a81b-824f9630f31c-config-volume\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:11.254033 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.253733    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-certificates\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.254033 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:11.253812    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 23:04:11.254033 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.253880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh48n\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-kube-api-access-bh48n\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.254033 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:11.253886    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert podName:31ee7939-0118-47d2-8a82-21f99709bf37 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:11.753865825 +0000 UTC m=+36.536906188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2rs4x" (UID: "31ee7939-0118-47d2-8a82-21f99709bf37") : secret "networking-console-plugin-cert" not found
Sep 09 23:04:11.254033 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.253965    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/31ee7939-0118-47d2-8a82-21f99709bf37-nginx-conf\") pod \"networking-console-plugin-79977f9844-2rs4x\" (UID: \"31ee7939-0118-47d2-8a82-21f99709bf37\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:04:11.254033 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.253995    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0fb09c39-00c7-4de0-bdbe-35cadac25075-trusted-ca\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.254420 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.254047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0fb09c39-00c7-4de0-bdbe-35cadac25075-installation-pull-secrets\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.254420 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.254077    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c3b7480-0c2a-4f3d-97af-ad331496274a-cert\") pod \"ingress-canary-hrpfl\" (UID: \"0c3b7480-0c2a-4f3d-97af-ad331496274a\") " pod="openshift-ingress-canary/ingress-canary-hrpfl"
Sep 09 23:04:11.254420 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.254125    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd1fe099-faf9-4290-a81b-824f9630f31c-tmp-dir\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:11.254420 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.254147    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j4sj\" (UniqueName: \"kubernetes.io/projected/bd1fe099-faf9-4290-a81b-824f9630f31c-kube-api-access-2j4sj\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:11.254420 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.254176    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:11.254420 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.254201    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.254420 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:11.254300    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:04:11.254420 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:11.254315    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7878fd6c5b-ffwd9: secret "image-registry-tls" not found
Sep 09 23:04:11.254420 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.254370    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1fe099-faf9-4290-a81b-824f9630f31c-config-volume\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:11.254420 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:11.254383    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls podName:0fb09c39-00c7-4de0-bdbe-35cadac25075 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:11.754366981 +0000 UTC m=+36.537407344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls") pod "image-registry-7878fd6c5b-ffwd9" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075") : secret "image-registry-tls" not found
Sep 09 23:04:11.254941 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.254432    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-certificates\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.254941 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.254444    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd1fe099-faf9-4290-a81b-824f9630f31c-tmp-dir\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:11.254941 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:11.254458    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:04:11.254941 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.254483    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-bound-sa-token\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.254941 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:11.254496    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls podName:bd1fe099-faf9-4290-a81b-824f9630f31c nodeName:}" failed. No retries permitted until 2026-09-09 23:04:11.754484022 +0000 UTC m=+36.537524384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls") pod "dns-default-v4q9p" (UID: "bd1fe099-faf9-4290-a81b-824f9630f31c") : secret "dns-default-metrics-tls" not found
Sep 09 23:04:11.254941 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.254530    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0fb09c39-00c7-4de0-bdbe-35cadac25075-ca-trust-extracted\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.254941 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.254866    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0fb09c39-00c7-4de0-bdbe-35cadac25075-ca-trust-extracted\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.255237 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.254969    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/31ee7939-0118-47d2-8a82-21f99709bf37-nginx-conf\") pod \"networking-console-plugin-79977f9844-2rs4x\" (UID: \"31ee7939-0118-47d2-8a82-21f99709bf37\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:04:11.255237 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.255121    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0fb09c39-00c7-4de0-bdbe-35cadac25075-trusted-ca\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.258533 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.258500    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0fb09c39-00c7-4de0-bdbe-35cadac25075-installation-pull-secrets\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.258651 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.258527    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0fb09c39-00c7-4de0-bdbe-35cadac25075-image-registry-private-configuration\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.263722 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.263673    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j4sj\" (UniqueName: \"kubernetes.io/projected/bd1fe099-faf9-4290-a81b-824f9630f31c-kube-api-access-2j4sj\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:11.263836 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.263797    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh48n\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-kube-api-access-bh48n\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.264136 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.264117    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-bound-sa-token\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.345191 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.345150    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:11.355199 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.355171    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c3b7480-0c2a-4f3d-97af-ad331496274a-cert\") pod \"ingress-canary-hrpfl\" (UID: \"0c3b7480-0c2a-4f3d-97af-ad331496274a\") " pod="openshift-ingress-canary/ingress-canary-hrpfl"
Sep 09 23:04:11.355389 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.355233    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcb7g\" (UniqueName: \"kubernetes.io/projected/0c3b7480-0c2a-4f3d-97af-ad331496274a-kube-api-access-hcb7g\") pod \"ingress-canary-hrpfl\" (UID: \"0c3b7480-0c2a-4f3d-97af-ad331496274a\") " pod="openshift-ingress-canary/ingress-canary-hrpfl"
Sep 09 23:04:11.357872 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.357848    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c3b7480-0c2a-4f3d-97af-ad331496274a-cert\") pod \"ingress-canary-hrpfl\" (UID: \"0c3b7480-0c2a-4f3d-97af-ad331496274a\") " pod="openshift-ingress-canary/ingress-canary-hrpfl"
Sep 09 23:04:11.363026 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.362997    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcb7g\" (UniqueName: \"kubernetes.io/projected/0c3b7480-0c2a-4f3d-97af-ad331496274a-kube-api-access-hcb7g\") pod \"ingress-canary-hrpfl\" (UID: \"0c3b7480-0c2a-4f3d-97af-ad331496274a\") " pod="openshift-ingress-canary/ingress-canary-hrpfl"
Sep 09 23:04:11.436235 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.436199    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hrpfl"
Sep 09 23:04:11.720327 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.720169    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:04:11.723247 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.723229    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 23:04:11.723392 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.723268    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-64srt\""
Sep 09 23:04:11.759796 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.759766    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:11.759796 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.759800    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:11.759958 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.759824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2rs4x\" (UID: \"31ee7939-0118-47d2-8a82-21f99709bf37\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:04:11.759958 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:11.759930    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 23:04:11.759958 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:11.759937    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:04:11.760050 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:11.759940    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:04:11.760050 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:11.759992    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7878fd6c5b-ffwd9: secret "image-registry-tls" not found
Sep 09 23:04:11.760050 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:11.759982    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert podName:31ee7939-0118-47d2-8a82-21f99709bf37 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:12.759969348 +0000 UTC m=+37.543009709 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2rs4x" (UID: "31ee7939-0118-47d2-8a82-21f99709bf37") : secret "networking-console-plugin-cert" not found
Sep 09 23:04:11.760050 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:11.760031    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls podName:bd1fe099-faf9-4290-a81b-824f9630f31c nodeName:}" failed. No retries permitted until 2026-09-09 23:04:12.760014356 +0000 UTC m=+37.543054723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls") pod "dns-default-v4q9p" (UID: "bd1fe099-faf9-4290-a81b-824f9630f31c") : secret "dns-default-metrics-tls" not found
Sep 09 23:04:11.760050 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:11.760046    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls podName:0fb09c39-00c7-4de0-bdbe-35cadac25075 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:12.760037355 +0000 UTC m=+37.543077725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls") pod "image-registry-7878fd6c5b-ffwd9" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075") : secret "image-registry-tls" not found
Sep 09 23:04:11.829944 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.829877    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hrpfl"]
Sep 09 23:04:11.833773 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:04:11.833742    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3b7480_0c2a_4f3d_97af_ad331496274a.slice/crio-7a9e51df2b4fdd262fab4bbbfcdf993b2e0c4ade6d5dcebdbdfbc0dc32c1cbad WatchSource:0}: Error finding container 7a9e51df2b4fdd262fab4bbbfcdf993b2e0c4ade6d5dcebdbdfbc0dc32c1cbad: Status 404 returned error can't find the container with id 7a9e51df2b4fdd262fab4bbbfcdf993b2e0c4ade6d5dcebdbdfbc0dc32c1cbad
Sep 09 23:04:11.877376 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:11.877332    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hrpfl" event={"ID":"0c3b7480-0c2a-4f3d-97af-ad331496274a","Type":"ContainerStarted","Data":"7a9e51df2b4fdd262fab4bbbfcdf993b2e0c4ade6d5dcebdbdfbc0dc32c1cbad"}
Sep 09 23:04:12.195731 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:12.195693    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:12.295817 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:12.295785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:12.716220 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:12.716183    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:04:12.716448 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:12.716186    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:04:12.718844 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:12.718810    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 23:04:12.718844 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:12.718823    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 23:04:12.719885 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:12.719871    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hwds4\""
Sep 09 23:04:12.719935 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:12.719892    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 23:04:12.768595 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:12.768562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:12.769134 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:12.768600    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:12.769134 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:12.768634    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2rs4x\" (UID: \"31ee7939-0118-47d2-8a82-21f99709bf37\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:04:12.769134 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:12.768724    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:04:12.769134 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:12.768739    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 23:04:12.769134 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:12.768746    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7878fd6c5b-ffwd9: secret "image-registry-tls" not found
Sep 09 23:04:12.769134 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:12.768722    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:04:12.769134 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:12.768797    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls podName:0fb09c39-00c7-4de0-bdbe-35cadac25075 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:14.76878224 +0000 UTC m=+39.551822602 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls") pod "image-registry-7878fd6c5b-ffwd9" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075") : secret "image-registry-tls" not found
Sep 09 23:04:12.769134 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:12.768812    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls podName:bd1fe099-faf9-4290-a81b-824f9630f31c nodeName:}" failed. No retries permitted until 2026-09-09 23:04:14.76880477 +0000 UTC m=+39.551845131 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls") pod "dns-default-v4q9p" (UID: "bd1fe099-faf9-4290-a81b-824f9630f31c") : secret "dns-default-metrics-tls" not found
Sep 09 23:04:12.769134 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:12.768822    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert podName:31ee7939-0118-47d2-8a82-21f99709bf37 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:14.76881749 +0000 UTC m=+39.551857852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2rs4x" (UID: "31ee7939-0118-47d2-8a82-21f99709bf37") : secret "networking-console-plugin-cert" not found
Sep 09 23:04:12.883433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:12.883381    2562 generic.go:356] "Generic (PLEG): container finished" podID="276a69fc-219e-4197-95e9-9de1e887a864" containerID="6671638acf325ef1b27e22d1ccc20f9c18c6a1dd7ee2a637d8e546d6d9c0e745" exitCode=0
Sep 09 23:04:12.883651 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:12.883448    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwl6c" event={"ID":"276a69fc-219e-4197-95e9-9de1e887a864","Type":"ContainerDied","Data":"6671638acf325ef1b27e22d1ccc20f9c18c6a1dd7ee2a637d8e546d6d9c0e745"}
Sep 09 23:04:13.135408 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:13.135381    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:13.213481 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:13.213442    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:13.311890 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:13.311807    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:13.893395 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:13.893359    2562 generic.go:356] "Generic (PLEG): container finished" podID="276a69fc-219e-4197-95e9-9de1e887a864" containerID="08fe9371fd93835f2f2907a3bd9a61081a61b611c81b211cc2387b14681726fc" exitCode=0
Sep 09 23:04:13.893395 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:13.893379    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwl6c" event={"ID":"276a69fc-219e-4197-95e9-9de1e887a864","Type":"ContainerDied","Data":"08fe9371fd93835f2f2907a3bd9a61081a61b611c81b211cc2387b14681726fc"}
Sep 09 23:04:14.216030 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:14.215956    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:14.267511 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:14.267485    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:14.787657 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:14.787618    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2rs4x\" (UID: \"31ee7939-0118-47d2-8a82-21f99709bf37\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:04:14.787856 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:14.787747    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:14.787856 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:14.787772    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:14.787856 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:14.787780    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 23:04:14.787856 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:14.787849    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert podName:31ee7939-0118-47d2-8a82-21f99709bf37 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:18.787831447 +0000 UTC m=+43.570871810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2rs4x" (UID: "31ee7939-0118-47d2-8a82-21f99709bf37") : secret "networking-console-plugin-cert" not found
Sep 09 23:04:14.788030 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:14.787878    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:04:14.788030 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:14.787931    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls podName:bd1fe099-faf9-4290-a81b-824f9630f31c nodeName:}" failed. No retries permitted until 2026-09-09 23:04:18.787918187 +0000 UTC m=+43.570958555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls") pod "dns-default-v4q9p" (UID: "bd1fe099-faf9-4290-a81b-824f9630f31c") : secret "dns-default-metrics-tls" not found
Sep 09 23:04:14.788030 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:14.787881    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:04:14.788030 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:14.787950    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7878fd6c5b-ffwd9: secret "image-registry-tls" not found
Sep 09 23:04:14.788030 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:14.787971    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls podName:0fb09c39-00c7-4de0-bdbe-35cadac25075 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:18.787964961 +0000 UTC m=+43.571005322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls") pod "image-registry-7878fd6c5b-ffwd9" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075") : secret "image-registry-tls" not found
Sep 09 23:04:14.900382 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:14.900336    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwl6c" event={"ID":"276a69fc-219e-4197-95e9-9de1e887a864","Type":"ContainerStarted","Data":"53bea404eeaf51a79fa7c39b8c9a93c5ad8f87b920c80152af6999328e590834"}
Sep 09 23:04:14.921143 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:14.921101    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rwl6c" podStartSLOduration=8.427931455 podStartE2EDuration="38.92108398s" totalImagesPullingTime="30.493152525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:14.919745305 +0000 UTC m=+39.702785688" watchObservedRunningTime="2026-09-09 23:04:14.92108398 +0000 UTC m=+39.704124342"
Sep 09 23:04:15.040191 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:15.040021    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:15.140960 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:15.140932    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:15.334577 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:15.334544    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:15.392433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:15.392333    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:15.733480 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:15.733412    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:15.789666 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:15.789635    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:15.904644 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:15.904612    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hrpfl" event={"ID":"0c3b7480-0c2a-4f3d-97af-ad331496274a","Type":"ContainerStarted","Data":"8094b47e487eed4406d2f6936d5f73a15c057b415cb1427922de13b38a9e4766"}
Sep 09 23:04:15.919548 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:15.919503    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hrpfl" podStartSLOduration=1.895458383 podStartE2EDuration="4.919487642s" totalImagesPullingTime="3.024029259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:15.918793161 +0000 UTC m=+40.701833544" watchObservedRunningTime="2026-09-09 23:04:15.919487642 +0000 UTC m=+40.702528025"
Sep 09 23:04:18.819796 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:18.819751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2rs4x\" (UID: \"31ee7939-0118-47d2-8a82-21f99709bf37\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:04:18.820236 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:18.819884    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:18.820236 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:18.819901    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 23:04:18.820236 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:18.819914    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:18.820236 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:18.819963    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert podName:31ee7939-0118-47d2-8a82-21f99709bf37 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:26.819946777 +0000 UTC m=+51.602987139 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2rs4x" (UID: "31ee7939-0118-47d2-8a82-21f99709bf37") : secret "networking-console-plugin-cert" not found
Sep 09 23:04:18.820236 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:18.820041    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:04:18.820236 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:18.820061    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7878fd6c5b-ffwd9: secret "image-registry-tls" not found
Sep 09 23:04:18.820236 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:18.820040    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:04:18.820236 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:18.820116    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls podName:0fb09c39-00c7-4de0-bdbe-35cadac25075 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:26.820101014 +0000 UTC m=+51.603141380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls") pod "image-registry-7878fd6c5b-ffwd9" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075") : secret "image-registry-tls" not found
Sep 09 23:04:18.820236 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:18.820133    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls podName:bd1fe099-faf9-4290-a81b-824f9630f31c nodeName:}" failed. No retries permitted until 2026-09-09 23:04:26.820124321 +0000 UTC m=+51.603164689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls") pod "dns-default-v4q9p" (UID: "bd1fe099-faf9-4290-a81b-824f9630f31c") : secret "dns-default-metrics-tls" not found
Sep 09 23:04:23.942078 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:23.942044    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:24.046363 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:24.046310    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:26.881733 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:26.881692    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:26.881733 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:26.881732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:26.882211 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:26.881754    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2rs4x\" (UID: \"31ee7939-0118-47d2-8a82-21f99709bf37\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:04:26.882211 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:26.881876    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:04:26.882211 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:26.881897    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7878fd6c5b-ffwd9: secret "image-registry-tls" not found
Sep 09 23:04:26.882211 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:26.881902    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 23:04:26.882211 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:26.881959    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls podName:0fb09c39-00c7-4de0-bdbe-35cadac25075 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:42.881936581 +0000 UTC m=+67.664976961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls") pod "image-registry-7878fd6c5b-ffwd9" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075") : secret "image-registry-tls" not found
Sep 09 23:04:26.882211 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:26.881983    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:04:26.882211 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:26.881985    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert podName:31ee7939-0118-47d2-8a82-21f99709bf37 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:42.881975324 +0000 UTC m=+67.665015686 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2rs4x" (UID: "31ee7939-0118-47d2-8a82-21f99709bf37") : secret "networking-console-plugin-cert" not found
Sep 09 23:04:26.882211 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:26.882079    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls podName:bd1fe099-faf9-4290-a81b-824f9630f31c nodeName:}" failed. No retries permitted until 2026-09-09 23:04:42.882066966 +0000 UTC m=+67.665107340 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls") pod "dns-default-v4q9p" (UID: "bd1fe099-faf9-4290-a81b-824f9630f31c") : secret "dns-default-metrics-tls" not found
Sep 09 23:04:27.358603 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:27.358524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:27.458394 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:27.458340    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:28.288643 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:28.288612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:28.342201 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:28.342171    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:28.775589 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:28.775560    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:35.869792 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:35.869760    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ffztl"
Sep 09 23:04:36.015280 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:36.015250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:36.076523 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:36.076496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:36.215548 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:36.215515    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:36.265635 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:36.265601    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:41.390383 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:41.390312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bfn\" (UniqueName: \"kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn\") pod \"network-check-target-rbfm8\" (UID: \"93c766f9-7d3d-472f-ac3e-232f9b925b1a\") " pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:04:41.390383 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:41.390389    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs\") pod \"network-metrics-daemon-dwb45\" (UID: \"c31b5254-ff30-4381-bcbd-d09e9d6fd177\") " pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:04:41.393505 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:41.393483    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 23:04:41.393505 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:41.393499    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 23:04:41.400646 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:41.400624    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 23:04:41.400747 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:41.400680    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs podName:c31b5254-ff30-4381-bcbd-d09e9d6fd177 nodeName:}" failed. No retries permitted until 2026-09-09 23:05:45.40066396 +0000 UTC m=+130.183704321 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs") pod "network-metrics-daemon-dwb45" (UID: "c31b5254-ff30-4381-bcbd-d09e9d6fd177") : secret "metrics-daemon-secret" not found
Sep 09 23:04:41.402877 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:41.402858    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 23:04:41.414134 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:41.414115    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8bfn\" (UniqueName: \"kubernetes.io/projected/93c766f9-7d3d-472f-ac3e-232f9b925b1a-kube-api-access-n8bfn\") pod \"network-check-target-rbfm8\" (UID: \"93c766f9-7d3d-472f-ac3e-232f9b925b1a\") " pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:04:41.490938 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:41.490898    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret\") pod \"global-pull-secret-syncer-tblgp\" (UID: \"b32f3790-a36e-4aeb-ac84-96e6ce77d480\") " pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:04:41.493742 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:41.493719    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 23:04:41.503812 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:41.503789    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b32f3790-a36e-4aeb-ac84-96e6ce77d480-original-pull-secret\") pod \"global-pull-secret-syncer-tblgp\" (UID: \"b32f3790-a36e-4aeb-ac84-96e6ce77d480\") " pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:04:41.525921 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:41.525891    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tblgp"
Sep 09 23:04:41.533728 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:41.533711    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hwds4\""
Sep 09 23:04:41.541625 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:41.541605    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:04:41.795975 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:41.795903    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tblgp"]
Sep 09 23:04:41.798767 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:04:41.798745    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb32f3790_a36e_4aeb_ac84_96e6ce77d480.slice/crio-dd676ac8aa8a83eb731f19712411907efa5cca9bfd4aa4f56033b47f7a1f7e33 WatchSource:0}: Error finding container dd676ac8aa8a83eb731f19712411907efa5cca9bfd4aa4f56033b47f7a1f7e33: Status 404 returned error can't find the container with id dd676ac8aa8a83eb731f19712411907efa5cca9bfd4aa4f56033b47f7a1f7e33
Sep 09 23:04:41.818899 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:41.818874    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rbfm8"]
Sep 09 23:04:41.822074 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:04:41.822053    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c766f9_7d3d_472f_ac3e_232f9b925b1a.slice/crio-4b0617d7d88a606b03ab75d45f550988d6ca9bc9bca2ab9dbbebda0b1e295329 WatchSource:0}: Error finding container 4b0617d7d88a606b03ab75d45f550988d6ca9bc9bca2ab9dbbebda0b1e295329: Status 404 returned error can't find the container with id 4b0617d7d88a606b03ab75d45f550988d6ca9bc9bca2ab9dbbebda0b1e295329
Sep 09 23:04:41.965499 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:41.965456    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rbfm8" event={"ID":"93c766f9-7d3d-472f-ac3e-232f9b925b1a","Type":"ContainerStarted","Data":"4b0617d7d88a606b03ab75d45f550988d6ca9bc9bca2ab9dbbebda0b1e295329"}
Sep 09 23:04:41.966615 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:41.966591    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tblgp" event={"ID":"b32f3790-a36e-4aeb-ac84-96e6ce77d480","Type":"ContainerStarted","Data":"dd676ac8aa8a83eb731f19712411907efa5cca9bfd4aa4f56033b47f7a1f7e33"}
Sep 09 23:04:42.902690 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:42.902653    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:04:42.902690 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:42.902699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:04:42.903204 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:42.902738    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2rs4x\" (UID: \"31ee7939-0118-47d2-8a82-21f99709bf37\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:04:42.903204 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:42.902923    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 23:04:42.903204 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:42.902989    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert podName:31ee7939-0118-47d2-8a82-21f99709bf37 nodeName:}" failed. No retries permitted until 2026-09-09 23:05:14.902969231 +0000 UTC m=+99.686009613 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2rs4x" (UID: "31ee7939-0118-47d2-8a82-21f99709bf37") : secret "networking-console-plugin-cert" not found
Sep 09 23:04:42.903204 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:42.903055    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:04:42.903204 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:42.903090    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls podName:bd1fe099-faf9-4290-a81b-824f9630f31c nodeName:}" failed. No retries permitted until 2026-09-09 23:05:14.90307783 +0000 UTC m=+99.686118192 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls") pod "dns-default-v4q9p" (UID: "bd1fe099-faf9-4290-a81b-824f9630f31c") : secret "dns-default-metrics-tls" not found
Sep 09 23:04:42.903204 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:42.903149    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:04:42.903204 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:42.903161    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7878fd6c5b-ffwd9: secret "image-registry-tls" not found
Sep 09 23:04:42.903204 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:04:42.903193    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls podName:0fb09c39-00c7-4de0-bdbe-35cadac25075 nodeName:}" failed. No retries permitted until 2026-09-09 23:05:14.90318214 +0000 UTC m=+99.686222516 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls") pod "image-registry-7878fd6c5b-ffwd9" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075") : secret "image-registry-tls" not found
Sep 09 23:04:47.984053 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:47.984014    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rbfm8" event={"ID":"93c766f9-7d3d-472f-ac3e-232f9b925b1a","Type":"ContainerStarted","Data":"adc79edf1171ebbc676d093adcf9582b4158e654bebfef8b60a66e17c84b8b18"}
Sep 09 23:04:47.984599 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:47.984143    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:04:47.985563 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:47.985541    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tblgp" event={"ID":"b32f3790-a36e-4aeb-ac84-96e6ce77d480","Type":"ContainerStarted","Data":"373ccfb51a6c6094dde8b852d8e3155c2445b9c49ce5d2e6104b4dab5ada2c09"}
Sep 09 23:04:48.001422 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:48.001375    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rbfm8" podStartSLOduration=66.891666402 podStartE2EDuration="1m12.001361471s" totalImagesPullingTime="5.109695069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:48.000627371 +0000 UTC m=+72.783667775" watchObservedRunningTime="2026-09-09 23:04:48.001361471 +0000 UTC m=+72.784401857"
Sep 09 23:04:48.016844 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:48.016796    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tblgp" podStartSLOduration=66.872945096 podStartE2EDuration="1m12.016783845s" totalImagesPullingTime="5.143838749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:48.016118989 +0000 UTC m=+72.799159372" watchObservedRunningTime="2026-09-09 23:04:48.016783845 +0000 UTC m=+72.799824232"
Sep 09 23:04:49.245979 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:49.245946    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:04:49.344932 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:04:49.344903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:05:14.928499 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:14.928455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:05:14.928499 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:14.928498    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:05:14.928965 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:14.928533    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2rs4x\" (UID: \"31ee7939-0118-47d2-8a82-21f99709bf37\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:05:14.928965 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:05:14.928611    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:05:14.928965 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:05:14.928622    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:05:14.928965 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:05:14.928642    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7878fd6c5b-ffwd9: secret "image-registry-tls" not found
Sep 09 23:05:14.928965 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:05:14.928649    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 23:05:14.928965 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:05:14.928682    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls podName:bd1fe099-faf9-4290-a81b-824f9630f31c nodeName:}" failed. No retries permitted until 2026-09-09 23:06:18.928665384 +0000 UTC m=+163.711705751 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls") pod "dns-default-v4q9p" (UID: "bd1fe099-faf9-4290-a81b-824f9630f31c") : secret "dns-default-metrics-tls" not found
Sep 09 23:05:14.928965 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:05:14.928697    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls podName:0fb09c39-00c7-4de0-bdbe-35cadac25075 nodeName:}" failed. No retries permitted until 2026-09-09 23:06:18.928690302 +0000 UTC m=+163.711730667 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls") pod "image-registry-7878fd6c5b-ffwd9" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075") : secret "image-registry-tls" not found
Sep 09 23:05:14.928965 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:05:14.928709    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert podName:31ee7939-0118-47d2-8a82-21f99709bf37 nodeName:}" failed. No retries permitted until 2026-09-09 23:06:18.928702191 +0000 UTC m=+163.711742552 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2rs4x" (UID: "31ee7939-0118-47d2-8a82-21f99709bf37") : secret "networking-console-plugin-cert" not found
Sep 09 23:05:15.408577 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:15.408538    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:05:18.990297 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:18.990265    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rbfm8"
Sep 09 23:05:23.433840 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.433809    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"]
Sep 09 23:05:23.436640 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.436622    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"
Sep 09 23:05:23.440790 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.440490    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 09 23:05:23.441080 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.441044    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 09 23:05:23.441769 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.441745    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 09 23:05:23.441990 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.441776    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 09 23:05:23.447924 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.447899    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"]
Sep 09 23:05:23.585701 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.585655    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4q55\" (UniqueName: \"kubernetes.io/projected/d47a0687-baf1-466e-96cd-78f7845fba78-kube-api-access-k4q55\") pod \"klusterlet-addon-workmgr-74cdb776f9-827lr\" (UID: \"d47a0687-baf1-466e-96cd-78f7845fba78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"
Sep 09 23:05:23.585701 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.585706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d47a0687-baf1-466e-96cd-78f7845fba78-klusterlet-config\") pod \"klusterlet-addon-workmgr-74cdb776f9-827lr\" (UID: \"d47a0687-baf1-466e-96cd-78f7845fba78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"
Sep 09 23:05:23.585908 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.585780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d47a0687-baf1-466e-96cd-78f7845fba78-tmp\") pod \"klusterlet-addon-workmgr-74cdb776f9-827lr\" (UID: \"d47a0687-baf1-466e-96cd-78f7845fba78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"
Sep 09 23:05:23.686782 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.686719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4q55\" (UniqueName: \"kubernetes.io/projected/d47a0687-baf1-466e-96cd-78f7845fba78-kube-api-access-k4q55\") pod \"klusterlet-addon-workmgr-74cdb776f9-827lr\" (UID: \"d47a0687-baf1-466e-96cd-78f7845fba78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"
Sep 09 23:05:23.686782 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.686760    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d47a0687-baf1-466e-96cd-78f7845fba78-klusterlet-config\") pod \"klusterlet-addon-workmgr-74cdb776f9-827lr\" (UID: \"d47a0687-baf1-466e-96cd-78f7845fba78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"
Sep 09 23:05:23.686890 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.686785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d47a0687-baf1-466e-96cd-78f7845fba78-tmp\") pod \"klusterlet-addon-workmgr-74cdb776f9-827lr\" (UID: \"d47a0687-baf1-466e-96cd-78f7845fba78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"
Sep 09 23:05:23.687087 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.687073    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d47a0687-baf1-466e-96cd-78f7845fba78-tmp\") pod \"klusterlet-addon-workmgr-74cdb776f9-827lr\" (UID: \"d47a0687-baf1-466e-96cd-78f7845fba78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"
Sep 09 23:05:23.689190 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.689160    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d47a0687-baf1-466e-96cd-78f7845fba78-klusterlet-config\") pod \"klusterlet-addon-workmgr-74cdb776f9-827lr\" (UID: \"d47a0687-baf1-466e-96cd-78f7845fba78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"
Sep 09 23:05:23.694356 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.694325    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4q55\" (UniqueName: \"kubernetes.io/projected/d47a0687-baf1-466e-96cd-78f7845fba78-kube-api-access-k4q55\") pod \"klusterlet-addon-workmgr-74cdb776f9-827lr\" (UID: \"d47a0687-baf1-466e-96cd-78f7845fba78\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"
Sep 09 23:05:23.747722 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:23.747684    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"
Sep 09 23:05:24.012276 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:24.012201    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"]
Sep 09 23:05:24.015445 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:05:24.015419    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47a0687_baf1_466e_96cd_78f7845fba78.slice/crio-7246bc1028c6ad4d21fc66ca2b2becd83d94c8b80ca525fdde7f029c2d684db6 WatchSource:0}: Error finding container 7246bc1028c6ad4d21fc66ca2b2becd83d94c8b80ca525fdde7f029c2d684db6: Status 404 returned error can't find the container with id 7246bc1028c6ad4d21fc66ca2b2becd83d94c8b80ca525fdde7f029c2d684db6
Sep 09 23:05:24.073027 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:24.072996    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr" event={"ID":"d47a0687-baf1-466e-96cd-78f7845fba78","Type":"ContainerStarted","Data":"7246bc1028c6ad4d21fc66ca2b2becd83d94c8b80ca525fdde7f029c2d684db6"}
Sep 09 23:05:30.090768 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:30.090727    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr" event={"ID":"d47a0687-baf1-466e-96cd-78f7845fba78","Type":"ContainerStarted","Data":"f9d68b5daae5f1fa079cef5c8db5f6564f96293a9da2c4bb2eec854cb6f51416"}
Sep 09 23:05:30.091235 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:30.090937    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"
Sep 09 23:05:30.092632 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:30.092612    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"
Sep 09 23:05:30.107157 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:30.107113    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr" podStartSLOduration=1.944860222 podStartE2EDuration="7.107099426s" totalImagesPullingTime="5.162239204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:05:30.106869629 +0000 UTC m=+114.889910014" watchObservedRunningTime="2026-09-09 23:05:30.107099426 +0000 UTC m=+114.890139788"
Sep 09 23:05:45.453063 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:05:45.453024    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs\") pod \"network-metrics-daemon-dwb45\" (UID: \"c31b5254-ff30-4381-bcbd-d09e9d6fd177\") " pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:05:45.453498 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:05:45.453201    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 23:05:45.453498 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:05:45.453266    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs podName:c31b5254-ff30-4381-bcbd-d09e9d6fd177 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:47.453247062 +0000 UTC m=+252.236287437 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs") pod "network-metrics-daemon-dwb45" (UID: "c31b5254-ff30-4381-bcbd-d09e9d6fd177") : secret "metrics-daemon-secret" not found
Sep 09 23:06:14.077865 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:06:14.077812    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9" podUID="0fb09c39-00c7-4de0-bdbe-35cadac25075"
Sep 09 23:06:14.087928 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:06:14.087905    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x" podUID="31ee7939-0118-47d2-8a82-21f99709bf37"
Sep 09 23:06:14.107077 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:06:14.107054    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-v4q9p" podUID="bd1fe099-faf9-4290-a81b-824f9630f31c"
Sep 09 23:06:14.193799 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:06:14.193771    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:06:14.193907 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:06:14.193806    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:06:14.729513 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:06:14.729474    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:06:18.989195 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:06:18.989161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:06:18.989195 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:06:18.989201    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:06:18.989710 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:06:18.989240    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2rs4x\" (UID: \"31ee7939-0118-47d2-8a82-21f99709bf37\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:06:18.989710 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:06:18.989331    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:06:18.989710 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:06:18.989405    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 23:06:18.989710 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:06:18.989334    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:06:18.989710 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:06:18.989410    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls podName:bd1fe099-faf9-4290-a81b-824f9630f31c nodeName:}" failed. No retries permitted until 2026-09-09 23:08:20.989394991 +0000 UTC m=+285.772435358 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls") pod "dns-default-v4q9p" (UID: "bd1fe099-faf9-4290-a81b-824f9630f31c") : secret "dns-default-metrics-tls" not found
Sep 09 23:06:18.989710 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:06:18.989448    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7878fd6c5b-ffwd9: secret "image-registry-tls" not found
Sep 09 23:06:18.989710 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:06:18.989474    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert podName:31ee7939-0118-47d2-8a82-21f99709bf37 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:20.989456602 +0000 UTC m=+285.772496968 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2rs4x" (UID: "31ee7939-0118-47d2-8a82-21f99709bf37") : secret "networking-console-plugin-cert" not found
Sep 09 23:06:18.989710 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:06:18.989505    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls podName:0fb09c39-00c7-4de0-bdbe-35cadac25075 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:20.989492516 +0000 UTC m=+285.772532883 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls") pod "image-registry-7878fd6c5b-ffwd9" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075") : secret "image-registry-tls" not found
Sep 09 23:06:25.717359 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:06:25.717319    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:06:27.716319 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:06:27.716282    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:07:20.828082 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:20.828050    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:29.375036 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:29.375002    2562 generic.go:356] "Generic (PLEG): container finished" podID="d47a0687-baf1-466e-96cd-78f7845fba78" containerID="f9d68b5daae5f1fa079cef5c8db5f6564f96293a9da2c4bb2eec854cb6f51416" exitCode=1
Sep 09 23:07:29.375421 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:29.375064    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr" event={"ID":"d47a0687-baf1-466e-96cd-78f7845fba78","Type":"ContainerDied","Data":"f9d68b5daae5f1fa079cef5c8db5f6564f96293a9da2c4bb2eec854cb6f51416"}
Sep 09 23:07:29.375421 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:29.375376    2562 scope.go:117] "RemoveContainer" containerID="f9d68b5daae5f1fa079cef5c8db5f6564f96293a9da2c4bb2eec854cb6f51416"
Sep 09 23:07:30.091478 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:30.091440    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"
Sep 09 23:07:30.379409 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:30.379378    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr" event={"ID":"d47a0687-baf1-466e-96cd-78f7845fba78","Type":"ContainerStarted","Data":"32570cbeedbe785ee63381120fdb2c9cd05832e60fdb89ce148eca74a3ebc496"}
Sep 09 23:07:30.379851 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:30.379724    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"
Sep 09 23:07:30.380252 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:30.380234    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cdb776f9-827lr"
Sep 09 23:07:42.733303 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.733267    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l"]
Sep 09 23:07:42.736096 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.736077    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l"
Sep 09 23:07:42.738991 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.738971    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 09 23:07:42.739825 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.739804    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 09 23:07:42.739986 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.739830    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:07:42.739986 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.739837    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 09 23:07:42.739986 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.739870    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2whxb\""
Sep 09 23:07:42.748614 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.748596    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l"]
Sep 09 23:07:42.787809 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.787786    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa82f387-b993-4bc4-ace1-41bccc668560-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kxh8l\" (UID: \"aa82f387-b993-4bc4-ace1-41bccc668560\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l"
Sep 09 23:07:42.787908 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.787821    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnvpw\" (UniqueName: \"kubernetes.io/projected/aa82f387-b993-4bc4-ace1-41bccc668560-kube-api-access-nnvpw\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kxh8l\" (UID: \"aa82f387-b993-4bc4-ace1-41bccc668560\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l"
Sep 09 23:07:42.787949 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.787900    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa82f387-b993-4bc4-ace1-41bccc668560-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kxh8l\" (UID: \"aa82f387-b993-4bc4-ace1-41bccc668560\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l"
Sep 09 23:07:42.833493 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.833466    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7d775859d6-bqmkj"]
Sep 09 23:07:42.836185 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.836171    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:42.838437 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.838420    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 09 23:07:42.838854 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.838826    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 09 23:07:42.838969 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.838942    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 23:07:42.839043 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.838941    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 09 23:07:42.839095 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.839062    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 09 23:07:42.839155 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.839101    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sv4mh\""
Sep 09 23:07:42.839676 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.839661    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 23:07:42.851372 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.851336    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7d775859d6-bqmkj"]
Sep 09 23:07:42.888276 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.888244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa82f387-b993-4bc4-ace1-41bccc668560-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kxh8l\" (UID: \"aa82f387-b993-4bc4-ace1-41bccc668560\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l"
Sep 09 23:07:42.888420 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.888291    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:42.888420 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.888337    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:42.888420 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.888388    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9c29\" (UniqueName: \"kubernetes.io/projected/d313f23b-e292-497c-93e9-9c321609462e-kube-api-access-l9c29\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:42.888535 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.888455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa82f387-b993-4bc4-ace1-41bccc668560-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kxh8l\" (UID: \"aa82f387-b993-4bc4-ace1-41bccc668560\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l"
Sep 09 23:07:42.888535 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.888495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnvpw\" (UniqueName: \"kubernetes.io/projected/aa82f387-b993-4bc4-ace1-41bccc668560-kube-api-access-nnvpw\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kxh8l\" (UID: \"aa82f387-b993-4bc4-ace1-41bccc668560\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l"
Sep 09 23:07:42.888535 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.888527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-default-certificate\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:42.888644 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.888546    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-stats-auth\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:42.889046 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.889031    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa82f387-b993-4bc4-ace1-41bccc668560-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kxh8l\" (UID: \"aa82f387-b993-4bc4-ace1-41bccc668560\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l"
Sep 09 23:07:42.890302 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.890283    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa82f387-b993-4bc4-ace1-41bccc668560-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kxh8l\" (UID: \"aa82f387-b993-4bc4-ace1-41bccc668560\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l"
Sep 09 23:07:42.895771 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.895753    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnvpw\" (UniqueName: \"kubernetes.io/projected/aa82f387-b993-4bc4-ace1-41bccc668560-kube-api-access-nnvpw\") pod \"kube-storage-version-migrator-operator-8d7dd4675-kxh8l\" (UID: \"aa82f387-b993-4bc4-ace1-41bccc668560\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l"
Sep 09 23:07:42.957235 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.957210    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:42.989425 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.989332    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:42.989425 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.989395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9c29\" (UniqueName: \"kubernetes.io/projected/d313f23b-e292-497c-93e9-9c321609462e-kube-api-access-l9c29\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:42.989425 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.989435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-default-certificate\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:42.989600 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.989451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-stats-auth\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:42.989600 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:42.989507    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle podName:d313f23b-e292-497c-93e9-9c321609462e nodeName:}" failed. No retries permitted until 2026-09-09 23:07:43.489485223 +0000 UTC m=+248.272525585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle") pod "router-default-7d775859d6-bqmkj" (UID: "d313f23b-e292-497c-93e9-9c321609462e") : configmap references non-existent config key: service-ca.crt
Sep 09 23:07:42.989600 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.989548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:42.989729 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:42.989640    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 23:07:42.989729 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:42.989683    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs podName:d313f23b-e292-497c-93e9-9c321609462e nodeName:}" failed. No retries permitted until 2026-09-09 23:07:43.48967022 +0000 UTC m=+248.272710582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs") pod "router-default-7d775859d6-bqmkj" (UID: "d313f23b-e292-497c-93e9-9c321609462e") : secret "router-metrics-certs-default" not found
Sep 09 23:07:42.991852 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.991826    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-default-certificate\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:42.991928 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.991826    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-stats-auth\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:42.999185 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:42.999169    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9c29\" (UniqueName: \"kubernetes.io/projected/d313f23b-e292-497c-93e9-9c321609462e-kube-api-access-l9c29\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:43.044766 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:43.044738    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l"
Sep 09 23:07:43.057712 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:43.057688    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:43.310783 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:43.310716    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l"]
Sep 09 23:07:43.313514 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:07:43.313480    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa82f387_b993_4bc4_ace1_41bccc668560.slice/crio-3f65444732ad73cc85da621ac1aa37163e9a84c66069a898139eedd349405544 WatchSource:0}: Error finding container 3f65444732ad73cc85da621ac1aa37163e9a84c66069a898139eedd349405544: Status 404 returned error can't find the container with id 3f65444732ad73cc85da621ac1aa37163e9a84c66069a898139eedd349405544
Sep 09 23:07:43.412143 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:43.412108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l" event={"ID":"aa82f387-b993-4bc4-ace1-41bccc668560","Type":"ContainerStarted","Data":"3f65444732ad73cc85da621ac1aa37163e9a84c66069a898139eedd349405544"}
Sep 09 23:07:43.492908 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:43.492876    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:43.493062 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:43.492919    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:43.493062 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:43.493029    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 23:07:43.493062 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:43.493051    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle podName:d313f23b-e292-497c-93e9-9c321609462e nodeName:}" failed. No retries permitted until 2026-09-09 23:07:44.493033213 +0000 UTC m=+249.276073575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle") pod "router-default-7d775859d6-bqmkj" (UID: "d313f23b-e292-497c-93e9-9c321609462e") : configmap references non-existent config key: service-ca.crt
Sep 09 23:07:43.493167 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:43.493071    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs podName:d313f23b-e292-497c-93e9-9c321609462e nodeName:}" failed. No retries permitted until 2026-09-09 23:07:44.493060487 +0000 UTC m=+249.276100862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs") pod "router-default-7d775859d6-bqmkj" (UID: "d313f23b-e292-497c-93e9-9c321609462e") : secret "router-metrics-certs-default" not found
Sep 09 23:07:44.502059 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:44.502022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:44.502059 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:44.502067    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:44.502540 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:44.502170    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 23:07:44.502540 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:44.502193    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle podName:d313f23b-e292-497c-93e9-9c321609462e nodeName:}" failed. No retries permitted until 2026-09-09 23:07:46.502177265 +0000 UTC m=+251.285217627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle") pod "router-default-7d775859d6-bqmkj" (UID: "d313f23b-e292-497c-93e9-9c321609462e") : configmap references non-existent config key: service-ca.crt
Sep 09 23:07:44.502540 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:44.502236    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs podName:d313f23b-e292-497c-93e9-9c321609462e nodeName:}" failed. No retries permitted until 2026-09-09 23:07:46.502218124 +0000 UTC m=+251.285258489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs") pod "router-default-7d775859d6-bqmkj" (UID: "d313f23b-e292-497c-93e9-9c321609462e") : secret "router-metrics-certs-default" not found
Sep 09 23:07:45.419582 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:45.419548    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l" event={"ID":"aa82f387-b993-4bc4-ace1-41bccc668560","Type":"ContainerStarted","Data":"78896ae82f574875b5839ca0f61d66fac6df7b12d24ec16dad07bb3996a7e32b"}
Sep 09 23:07:45.434463 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:45.434413    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l" podStartSLOduration=1.473075689 podStartE2EDuration="3.43439344s" totalImagesPullingTime="1.961317751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:45.434288573 +0000 UTC m=+250.217328969" watchObservedRunningTime="2026-09-09 23:07:45.43439344 +0000 UTC m=+250.217433805"
Sep 09 23:07:45.770363 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:45.770303    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:46.005310 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:46.005268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:46.516361 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:46.516316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:46.516564 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:46.516379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:46.516564 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:46.516496    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 23:07:46.516676 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:46.516575    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs podName:d313f23b-e292-497c-93e9-9c321609462e nodeName:}" failed. No retries permitted until 2026-09-09 23:07:50.516552885 +0000 UTC m=+255.299593250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs") pod "router-default-7d775859d6-bqmkj" (UID: "d313f23b-e292-497c-93e9-9c321609462e") : secret "router-metrics-certs-default" not found
Sep 09 23:07:46.516676 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:46.516600    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle podName:d313f23b-e292-497c-93e9-9c321609462e nodeName:}" failed. No retries permitted until 2026-09-09 23:07:50.516588047 +0000 UTC m=+255.299628411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle") pod "router-default-7d775859d6-bqmkj" (UID: "d313f23b-e292-497c-93e9-9c321609462e") : configmap references non-existent config key: service-ca.crt
Sep 09 23:07:46.884375 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:46.884325    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:47.110391 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.110337    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:47.166834 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.166778    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:47.525008 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.524923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs\") pod \"network-metrics-daemon-dwb45\" (UID: \"c31b5254-ff30-4381-bcbd-d09e9d6fd177\") " pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:07:47.525147 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:47.525064    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 23:07:47.525147 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:47.525122    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs podName:c31b5254-ff30-4381-bcbd-d09e9d6fd177 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:49.525108049 +0000 UTC m=+374.308148410 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs") pod "network-metrics-daemon-dwb45" (UID: "c31b5254-ff30-4381-bcbd-d09e9d6fd177") : secret "metrics-daemon-secret" not found
Sep 09 23:07:47.639487 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.639456    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dzlv2"]
Sep 09 23:07:47.642610 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.642590    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:47.645131 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.645109    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 23:07:47.645310 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.645292    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 23:07:47.646258 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.646238    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6xppp\""
Sep 09 23:07:47.646367 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.646238    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 23:07:47.646367 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.646242    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 23:07:47.652018 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.651995    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:47.652018 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.652011    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dzlv2"]
Sep 09 23:07:47.715246 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.715213    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:47.725551 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.725525    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ccdd862f-4d28-40b9-a758-97289f68ee44-crio-socket\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:47.725675 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.725557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncs9q\" (UniqueName: \"kubernetes.io/projected/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-api-access-ncs9q\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:47.725675 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.725642    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:47.725675 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.725663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:47.725790 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.725719    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccdd862f-4d28-40b9-a758-97289f68ee44-data-volume\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:47.826233 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.826162    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncs9q\" (UniqueName: \"kubernetes.io/projected/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-api-access-ncs9q\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:47.826405 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.826249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:47.826405 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.826273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:47.826405 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.826302    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccdd862f-4d28-40b9-a758-97289f68ee44-data-volume\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:47.826405 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.826333    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ccdd862f-4d28-40b9-a758-97289f68ee44-crio-socket\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:47.826405 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:47.826392    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:07:47.826611 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.826429    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ccdd862f-4d28-40b9-a758-97289f68ee44-crio-socket\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:47.826611 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:47.826430    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:07:47.826611 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:47.826457    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm podName:ccdd862f-4d28-40b9-a758-97289f68ee44 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:48.326439131 +0000 UTC m=+253.109479497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dzlv2" (UID: "ccdd862f-4d28-40b9-a758-97289f68ee44") : configmap "kube-rbac-proxy" not found
Sep 09 23:07:47.826611 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:47.826481    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls podName:ccdd862f-4d28-40b9-a758-97289f68ee44 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:48.326470208 +0000 UTC m=+253.109510573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dzlv2" (UID: "ccdd862f-4d28-40b9-a758-97289f68ee44") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:07:47.826745 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.826623    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccdd862f-4d28-40b9-a758-97289f68ee44-data-volume\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:47.835774 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:47.835749    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncs9q\" (UniqueName: \"kubernetes.io/projected/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-api-access-ncs9q\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:48.330806 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:48.330761    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:48.330806 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:48.330807    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:48.331205 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:48.330881    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:07:48.331205 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:48.330917    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:07:48.331205 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:48.330945    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm podName:ccdd862f-4d28-40b9-a758-97289f68ee44 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:49.330929868 +0000 UTC m=+254.113970230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dzlv2" (UID: "ccdd862f-4d28-40b9-a758-97289f68ee44") : configmap "kube-rbac-proxy" not found
Sep 09 23:07:48.331205 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:48.330959    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls podName:ccdd862f-4d28-40b9-a758-97289f68ee44 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:49.330952627 +0000 UTC m=+254.113992989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dzlv2" (UID: "ccdd862f-4d28-40b9-a758-97289f68ee44") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:07:48.556583 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:48.556550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:48.608519 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:48.608450    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:48.991887 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:48.991857    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:49.260185 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:49.260121    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:49.338763 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:49.338730    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:49.339061 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:49.338771    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:49.339061 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:49.338853    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:07:49.339061 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:49.338932    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm podName:ccdd862f-4d28-40b9-a758-97289f68ee44 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:51.338916159 +0000 UTC m=+256.121956528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dzlv2" (UID: "ccdd862f-4d28-40b9-a758-97289f68ee44") : configmap "kube-rbac-proxy" not found
Sep 09 23:07:49.339061 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:49.338946    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:07:49.339061 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:49.338996    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls podName:ccdd862f-4d28-40b9-a758-97289f68ee44 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:51.338980682 +0000 UTC m=+256.122021046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dzlv2" (UID: "ccdd862f-4d28-40b9-a758-97289f68ee44") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:07:49.360546 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:49.360519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:49.747627 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:49.747594    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:49.799872 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:49.799842    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:50.213950 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:50.213925    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5sd94_6397c170-a04a-4a23-8705-2d1033baca7e/dns-node-resolver/0.log"
Sep 09 23:07:50.548951 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:50.548869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:50.548951 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:50.548901    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:50.549317 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:50.549021    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 23:07:50.549317 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:50.549062    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle podName:d313f23b-e292-497c-93e9-9c321609462e nodeName:}" failed. No retries permitted until 2026-09-09 23:07:58.549045679 +0000 UTC m=+263.332086042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle") pod "router-default-7d775859d6-bqmkj" (UID: "d313f23b-e292-497c-93e9-9c321609462e") : configmap references non-existent config key: service-ca.crt
Sep 09 23:07:50.549317 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:50.549086    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs podName:d313f23b-e292-497c-93e9-9c321609462e nodeName:}" failed. No retries permitted until 2026-09-09 23:07:58.549078386 +0000 UTC m=+263.332118748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs") pod "router-default-7d775859d6-bqmkj" (UID: "d313f23b-e292-497c-93e9-9c321609462e") : secret "router-metrics-certs-default" not found
Sep 09 23:07:50.855837 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:50.855762    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-zdxvd"]
Sep 09 23:07:50.858799 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:50.858784    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-zdxvd"
Sep 09 23:07:50.861269 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:50.861248    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-62jkf\""
Sep 09 23:07:50.861411 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:50.861313    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 09 23:07:50.862257 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:50.862240    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 09 23:07:50.862368 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:50.862291    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 09 23:07:50.862519 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:50.862506    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 09 23:07:50.867645 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:50.867623    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-zdxvd"]
Sep 09 23:07:50.890742 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:50.890716    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:50.945734 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:50.945713    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:50.952855 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:50.952834    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/73b86070-ae64-4b22-8e39-bf3163165008-signing-key\") pod \"service-ca-75d99c484-zdxvd\" (UID: \"73b86070-ae64-4b22-8e39-bf3163165008\") " pod="openshift-service-ca/service-ca-75d99c484-zdxvd"
Sep 09 23:07:50.952918 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:50.952863    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/73b86070-ae64-4b22-8e39-bf3163165008-signing-cabundle\") pod \"service-ca-75d99c484-zdxvd\" (UID: \"73b86070-ae64-4b22-8e39-bf3163165008\") " pod="openshift-service-ca/service-ca-75d99c484-zdxvd"
Sep 09 23:07:50.952918 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:50.952890    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k52j6\" (UniqueName: \"kubernetes.io/projected/73b86070-ae64-4b22-8e39-bf3163165008-kube-api-access-k52j6\") pod \"service-ca-75d99c484-zdxvd\" (UID: \"73b86070-ae64-4b22-8e39-bf3163165008\") " pod="openshift-service-ca/service-ca-75d99c484-zdxvd"
Sep 09 23:07:51.053555 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:51.053527    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/73b86070-ae64-4b22-8e39-bf3163165008-signing-key\") pod \"service-ca-75d99c484-zdxvd\" (UID: \"73b86070-ae64-4b22-8e39-bf3163165008\") " pod="openshift-service-ca/service-ca-75d99c484-zdxvd"
Sep 09 23:07:51.053669 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:51.053563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/73b86070-ae64-4b22-8e39-bf3163165008-signing-cabundle\") pod \"service-ca-75d99c484-zdxvd\" (UID: \"73b86070-ae64-4b22-8e39-bf3163165008\") " pod="openshift-service-ca/service-ca-75d99c484-zdxvd"
Sep 09 23:07:51.053669 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:51.053589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k52j6\" (UniqueName: \"kubernetes.io/projected/73b86070-ae64-4b22-8e39-bf3163165008-kube-api-access-k52j6\") pod \"service-ca-75d99c484-zdxvd\" (UID: \"73b86070-ae64-4b22-8e39-bf3163165008\") " pod="openshift-service-ca/service-ca-75d99c484-zdxvd"
Sep 09 23:07:51.054152 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:51.054128    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/73b86070-ae64-4b22-8e39-bf3163165008-signing-cabundle\") pod \"service-ca-75d99c484-zdxvd\" (UID: \"73b86070-ae64-4b22-8e39-bf3163165008\") " pod="openshift-service-ca/service-ca-75d99c484-zdxvd"
Sep 09 23:07:51.055909 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:51.055889    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/73b86070-ae64-4b22-8e39-bf3163165008-signing-key\") pod \"service-ca-75d99c484-zdxvd\" (UID: \"73b86070-ae64-4b22-8e39-bf3163165008\") " pod="openshift-service-ca/service-ca-75d99c484-zdxvd"
Sep 09 23:07:51.061845 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:51.061821    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k52j6\" (UniqueName: \"kubernetes.io/projected/73b86070-ae64-4b22-8e39-bf3163165008-kube-api-access-k52j6\") pod \"service-ca-75d99c484-zdxvd\" (UID: \"73b86070-ae64-4b22-8e39-bf3163165008\") " pod="openshift-service-ca/service-ca-75d99c484-zdxvd"
Sep 09 23:07:51.167386 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:51.167360    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-zdxvd"
Sep 09 23:07:51.356694 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:51.356658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:51.356694 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:51.356696    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:51.356894 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:51.356798    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:07:51.356894 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:51.356866    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm podName:ccdd862f-4d28-40b9-a758-97289f68ee44 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:55.356848351 +0000 UTC m=+260.139888717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dzlv2" (UID: "ccdd862f-4d28-40b9-a758-97289f68ee44") : configmap "kube-rbac-proxy" not found
Sep 09 23:07:51.356894 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:51.356872    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:07:51.356987 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:51.356915    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls podName:ccdd862f-4d28-40b9-a758-97289f68ee44 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:55.356899635 +0000 UTC m=+260.139939997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dzlv2" (UID: "ccdd862f-4d28-40b9-a758-97289f68ee44") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:07:51.413217 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:51.413196    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-chj99_e6ce54c2-4e66-4b37-96fe-d348247d7628/node-ca/0.log"
Sep 09 23:07:51.431829 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:51.431774    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-zdxvd"]
Sep 09 23:07:51.434443 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:07:51.434414    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b86070_ae64_4b22_8e39_bf3163165008.slice/crio-201cc76bea947980072781853d5e98d64298b22c9afa9bd605e01cc6bec34463 WatchSource:0}: Error finding container 201cc76bea947980072781853d5e98d64298b22c9afa9bd605e01cc6bec34463: Status 404 returned error can't find the container with id 201cc76bea947980072781853d5e98d64298b22c9afa9bd605e01cc6bec34463
Sep 09 23:07:51.801747 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:51.801671    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:52.213810 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:52.213784    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hrpfl_0c3b7480-0c2a-4f3d-97af-ad331496274a/serve-healthcheck-canary/0.log"
Sep 09 23:07:52.440225 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:52.440198    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-zdxvd" event={"ID":"73b86070-ae64-4b22-8e39-bf3163165008","Type":"ContainerStarted","Data":"201cc76bea947980072781853d5e98d64298b22c9afa9bd605e01cc6bec34463"}
Sep 09 23:07:53.016361 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:53.016289    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-kxh8l_aa82f387-b993-4bc4-ace1-41bccc668560/kube-storage-version-migrator-operator/0.log"
Sep 09 23:07:54.079244 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:54.079201    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:54.179503 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:54.179451    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:54.276622 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:54.276583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:54.377305 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:54.377268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:54.434430 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:54.434406    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:54.447945 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:54.447917    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-zdxvd" event={"ID":"73b86070-ae64-4b22-8e39-bf3163165008","Type":"ContainerStarted","Data":"d828dbc91644c64eb40b7f8912ea59f534384966aa5ff689d85f63a7c4a91737"}
Sep 09 23:07:54.463768 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:54.463725    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-zdxvd" podStartSLOduration=2.447508731 podStartE2EDuration="4.463707519s" totalImagesPullingTime="2.016198788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:54.463381112 +0000 UTC m=+259.246421495" watchObservedRunningTime="2026-09-09 23:07:54.463707519 +0000 UTC m=+259.246747904"
Sep 09 23:07:55.172176 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:55.172139    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:55.391568 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:55.391539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:55.391568 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:55.391571    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:07:55.391756 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:55.391658    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:07:55.391756 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:55.391690    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:07:55.391756 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:55.391723    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm podName:ccdd862f-4d28-40b9-a758-97289f68ee44 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:03.391708476 +0000 UTC m=+268.174748837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dzlv2" (UID: "ccdd862f-4d28-40b9-a758-97289f68ee44") : configmap "kube-rbac-proxy" not found
Sep 09 23:07:55.391756 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:55.391737    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls podName:ccdd862f-4d28-40b9-a758-97289f68ee44 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:03.391731017 +0000 UTC m=+268.174771379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dzlv2" (UID: "ccdd862f-4d28-40b9-a758-97289f68ee44") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:07:55.770396 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:55.770341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:55.974827 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:55.974791    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:56.172997 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:56.172958    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:56.570605 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:56.570493    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:57.170432 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:57.170377    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:57.772226 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:57.772186    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:57.824988 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:57.824955    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:57.968680 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:57.968608    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:58.027680 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:58.027596    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:58.216597 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:58.216569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:58.393701 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:58.393674    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:58.572278 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:58.572230    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:58.615701 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:58.615676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:58.615804 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:58.615706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:07:58.615854 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:58.615829    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle podName:d313f23b-e292-497c-93e9-9c321609462e nodeName:}" failed. No retries permitted until 2026-09-09 23:08:14.615812188 +0000 UTC m=+279.398852550 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle") pod "router-default-7d775859d6-bqmkj" (UID: "d313f23b-e292-497c-93e9-9c321609462e") : configmap references non-existent config key: service-ca.crt
Sep 09 23:07:58.615854 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:58.615845    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 23:07:58.615932 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:07:58.615883    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs podName:d313f23b-e292-497c-93e9-9c321609462e nodeName:}" failed. No retries permitted until 2026-09-09 23:08:14.61587198 +0000 UTC m=+279.398912342 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs") pod "router-default-7d775859d6-bqmkj" (UID: "d313f23b-e292-497c-93e9-9c321609462e") : secret "router-metrics-certs-default" not found
Sep 09 23:07:59.167944 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:59.167903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:59.572263 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:59.572173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:07:59.974485 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:07:59.974449    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:00.094187 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:00.094151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:00.374700 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:00.374670    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:00.479741 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:00.479709    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:00.774394 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:00.774258    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:01.168395 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:01.168362    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:01.371169 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:01.371137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:01.769358 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:01.769319    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:02.173240 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:02.173206    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:02.771287 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:02.771258    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:03.371824 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:03.371790    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:03.450982 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:03.450941    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:08:03.450982 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:03.450984    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:08:03.451201 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:08:03.451098    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:08:03.451201 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:08:03.451153    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls podName:ccdd862f-4d28-40b9-a758-97289f68ee44 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:19.451139957 +0000 UTC m=+284.234180319 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dzlv2" (UID: "ccdd862f-4d28-40b9-a758-97289f68ee44") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:08:03.451500 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:03.451480    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccdd862f-4d28-40b9-a758-97289f68ee44-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:08:03.572111 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:03.572077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:03.772116 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:03.772086    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:04.171903 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:04.171871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:04.590455 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:04.590379    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:04.774650 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:04.774617    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:08.530990 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:08.530961    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:08.632703 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:08.632675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:08.732176 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:08.732142    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:08.815526 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:08.815451    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:08.877384 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:08.877339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:09.035182 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:09.035151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:09.412950 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:09.412918    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:09.513986 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:09.513951    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:09.831987 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:09.831895    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:10.036289 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:10.036259    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:10.136929 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:10.136898    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:10.236687 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:10.236654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:10.401449 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:10.401334    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:10.623105 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:10.623074    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:11.057195 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:11.057161    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:11.184874 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:11.184843    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:11.841482 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:11.841450    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:11.895834 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:11.895809    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:12.345774 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:12.345729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:12.401433 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:12.401382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:14.635093 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:14.635060    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:08:14.635093 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:14.635094    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:08:14.635780 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:14.635762    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d313f23b-e292-497c-93e9-9c321609462e-service-ca-bundle\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:08:14.637420 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:14.637402    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d313f23b-e292-497c-93e9-9c321609462e-metrics-certs\") pod \"router-default-7d775859d6-bqmkj\" (UID: \"d313f23b-e292-497c-93e9-9c321609462e\") " pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:08:14.644263 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:14.644243    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:08:14.912663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:14.912592    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7d775859d6-bqmkj"]
Sep 09 23:08:14.915804 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:08:14.915779    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd313f23b_e292_497c_93e9_9c321609462e.slice/crio-8cae8a5b43ff720ec74669f7551731336865ae4be5dbb5bd37a84641145da61e WatchSource:0}: Error finding container 8cae8a5b43ff720ec74669f7551731336865ae4be5dbb5bd37a84641145da61e: Status 404 returned error can't find the container with id 8cae8a5b43ff720ec74669f7551731336865ae4be5dbb5bd37a84641145da61e
Sep 09 23:08:15.516119 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:15.516084    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7d775859d6-bqmkj" event={"ID":"d313f23b-e292-497c-93e9-9c321609462e","Type":"ContainerStarted","Data":"62683a054bee651d4fb666e87a93a8c3b1beb6c087c32fa047edd3c5aeb6ca6c"}
Sep 09 23:08:15.516382 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:15.516137    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7d775859d6-bqmkj" event={"ID":"d313f23b-e292-497c-93e9-9c321609462e","Type":"ContainerStarted","Data":"8cae8a5b43ff720ec74669f7551731336865ae4be5dbb5bd37a84641145da61e"}
Sep 09 23:08:15.533801 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:15.533754    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7d775859d6-bqmkj" podStartSLOduration=33.53373844 podStartE2EDuration="33.53373844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:07:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:15.532882703 +0000 UTC m=+280.315923087" watchObservedRunningTime="2026-09-09 23:08:15.53373844 +0000 UTC m=+280.316778824"
Sep 09 23:08:15.644485 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:15.644448    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:08:15.647010 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:15.646987    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:08:16.518785 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:16.518755    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:08:16.520063 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:16.520039    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7d775859d6-bqmkj"
Sep 09 23:08:17.194574 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:08:17.194533    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-v4q9p" podUID="bd1fe099-faf9-4290-a81b-824f9630f31c"
Sep 09 23:08:17.194574 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:08:17.194533    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9" podUID="0fb09c39-00c7-4de0-bdbe-35cadac25075"
Sep 09 23:08:17.457535 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:17.457453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:17.522026 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:17.521994    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:08:17.522026 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:17.522001    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:08:17.556566 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:17.556543    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:17.634325 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:17.634295    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:17.762583 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:17.762511    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:19.472734 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:19.472701    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:08:19.474993 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:19.474971    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccdd862f-4d28-40b9-a758-97289f68ee44-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzlv2\" (UID: \"ccdd862f-4d28-40b9-a758-97289f68ee44\") " pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:08:19.751416 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:19.751319    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dzlv2"
Sep 09 23:08:20.021212 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:20.021189    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dzlv2"]
Sep 09 23:08:20.023650 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:08:20.023623    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccdd862f_4d28_40b9_a758_97289f68ee44.slice/crio-67c8ae734d105fd7af8cbad271e4c6707febe5ad30c93993095a90c35b2d117f WatchSource:0}: Error finding container 67c8ae734d105fd7af8cbad271e4c6707febe5ad30c93993095a90c35b2d117f: Status 404 returned error can't find the container with id 67c8ae734d105fd7af8cbad271e4c6707febe5ad30c93993095a90c35b2d117f
Sep 09 23:08:20.533122 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:20.533089    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dzlv2" event={"ID":"ccdd862f-4d28-40b9-a758-97289f68ee44","Type":"ContainerStarted","Data":"2d7adddb526239254f97e17fd06bb171dd427c6a0e2c164ea7a62b5a2754cd44"}
Sep 09 23:08:20.533554 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:20.533156    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dzlv2" event={"ID":"ccdd862f-4d28-40b9-a758-97289f68ee44","Type":"ContainerStarted","Data":"67c8ae734d105fd7af8cbad271e4c6707febe5ad30c93993095a90c35b2d117f"}
Sep 09 23:08:21.085040 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.084985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:08:21.085040 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.085050    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:08:21.085308 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.085089    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2rs4x\" (UID: \"31ee7939-0118-47d2-8a82-21f99709bf37\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:08:21.087462 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.087426    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd1fe099-faf9-4290-a81b-824f9630f31c-metrics-tls\") pod \"dns-default-v4q9p\" (UID: \"bd1fe099-faf9-4290-a81b-824f9630f31c\") " pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:08:21.087462 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.087442    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31ee7939-0118-47d2-8a82-21f99709bf37-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2rs4x\" (UID: \"31ee7939-0118-47d2-8a82-21f99709bf37\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:08:21.087609 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.087480    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls\") pod \"image-registry-7878fd6c5b-ffwd9\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") " pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:08:21.119719 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.119690    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6mtf5\""
Sep 09 23:08:21.124552 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.124532    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jj6sk\""
Sep 09 23:08:21.124656 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.124636    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-699nw\""
Sep 09 23:08:21.127418 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.127402    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x"
Sep 09 23:08:21.133276 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.133262    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:08:21.133383 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.133369    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:08:21.397935 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.397894    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-2rs4x"]
Sep 09 23:08:21.401568 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:08:21.401538    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ee7939_0118_47d2_8a82_21f99709bf37.slice/crio-9b55e637b8e81060e88d5c3dd1da718c878c9ada22c86d183f5f8676d900ee43 WatchSource:0}: Error finding container 9b55e637b8e81060e88d5c3dd1da718c878c9ada22c86d183f5f8676d900ee43: Status 404 returned error can't find the container with id 9b55e637b8e81060e88d5c3dd1da718c878c9ada22c86d183f5f8676d900ee43
Sep 09 23:08:21.409769 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.409745    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v4q9p"]
Sep 09 23:08:21.413041 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:08:21.413012    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd1fe099_faf9_4290_a81b_824f9630f31c.slice/crio-97049738e18909959dce1bcc1622b5e98461fbe6c5d509e082d475a2f318b969 WatchSource:0}: Error finding container 97049738e18909959dce1bcc1622b5e98461fbe6c5d509e082d475a2f318b969: Status 404 returned error can't find the container with id 97049738e18909959dce1bcc1622b5e98461fbe6c5d509e082d475a2f318b969
Sep 09 23:08:21.413156 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.413098    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7878fd6c5b-ffwd9"]
Sep 09 23:08:21.416464 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:08:21.416442    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fb09c39_00c7_4de0_bdbe_35cadac25075.slice/crio-8add120f2edf61c9735fee547450727ee5bc497bd96c897d2a716f80f2c17dc6 WatchSource:0}: Error finding container 8add120f2edf61c9735fee547450727ee5bc497bd96c897d2a716f80f2c17dc6: Status 404 returned error can't find the container with id 8add120f2edf61c9735fee547450727ee5bc497bd96c897d2a716f80f2c17dc6
Sep 09 23:08:21.539568 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.539533    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9" event={"ID":"0fb09c39-00c7-4de0-bdbe-35cadac25075","Type":"ContainerStarted","Data":"1f98c74175a51fb1ec71c66ac6f47c40d42fb58814706e86f8712f4e0e93ddb0"}
Sep 09 23:08:21.539987 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.539589    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9" event={"ID":"0fb09c39-00c7-4de0-bdbe-35cadac25075","Type":"ContainerStarted","Data":"8add120f2edf61c9735fee547450727ee5bc497bd96c897d2a716f80f2c17dc6"}
Sep 09 23:08:21.539987 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.539632    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:08:21.542083 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.542058    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dzlv2" event={"ID":"ccdd862f-4d28-40b9-a758-97289f68ee44","Type":"ContainerStarted","Data":"ba164ef17da16d9bce4c8d7b9aa03194b00d01adafc97957c5abc93d23300496"}
Sep 09 23:08:21.543617 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.543593    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x" event={"ID":"31ee7939-0118-47d2-8a82-21f99709bf37","Type":"ContainerStarted","Data":"9b55e637b8e81060e88d5c3dd1da718c878c9ada22c86d183f5f8676d900ee43"}
Sep 09 23:08:21.544971 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.544950    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v4q9p" event={"ID":"bd1fe099-faf9-4290-a81b-824f9630f31c","Type":"ContainerStarted","Data":"97049738e18909959dce1bcc1622b5e98461fbe6c5d509e082d475a2f318b969"}
Sep 09 23:08:21.559032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.558978    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9" podStartSLOduration=263.558960503 podStartE2EDuration="4m23.558960503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:03:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:21.55813357 +0000 UTC m=+286.341173955" watchObservedRunningTime="2026-09-09 23:08:21.558960503 +0000 UTC m=+286.342000888"
Sep 09 23:08:21.642643 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.642604    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:21.669376 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.669285    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-czkr5"]
Sep 09 23:08:21.672735 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.672714    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5"
Sep 09 23:08:21.675709 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.675459    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9nmp2\""
Sep 09 23:08:21.675709 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.675479    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 23:08:21.675709 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.675498    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 09 23:08:21.675709 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.675459    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 23:08:21.675709 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.675479    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 09 23:08:21.675709 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.675598    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 23:08:21.682430 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.681813    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-czkr5"]
Sep 09 23:08:21.702815 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.702773    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:21.790594 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.790556    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/710cab43-d10f-4aa3-af4c-0eecab1218b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-czkr5\" (UID: \"710cab43-d10f-4aa3-af4c-0eecab1218b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5"
Sep 09 23:08:21.790744 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.790628    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8bvk\" (UniqueName: \"kubernetes.io/projected/710cab43-d10f-4aa3-af4c-0eecab1218b7-kube-api-access-k8bvk\") pod \"prometheus-operator-6f4946db56-czkr5\" (UID: \"710cab43-d10f-4aa3-af4c-0eecab1218b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5"
Sep 09 23:08:21.790744 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.790660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/710cab43-d10f-4aa3-af4c-0eecab1218b7-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-czkr5\" (UID: \"710cab43-d10f-4aa3-af4c-0eecab1218b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5"
Sep 09 23:08:21.790893 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.790742    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/710cab43-d10f-4aa3-af4c-0eecab1218b7-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-czkr5\" (UID: \"710cab43-d10f-4aa3-af4c-0eecab1218b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5"
Sep 09 23:08:21.891753 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.891719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8bvk\" (UniqueName: \"kubernetes.io/projected/710cab43-d10f-4aa3-af4c-0eecab1218b7-kube-api-access-k8bvk\") pod \"prometheus-operator-6f4946db56-czkr5\" (UID: \"710cab43-d10f-4aa3-af4c-0eecab1218b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5"
Sep 09 23:08:21.891753 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.891757    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/710cab43-d10f-4aa3-af4c-0eecab1218b7-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-czkr5\" (UID: \"710cab43-d10f-4aa3-af4c-0eecab1218b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5"
Sep 09 23:08:21.891976 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.891838    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/710cab43-d10f-4aa3-af4c-0eecab1218b7-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-czkr5\" (UID: \"710cab43-d10f-4aa3-af4c-0eecab1218b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5"
Sep 09 23:08:21.891976 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.891880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/710cab43-d10f-4aa3-af4c-0eecab1218b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-czkr5\" (UID: \"710cab43-d10f-4aa3-af4c-0eecab1218b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5"
Sep 09 23:08:21.892568 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.892540    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/710cab43-d10f-4aa3-af4c-0eecab1218b7-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-czkr5\" (UID: \"710cab43-d10f-4aa3-af4c-0eecab1218b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5"
Sep 09 23:08:21.894512 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.894489    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/710cab43-d10f-4aa3-af4c-0eecab1218b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-czkr5\" (UID: \"710cab43-d10f-4aa3-af4c-0eecab1218b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5"
Sep 09 23:08:21.894632 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.894595    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/710cab43-d10f-4aa3-af4c-0eecab1218b7-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-czkr5\" (UID: \"710cab43-d10f-4aa3-af4c-0eecab1218b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5"
Sep 09 23:08:21.899810 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.899749    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8bvk\" (UniqueName: \"kubernetes.io/projected/710cab43-d10f-4aa3-af4c-0eecab1218b7-kube-api-access-k8bvk\") pod \"prometheus-operator-6f4946db56-czkr5\" (UID: \"710cab43-d10f-4aa3-af4c-0eecab1218b7\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5"
Sep 09 23:08:21.930164 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.930020    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:21.988553 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:21.988518    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5"
Sep 09 23:08:22.406581 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:22.406495    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-czkr5"]
Sep 09 23:08:22.409548 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:08:22.409515    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod710cab43_d10f_4aa3_af4c_0eecab1218b7.slice/crio-1b1d065a688cf368acb1b42d539832fcd80e58a3e7611bfb348d58b19eb56e14 WatchSource:0}: Error finding container 1b1d065a688cf368acb1b42d539832fcd80e58a3e7611bfb348d58b19eb56e14: Status 404 returned error can't find the container with id 1b1d065a688cf368acb1b42d539832fcd80e58a3e7611bfb348d58b19eb56e14
Sep 09 23:08:22.550446 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:22.550360    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5" event={"ID":"710cab43-d10f-4aa3-af4c-0eecab1218b7","Type":"ContainerStarted","Data":"1b1d065a688cf368acb1b42d539832fcd80e58a3e7611bfb348d58b19eb56e14"}
Sep 09 23:08:22.552710 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:22.552685    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dzlv2" event={"ID":"ccdd862f-4d28-40b9-a758-97289f68ee44","Type":"ContainerStarted","Data":"918c69910ad484166fb31543076cd0544c09fc215a12d20d83eb38a91a6ef8fc"}
Sep 09 23:08:22.570799 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:22.570747    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dzlv2" podStartSLOduration=33.524264901 podStartE2EDuration="35.570727052s" totalImagesPullingTime="2.046462151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:07:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:22.56990984 +0000 UTC m=+287.352950239" watchObservedRunningTime="2026-09-09 23:08:22.570727052 +0000 UTC m=+287.353767439"
Sep 09 23:08:24.051992 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:24.051969    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:24.230133 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:24.230051    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:24.561489 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:24.561393    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v4q9p" event={"ID":"bd1fe099-faf9-4290-a81b-824f9630f31c","Type":"ContainerStarted","Data":"12bf0cd99a8fbfd711cd8365225e3030cb9e474bd0caf235fd8c84f2164b86ef"}
Sep 09 23:08:24.561489 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:24.561455    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v4q9p" event={"ID":"bd1fe099-faf9-4290-a81b-824f9630f31c","Type":"ContainerStarted","Data":"fb341356e5cafd4f680bbea7209ae4505ea0ea632cc0e7ea3cbc56453c51af02"}
Sep 09 23:08:24.561699 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:24.561498    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:08:24.563188 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:24.563160    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5" event={"ID":"710cab43-d10f-4aa3-af4c-0eecab1218b7","Type":"ContainerStarted","Data":"10dd6ab52df225c02880515ad3d45cc820a8cbca80e77840ccd44013335264fb"}
Sep 09 23:08:24.563298 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:24.563219    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5" event={"ID":"710cab43-d10f-4aa3-af4c-0eecab1218b7","Type":"ContainerStarted","Data":"3b8c8e6baffe623da7c9098d6ea586e09f9490e128992c9089efbbd7bf3cfce5"}
Sep 09 23:08:24.564587 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:24.564567    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x" event={"ID":"31ee7939-0118-47d2-8a82-21f99709bf37","Type":"ContainerStarted","Data":"0411103ccbe444e278e0eb9b77ee3cb678d54a57a9cf296b7504331ff14472d3"}
Sep 09 23:08:24.578674 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:24.578621    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v4q9p" podStartSLOduration=251.440965621 podStartE2EDuration="4m13.57860772s" totalImagesPullingTime="2.137642099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:24.577273645 +0000 UTC m=+289.360314040" watchObservedRunningTime="2026-09-09 23:08:24.57860772 +0000 UTC m=+289.361648102"
Sep 09 23:08:24.592882 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:24.592834    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-2rs4x" podStartSLOduration=278.449949052 podStartE2EDuration="4m40.592819617s" totalImagesPullingTime="2.142870565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:24.592283068 +0000 UTC m=+289.375323453" watchObservedRunningTime="2026-09-09 23:08:24.592819617 +0000 UTC m=+289.375860001"
Sep 09 23:08:24.612802 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:24.612760    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-czkr5" podStartSLOduration=2.051391727 podStartE2EDuration="3.61274524s" totalImagesPullingTime="1.561353513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:24.612474121 +0000 UTC m=+289.395514498" watchObservedRunningTime="2026-09-09 23:08:24.61274524 +0000 UTC m=+289.395785623"
Sep 09 23:08:24.703124 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:24.703092    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:24.766129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:24.766094    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:25.823544 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:25.823514    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:26.016772 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.016722    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:26.073018 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.072991    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"]
Sep 09 23:08:26.076391 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.076322    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.079389 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.079369    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 09 23:08:26.079491 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.079387    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 09 23:08:26.079788 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.079763    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 09 23:08:26.080549 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.080534    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hblvk\""
Sep 09 23:08:26.091215 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.091196    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-588f5"]
Sep 09 23:08:26.094530 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.094508    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"]
Sep 09 23:08:26.094641 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.094626    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.097473 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.097453    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 23:08:26.097631 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.097609    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dg28d\""
Sep 09 23:08:26.097743 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.097542    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 23:08:26.097805 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.097454    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 23:08:26.127235 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.127203    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:26.226856 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.226825    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:26.230897 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.230871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6m8m\" (UniqueName: \"kubernetes.io/projected/eae5ea0f-bf18-4270-bf88-4564d3876dfd-kube-api-access-v6m8m\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.230989 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.230910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-tls\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.230989 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.230936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.230989 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.230977    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eae5ea0f-bf18-4270-bf88-4564d3876dfd-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.231090 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.231027    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-root\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.231090 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.231069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-textfile\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.231151 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.231088    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eae5ea0f-bf18-4270-bf88-4564d3876dfd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.231151 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.231109    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-wtmp\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.231151 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.231124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/eae5ea0f-bf18-4270-bf88-4564d3876dfd-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.231238 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.231168    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-sys\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.231238 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.231198    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-metrics-client-ca\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.231303 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.231253    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/eae5ea0f-bf18-4270-bf88-4564d3876dfd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.231303 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.231288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh4rg\" (UniqueName: \"kubernetes.io/projected/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-kube-api-access-hh4rg\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.231387 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.231336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eae5ea0f-bf18-4270-bf88-4564d3876dfd-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.231425 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.231396    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-accelerators-collector-config\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.326663 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.326572    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:26.332675 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.332653    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-accelerators-collector-config\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.332755 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.332681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6m8m\" (UniqueName: \"kubernetes.io/projected/eae5ea0f-bf18-4270-bf88-4564d3876dfd-kube-api-access-v6m8m\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.332755 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.332703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-tls\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.332755 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.332723    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.332887 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.332775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eae5ea0f-bf18-4270-bf88-4564d3876dfd-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.332887 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.332806    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-root\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.332887 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:08:26.332831    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 09 23:08:26.332887 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.332844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-textfile\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.333064 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:08:26.332893    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-tls podName:a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f nodeName:}" failed. No retries permitted until 2026-09-09 23:08:26.832873593 +0000 UTC m=+291.615913964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-tls") pod "node-exporter-588f5" (UID: "a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f") : secret "node-exporter-tls" not found
Sep 09 23:08:26.333064 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.332912    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-root\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.333064 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.332965    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eae5ea0f-bf18-4270-bf88-4564d3876dfd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.333064 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.333000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-wtmp\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.333064 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.333035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/eae5ea0f-bf18-4270-bf88-4564d3876dfd-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.333322 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.333081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-sys\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.333322 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.333112    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-textfile\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.333322 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.333117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-metrics-client-ca\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.333322 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.333161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/eae5ea0f-bf18-4270-bf88-4564d3876dfd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.333322 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.333194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh4rg\" (UniqueName: \"kubernetes.io/projected/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-kube-api-access-hh4rg\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.333322 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.333249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eae5ea0f-bf18-4270-bf88-4564d3876dfd-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.333618 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.333373    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-accelerators-collector-config\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.333618 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.333428    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-sys\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.333618 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.333460    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/eae5ea0f-bf18-4270-bf88-4564d3876dfd-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.333747 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.333630    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eae5ea0f-bf18-4270-bf88-4564d3876dfd-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.333747 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.333653    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-wtmp\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.333880 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.333848    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-metrics-client-ca\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.334040 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.334003    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/eae5ea0f-bf18-4270-bf88-4564d3876dfd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.335652 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.335624    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eae5ea0f-bf18-4270-bf88-4564d3876dfd-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.335739 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.335687    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.335820 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.335803    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eae5ea0f-bf18-4270-bf88-4564d3876dfd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.341809 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.341788    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6m8m\" (UniqueName: \"kubernetes.io/projected/eae5ea0f-bf18-4270-bf88-4564d3876dfd-kube-api-access-v6m8m\") pod \"kube-state-metrics-74cb57df7-8zbnp\" (UID: \"eae5ea0f-bf18-4270-bf88-4564d3876dfd\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.341809 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.341804    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh4rg\" (UniqueName: \"kubernetes.io/projected/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-kube-api-access-hh4rg\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.388460 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.388437    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"
Sep 09 23:08:26.427847 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.427812    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:26.528888 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.528851    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:26.631198 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.631167    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:26.663221 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.663185    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp"]
Sep 09 23:08:26.665958 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:08:26.665934    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae5ea0f_bf18_4270_bf88_4564d3876dfd.slice/crio-c9934ef6741b45719ea956f00de7163602548b958b565b1e01321b738c1d4130 WatchSource:0}: Error finding container c9934ef6741b45719ea956f00de7163602548b958b565b1e01321b738c1d4130: Status 404 returned error can't find the container with id c9934ef6741b45719ea956f00de7163602548b958b565b1e01321b738c1d4130
Sep 09 23:08:26.838033 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.837997    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-tls\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:26.840221 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:26.840200    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f-node-exporter-tls\") pod \"node-exporter-588f5\" (UID: \"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f\") " pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:27.006598 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:27.005926    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-588f5"
Sep 09 23:08:27.018956 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:08:27.018933    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4aa34dc_e7b3_450b_b3ee_ee24d6f3300f.slice/crio-448554cef5f350591cce38a7976d6d4f33f71b48a468318905a34cad53d64335 WatchSource:0}: Error finding container 448554cef5f350591cce38a7976d6d4f33f71b48a468318905a34cad53d64335: Status 404 returned error can't find the container with id 448554cef5f350591cce38a7976d6d4f33f71b48a468318905a34cad53d64335
Sep 09 23:08:27.034320 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:27.034297    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:27.103827 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:27.103802    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:27.363226 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:27.363151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:27.576478 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:27.576445    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp" event={"ID":"eae5ea0f-bf18-4270-bf88-4564d3876dfd","Type":"ContainerStarted","Data":"c9934ef6741b45719ea956f00de7163602548b958b565b1e01321b738c1d4130"}
Sep 09 23:08:27.577687 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:27.577662    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-588f5" event={"ID":"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f","Type":"ContainerStarted","Data":"448554cef5f350591cce38a7976d6d4f33f71b48a468318905a34cad53d64335"}
Sep 09 23:08:27.670247 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:27.670208    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:28.587408 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:28.587372    2562 generic.go:356] "Generic (PLEG): container finished" podID="a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f" containerID="31c39a4f125aa48bbd40a95b6b622d181de909592df63284e32f7bcdfc0670be" exitCode=0
Sep 09 23:08:28.587822 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:28.587445    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-588f5" event={"ID":"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f","Type":"ContainerDied","Data":"31c39a4f125aa48bbd40a95b6b622d181de909592df63284e32f7bcdfc0670be"}
Sep 09 23:08:28.589807 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:28.589784    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp" event={"ID":"eae5ea0f-bf18-4270-bf88-4564d3876dfd","Type":"ContainerStarted","Data":"734038de4410ac29676739d6ad4ca1cb3615457a2ad747dc168f077827917dd6"}
Sep 09 23:08:28.589909 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:28.589850    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp" event={"ID":"eae5ea0f-bf18-4270-bf88-4564d3876dfd","Type":"ContainerStarted","Data":"ae9fb745bf08a498b3969dfba3975ca3e87ebb4c2b2c624d39cae5d8aedddac2"}
Sep 09 23:08:28.718316 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:08:28.718279    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dwb45" podUID="c31b5254-ff30-4381-bcbd-d09e9d6fd177"
Sep 09 23:08:29.040489 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:29.040407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:29.140126 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:29.140094    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:29.240853 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:29.240825    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:29.595858 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:29.595824    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-588f5" event={"ID":"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f","Type":"ContainerStarted","Data":"b3695371b30d25c812193b5b9f1963a8531b8d73ffe005b8cf375c18f7a817d8"}
Sep 09 23:08:29.596279 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:29.595888    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-588f5" event={"ID":"a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f","Type":"ContainerStarted","Data":"d19d9a8e86ffe1e96e7b112442d123e282e8c38edc6e437ca6e6598fe6e0c787"}
Sep 09 23:08:29.597831 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:29.597801    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp" event={"ID":"eae5ea0f-bf18-4270-bf88-4564d3876dfd","Type":"ContainerStarted","Data":"51867b3574dfdf589613ec10bf010ab721e192099efd8881d9096c96f578d6e5"}
Sep 09 23:08:29.616092 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:29.616052    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-588f5" podStartSLOduration=2.166440383 podStartE2EDuration="3.616037289s" totalImagesPullingTime="1.373224379s" totalInitContainerRuntime="76.372527ms" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:29.614824659 +0000 UTC m=+294.397865043" watchObservedRunningTime="2026-09-09 23:08:29.616037289 +0000 UTC m=+294.399077672"
Sep 09 23:08:29.632001 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:29.631964    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-8zbnp" podStartSLOduration=1.907920566 podStartE2EDuration="3.63195022s" totalImagesPullingTime="1.724029654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:29.631418325 +0000 UTC m=+294.414458713" watchObservedRunningTime="2026-09-09 23:08:29.63195022 +0000 UTC m=+294.414990603"
Sep 09 23:08:30.547229 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.547193    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5455c87ddc-thckm"]
Sep 09 23:08:30.550315 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.550295    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.554601 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.554575    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 23:08:30.554601 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.554599    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 09 23:08:30.554770 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.554619    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 09 23:08:30.554770 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.554627    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pkmcd\""
Sep 09 23:08:30.554770 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.554627    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 09 23:08:30.554770 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.554597    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-aubl4ibplt89m\""
Sep 09 23:08:30.561203 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.561185    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5455c87ddc-thckm"]
Sep 09 23:08:30.671714 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.671682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b56b7c45-7fa7-409a-8934-614719953032-metrics-server-audit-profiles\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.671714 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.671720    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b56b7c45-7fa7-409a-8934-614719953032-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.672073 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.671742    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b56b7c45-7fa7-409a-8934-614719953032-secret-metrics-server-tls\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.672073 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.671767    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b56b7c45-7fa7-409a-8934-614719953032-audit-log\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.672073 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.671836    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k7lb\" (UniqueName: \"kubernetes.io/projected/b56b7c45-7fa7-409a-8934-614719953032-kube-api-access-4k7lb\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.672073 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.671876    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b56b7c45-7fa7-409a-8934-614719953032-secret-metrics-server-client-certs\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.672073 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.671958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b56b7c45-7fa7-409a-8934-614719953032-client-ca-bundle\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.773158 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.773126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k7lb\" (UniqueName: \"kubernetes.io/projected/b56b7c45-7fa7-409a-8934-614719953032-kube-api-access-4k7lb\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.773381 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.773181    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b56b7c45-7fa7-409a-8934-614719953032-secret-metrics-server-client-certs\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.773628 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.773601    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b56b7c45-7fa7-409a-8934-614719953032-client-ca-bundle\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.773944 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.773904    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b56b7c45-7fa7-409a-8934-614719953032-metrics-server-audit-profiles\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.774110 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.774079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b56b7c45-7fa7-409a-8934-614719953032-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.774225 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.774135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b56b7c45-7fa7-409a-8934-614719953032-secret-metrics-server-tls\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.774225 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.774162    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b56b7c45-7fa7-409a-8934-614719953032-audit-log\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.774634 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.774615    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b56b7c45-7fa7-409a-8934-614719953032-audit-log\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.775280 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.775254    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b56b7c45-7fa7-409a-8934-614719953032-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.775438 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.775420    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b56b7c45-7fa7-409a-8934-614719953032-metrics-server-audit-profiles\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.775910 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.775890    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b56b7c45-7fa7-409a-8934-614719953032-secret-metrics-server-client-certs\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.777024 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.776999    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b56b7c45-7fa7-409a-8934-614719953032-client-ca-bundle\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.777189 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.777170    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b56b7c45-7fa7-409a-8934-614719953032-secret-metrics-server-tls\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.781196 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.781171    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k7lb\" (UniqueName: \"kubernetes.io/projected/b56b7c45-7fa7-409a-8934-614719953032-kube-api-access-4k7lb\") pod \"metrics-server-5455c87ddc-thckm\" (UID: \"b56b7c45-7fa7-409a-8934-614719953032\") " pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.794568 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.794540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:30.807035 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.806969    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn"]
Sep 09 23:08:30.811057 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.811039    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn"
Sep 09 23:08:30.813752 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.813732    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hk4g8\""
Sep 09 23:08:30.813848 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.813786    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 09 23:08:30.818578 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.818559    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn"]
Sep 09 23:08:30.859506 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.859481    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:30.901372 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.901330    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:30.976861 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.976825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b144d33e-1109-4b2b-9f9b-016913916e84-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-xt4fn\" (UID: \"b144d33e-1109-4b2b-9f9b-016913916e84\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn"
Sep 09 23:08:30.976999 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:30.976928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvwxz\" (UniqueName: \"kubernetes.io/projected/b144d33e-1109-4b2b-9f9b-016913916e84-kube-api-access-pvwxz\") pod \"monitoring-plugin-85bbbbbf4-xt4fn\" (UID: \"b144d33e-1109-4b2b-9f9b-016913916e84\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn"
Sep 09 23:08:31.078047 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:31.077975    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvwxz\" (UniqueName: \"kubernetes.io/projected/b144d33e-1109-4b2b-9f9b-016913916e84-kube-api-access-pvwxz\") pod \"monitoring-plugin-85bbbbbf4-xt4fn\" (UID: \"b144d33e-1109-4b2b-9f9b-016913916e84\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn"
Sep 09 23:08:31.078047 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:31.078023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b144d33e-1109-4b2b-9f9b-016913916e84-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-xt4fn\" (UID: \"b144d33e-1109-4b2b-9f9b-016913916e84\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn"
Sep 09 23:08:31.078188 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:08:31.078120    2562 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 09 23:08:31.078188 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:08:31.078170    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b144d33e-1109-4b2b-9f9b-016913916e84-monitoring-plugin-cert podName:b144d33e-1109-4b2b-9f9b-016913916e84 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:31.578156128 +0000 UTC m=+296.361196491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b144d33e-1109-4b2b-9f9b-016913916e84-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-xt4fn" (UID: "b144d33e-1109-4b2b-9f9b-016913916e84") : secret "monitoring-plugin-cert" not found
Sep 09 23:08:31.086511 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:31.086489    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvwxz\" (UniqueName: \"kubernetes.io/projected/b144d33e-1109-4b2b-9f9b-016913916e84-kube-api-access-pvwxz\") pod \"monitoring-plugin-85bbbbbf4-xt4fn\" (UID: \"b144d33e-1109-4b2b-9f9b-016913916e84\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn"
Sep 09 23:08:31.134699 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:31.134675    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5455c87ddc-thckm"]
Sep 09 23:08:31.137830 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:08:31.137806    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb56b7c45_7fa7_409a_8934_614719953032.slice/crio-2e8a66d9fe9fa74265826786dac56523219c704857ac02cbc65fd4a75c37cb5d WatchSource:0}: Error finding container 2e8a66d9fe9fa74265826786dac56523219c704857ac02cbc65fd4a75c37cb5d: Status 404 returned error can't find the container with id 2e8a66d9fe9fa74265826786dac56523219c704857ac02cbc65fd4a75c37cb5d
Sep 09 23:08:31.415813 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:31.415780    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:31.583237 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:31.583202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b144d33e-1109-4b2b-9f9b-016913916e84-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-xt4fn\" (UID: \"b144d33e-1109-4b2b-9f9b-016913916e84\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn"
Sep 09 23:08:31.585560 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:31.585537    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b144d33e-1109-4b2b-9f9b-016913916e84-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-xt4fn\" (UID: \"b144d33e-1109-4b2b-9f9b-016913916e84\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn"
Sep 09 23:08:31.605438 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:31.605412    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5455c87ddc-thckm" event={"ID":"b56b7c45-7fa7-409a-8934-614719953032","Type":"ContainerStarted","Data":"2e8a66d9fe9fa74265826786dac56523219c704857ac02cbc65fd4a75c37cb5d"}
Sep 09 23:08:31.724314 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:31.724242    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn"
Sep 09 23:08:32.013822 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.013531    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn"]
Sep 09 23:08:32.020711 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:08:32.020680    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb144d33e_1109_4b2b_9f9b_016913916e84.slice/crio-3a576cfbbe651b370895657c62d2d2193b1881a37ddf7b836a2ea9f386835ce5 WatchSource:0}: Error finding container 3a576cfbbe651b370895657c62d2d2193b1881a37ddf7b836a2ea9f386835ce5: Status 404 returned error can't find the container with id 3a576cfbbe651b370895657c62d2d2193b1881a37ddf7b836a2ea9f386835ce5
Sep 09 23:08:32.294930 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.294845    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:32.303458 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.303430    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:08:32.307924 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.307900    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.311313 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.311193    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 09 23:08:32.311313 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.311269    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bqpbq\""
Sep 09 23:08:32.311313 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.311306    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 09 23:08:32.311556 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.311447    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 09 23:08:32.311613 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.311563    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 09 23:08:32.312924 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.312730    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 09 23:08:32.312924 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.312757    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 09 23:08:32.312924 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.312780    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 09 23:08:32.312924 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.312790    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 09 23:08:32.312924 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.312832    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 09 23:08:32.313253 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.313096    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 09 23:08:32.313253 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.313170    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 09 23:08:32.313253 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.313227    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 09 23:08:32.313644 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.313629    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e5s4ivbkqpb5o\""
Sep 09 23:08:32.315302 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.315281    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 09 23:08:32.318401 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.318289    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 09 23:08:32.322979 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.322955    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:08:32.491361 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c669e5f-a92a-495d-adae-079b488c6863-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.491529 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491389    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.491529 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491446    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.491529 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.491529 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.491698 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491554    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-config\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.491698 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.491698 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.491698 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491681    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2lqg\" (UniqueName: \"kubernetes.io/projected/1c669e5f-a92a-495d-adae-079b488c6863-kube-api-access-l2lqg\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.491861 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491708    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.491861 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491730    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.491861 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.491861 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.491861 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.491861 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491856    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.492107 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.492107 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.492107 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491931    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.492107 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491959    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-web-config\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.492107 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.491994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c669e5f-a92a-495d-adae-079b488c6863-config-out\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.592885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.592936    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-web-config\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.592969    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c669e5f-a92a-495d-adae-079b488c6863-config-out\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c669e5f-a92a-495d-adae-079b488c6863-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593040    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593065    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593121    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593146    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-config\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593178    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593207    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2lqg\" (UniqueName: \"kubernetes.io/projected/1c669e5f-a92a-495d-adae-079b488c6863-kube-api-access-l2lqg\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593290    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593367    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.593668 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593389    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.594574 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.594574 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593444    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.594574 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.593505    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.594725 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.594703    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.595927 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.595896    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.596468 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.596441    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.596745 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.596722    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.597517 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.597218    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.598446 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.597957    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-web-config\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.598446 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.597963    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.598446 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.598302    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.598446 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.598410    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.598712 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.598556    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.599000 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.598947    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c669e5f-a92a-495d-adae-079b488c6863-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.599186 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.599162    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.599851 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.599413    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c669e5f-a92a-495d-adae-079b488c6863-config-out\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.599851 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.599814    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.600544 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.600504    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.600960 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.600934    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.601584 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.601561    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.601691 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.601671    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.602457 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.602335    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-config\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.605173 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.605150    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2lqg\" (UniqueName: \"kubernetes.io/projected/1c669e5f-a92a-495d-adae-079b488c6863-kube-api-access-l2lqg\") pod \"prometheus-k8s-0\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:32.612171 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.612146    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn" event={"ID":"b144d33e-1109-4b2b-9f9b-016913916e84","Type":"ContainerStarted","Data":"3a576cfbbe651b370895657c62d2d2193b1881a37ddf7b836a2ea9f386835ce5"}
Sep 09 23:08:32.622447 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:32.622427    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:33.049174 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:33.049150    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:08:33.051411 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:08:33.051382    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c669e5f_a92a_495d_adae_079b488c6863.slice/crio-0c8f2c2c22158c89eb17712eeb8e8a446f808900b074f8d4fe557600313582c1 WatchSource:0}: Error finding container 0c8f2c2c22158c89eb17712eeb8e8a446f808900b074f8d4fe557600313582c1: Status 404 returned error can't find the container with id 0c8f2c2c22158c89eb17712eeb8e8a446f808900b074f8d4fe557600313582c1
Sep 09 23:08:33.618835 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:33.618770    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c669e5f-a92a-495d-adae-079b488c6863","Type":"ContainerStarted","Data":"0c8f2c2c22158c89eb17712eeb8e8a446f808900b074f8d4fe557600313582c1"}
Sep 09 23:08:33.620969 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:33.620942    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5455c87ddc-thckm" event={"ID":"b56b7c45-7fa7-409a-8934-614719953032","Type":"ContainerStarted","Data":"37e1a54c8d338ca6726e1432dcba9a5d405fb068401749191d85cf36b2e8e6ed"}
Sep 09 23:08:33.638248 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:33.638202    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5455c87ddc-thckm" podStartSLOduration=1.9578776599999999 podStartE2EDuration="3.638186241s" totalImagesPullingTime="1.680308581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:33.63601021 +0000 UTC m=+298.419050599" watchObservedRunningTime="2026-09-09 23:08:33.638186241 +0000 UTC m=+298.421226679"
Sep 09 23:08:34.309538 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:34.309502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:34.360017 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:34.359987    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:34.571055 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:34.570979    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v4q9p"
Sep 09 23:08:34.626181 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:34.626145    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn" event={"ID":"b144d33e-1109-4b2b-9f9b-016913916e84","Type":"ContainerStarted","Data":"4b088fce07c6e06c792abcb540c6a66f13e97976ac9f75124b9d1d80fba6d93b"}
Sep 09 23:08:34.626365 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:34.626210    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn"
Sep 09 23:08:34.627853 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:34.627824    2562 generic.go:356] "Generic (PLEG): container finished" podID="1c669e5f-a92a-495d-adae-079b488c6863" containerID="d5f3ddf54f3665817c2b83d125fb83e895d6cd8c29e169bbba792445cc4e7461" exitCode=0
Sep 09 23:08:34.627970 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:34.627908    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c669e5f-a92a-495d-adae-079b488c6863","Type":"ContainerDied","Data":"d5f3ddf54f3665817c2b83d125fb83e895d6cd8c29e169bbba792445cc4e7461"}
Sep 09 23:08:34.631411 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:34.631392    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn"
Sep 09 23:08:34.642106 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:34.642070    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xt4fn" podStartSLOduration=2.469231282 podStartE2EDuration="4.642054887s" totalImagesPullingTime="2.172823605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:34.641381867 +0000 UTC m=+299.424422245" watchObservedRunningTime="2026-09-09 23:08:34.642054887 +0000 UTC m=+299.425095271"
Sep 09 23:08:35.523808 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:35.523771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:35.624047 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:35.624021    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:35.626929 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:35.626910    2562 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 23:08:35.726974 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:35.726797    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:36.827909 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:36.827879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:36.928075 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:36.928040    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:38.071403 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:38.071369    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:38.268724 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:38.268701    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:08:38.644455 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:38.644417    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c669e5f-a92a-495d-adae-079b488c6863","Type":"ContainerStarted","Data":"b414d3e0e3bf62732c1312324b7a18519b407654c672233b8d0e50cff611c74e"}
Sep 09 23:08:38.644594 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:38.644479    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c669e5f-a92a-495d-adae-079b488c6863","Type":"ContainerStarted","Data":"3fafa11ea2b6f2af70c91f768757682970f90472ab0cf310debe8cc4c2d3afc1"}
Sep 09 23:08:39.281645 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:39.281600    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:40.655971 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:40.655938    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c669e5f-a92a-495d-adae-079b488c6863","Type":"ContainerStarted","Data":"eaddf9f110c41fece0a1f6e0978b13a31c1862ef6166fdc7f5ed5d5cc37aa31d"}
Sep 09 23:08:40.656320 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:40.656022    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c669e5f-a92a-495d-adae-079b488c6863","Type":"ContainerStarted","Data":"5ac5b04535f6583cefca5a913322ac94eefceb51838347215876e09dc886ccea"}
Sep 09 23:08:40.656320 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:40.656050    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c669e5f-a92a-495d-adae-079b488c6863","Type":"ContainerStarted","Data":"4b5ab38f2410dcb84035034e54e87fd1cf1b20b40192dba2968a7346de6cf9d5"}
Sep 09 23:08:40.656320 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:40.656081    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c669e5f-a92a-495d-adae-079b488c6863","Type":"ContainerStarted","Data":"ec22bad2ded593d21c48346f3627a55166e9679f04be85322f60b05dd2efc267"}
Sep 09 23:08:40.684192 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:40.684132    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.169058783 podStartE2EDuration="8.684113259s" totalImagesPullingTime="6.488247768s" totalInitContainerRuntime="26.806708ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:40.682198443 +0000 UTC m=+305.465238825" watchObservedRunningTime="2026-09-09 23:08:40.684113259 +0000 UTC m=+305.467153646"
Sep 09 23:08:40.717164 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:40.717136    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:08:41.125420 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:41.125380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:41.138917 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:41.138879    2562 patch_prober.go:28] interesting pod/image-registry-7878fd6c5b-ffwd9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 23:08:41.139032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:41.138930    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9" podUID="0fb09c39-00c7-4de0-bdbe-35cadac25075" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 23:08:41.225998 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:41.225972    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:42.556955 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:42.556925    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:08:42.622891 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:42.622865    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:08:42.773900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:42.773863    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7878fd6c5b-ffwd9"]
Sep 09 23:08:42.847544 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:42.847470    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:42.948328 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:42.948299    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:43.224515 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:43.224481    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:43.324821 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:43.324788    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:43.680979 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:43.680949    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:43.781725 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:43.781691    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:44.195266 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:44.195233    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:44.290898 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:44.290865    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:44.350654 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:44.350623    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:44.786287 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:44.786255    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:44.852159 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:44.852135    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:46.105838 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:46.105806    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:46.153215 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:46.153188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:50.859602 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:50.859565    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:50.859953 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:50.859627    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:08:53.864124 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:53.864090    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:53.928440 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:53.928395    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:56.717451 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:56.717417    2562 generic.go:356] "Generic (PLEG): container finished" podID="aa82f387-b993-4bc4-ace1-41bccc668560" containerID="78896ae82f574875b5839ca0f61d66fac6df7b12d24ec16dad07bb3996a7e32b" exitCode=0
Sep 09 23:08:56.717819 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:56.717493    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l" event={"ID":"aa82f387-b993-4bc4-ace1-41bccc668560","Type":"ContainerDied","Data":"78896ae82f574875b5839ca0f61d66fac6df7b12d24ec16dad07bb3996a7e32b"}
Sep 09 23:08:56.717863 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:56.717840    2562 scope.go:117] "RemoveContainer" containerID="78896ae82f574875b5839ca0f61d66fac6df7b12d24ec16dad07bb3996a7e32b"
Sep 09 23:08:57.090937 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:57.090849    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:57.142971 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:57.142937    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:57.344474 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:57.344381    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:57.443394 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:57.443364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:08:57.722471 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:08:57.722439    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-kxh8l" event={"ID":"aa82f387-b993-4bc4-ace1-41bccc668560","Type":"ContainerStarted","Data":"3b018d9649a30c01d03d6687591c547778a0561df31892c06d4ff892010569a9"}
Sep 09 23:09:07.793278 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:07.793209    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9" podUID="0fb09c39-00c7-4de0-bdbe-35cadac25075" containerName="registry" containerID="cri-o://1f98c74175a51fb1ec71c66ac6f47c40d42fb58814706e86f8712f4e0e93ddb0" gracePeriod=30
Sep 09 23:09:08.035159 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.035136    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:09:08.098482 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.098394    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-certificates\") pod \"0fb09c39-00c7-4de0-bdbe-35cadac25075\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") "
Sep 09 23:09:08.098482 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.098430    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0fb09c39-00c7-4de0-bdbe-35cadac25075-installation-pull-secrets\") pod \"0fb09c39-00c7-4de0-bdbe-35cadac25075\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") "
Sep 09 23:09:08.098482 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.098452    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-bound-sa-token\") pod \"0fb09c39-00c7-4de0-bdbe-35cadac25075\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") "
Sep 09 23:09:08.098482 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.098468    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls\") pod \"0fb09c39-00c7-4de0-bdbe-35cadac25075\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") "
Sep 09 23:09:08.098799 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.098492    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0fb09c39-00c7-4de0-bdbe-35cadac25075-ca-trust-extracted\") pod \"0fb09c39-00c7-4de0-bdbe-35cadac25075\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") "
Sep 09 23:09:08.098799 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.098522    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh48n\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-kube-api-access-bh48n\") pod \"0fb09c39-00c7-4de0-bdbe-35cadac25075\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") "
Sep 09 23:09:08.098799 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.098557    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0fb09c39-00c7-4de0-bdbe-35cadac25075-image-registry-private-configuration\") pod \"0fb09c39-00c7-4de0-bdbe-35cadac25075\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") "
Sep 09 23:09:08.098799 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.098648    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0fb09c39-00c7-4de0-bdbe-35cadac25075-trusted-ca\") pod \"0fb09c39-00c7-4de0-bdbe-35cadac25075\" (UID: \"0fb09c39-00c7-4de0-bdbe-35cadac25075\") "
Sep 09 23:09:08.099045 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.098886    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0fb09c39-00c7-4de0-bdbe-35cadac25075" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:09:08.099608 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.099581    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fb09c39-00c7-4de0-bdbe-35cadac25075-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0fb09c39-00c7-4de0-bdbe-35cadac25075" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:09:08.101217 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.101155    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0fb09c39-00c7-4de0-bdbe-35cadac25075-trusted-ca\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:08.101217 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.101183    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-certificates\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:08.101415 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.101395    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0fb09c39-00c7-4de0-bdbe-35cadac25075" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:09:08.101553 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.101527    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fb09c39-00c7-4de0-bdbe-35cadac25075-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0fb09c39-00c7-4de0-bdbe-35cadac25075" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:09:08.101615 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.101584    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-kube-api-access-bh48n" (OuterVolumeSpecName: "kube-api-access-bh48n") pod "0fb09c39-00c7-4de0-bdbe-35cadac25075" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075"). InnerVolumeSpecName "kube-api-access-bh48n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:09:08.101659 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.101616    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fb09c39-00c7-4de0-bdbe-35cadac25075-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0fb09c39-00c7-4de0-bdbe-35cadac25075" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:09:08.101695 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.101677    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0fb09c39-00c7-4de0-bdbe-35cadac25075" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:09:08.107693 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.107668    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fb09c39-00c7-4de0-bdbe-35cadac25075-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0fb09c39-00c7-4de0-bdbe-35cadac25075" (UID: "0fb09c39-00c7-4de0-bdbe-35cadac25075"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:09:08.202369 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.202316    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0fb09c39-00c7-4de0-bdbe-35cadac25075-installation-pull-secrets\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:08.202527 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.202388    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-bound-sa-token\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:08.202527 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.202405    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-registry-tls\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:08.202527 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.202418    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0fb09c39-00c7-4de0-bdbe-35cadac25075-ca-trust-extracted\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:08.202527 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.202432    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh48n\" (UniqueName: \"kubernetes.io/projected/0fb09c39-00c7-4de0-bdbe-35cadac25075-kube-api-access-bh48n\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:08.202527 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.202446    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0fb09c39-00c7-4de0-bdbe-35cadac25075-image-registry-private-configuration\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:08.761660 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.761626    2562 generic.go:356] "Generic (PLEG): container finished" podID="0fb09c39-00c7-4de0-bdbe-35cadac25075" containerID="1f98c74175a51fb1ec71c66ac6f47c40d42fb58814706e86f8712f4e0e93ddb0" exitCode=0
Sep 09 23:09:08.761856 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.761676    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9"
Sep 09 23:09:08.761856 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.761721    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9" event={"ID":"0fb09c39-00c7-4de0-bdbe-35cadac25075","Type":"ContainerDied","Data":"1f98c74175a51fb1ec71c66ac6f47c40d42fb58814706e86f8712f4e0e93ddb0"}
Sep 09 23:09:08.761856 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.761777    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7878fd6c5b-ffwd9" event={"ID":"0fb09c39-00c7-4de0-bdbe-35cadac25075","Type":"ContainerDied","Data":"8add120f2edf61c9735fee547450727ee5bc497bd96c897d2a716f80f2c17dc6"}
Sep 09 23:09:08.761856 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.761817    2562 scope.go:117] "RemoveContainer" containerID="1f98c74175a51fb1ec71c66ac6f47c40d42fb58814706e86f8712f4e0e93ddb0"
Sep 09 23:09:08.771752 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.771703    2562 scope.go:117] "RemoveContainer" containerID="1f98c74175a51fb1ec71c66ac6f47c40d42fb58814706e86f8712f4e0e93ddb0"
Sep 09 23:09:08.773670 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:09:08.773640    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f98c74175a51fb1ec71c66ac6f47c40d42fb58814706e86f8712f4e0e93ddb0\": container with ID starting with 1f98c74175a51fb1ec71c66ac6f47c40d42fb58814706e86f8712f4e0e93ddb0 not found: ID does not exist" containerID="1f98c74175a51fb1ec71c66ac6f47c40d42fb58814706e86f8712f4e0e93ddb0"
Sep 09 23:09:08.773772 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.773679    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f98c74175a51fb1ec71c66ac6f47c40d42fb58814706e86f8712f4e0e93ddb0"} err="failed to get container status \"1f98c74175a51fb1ec71c66ac6f47c40d42fb58814706e86f8712f4e0e93ddb0\": rpc error: code = NotFound desc = could not find container \"1f98c74175a51fb1ec71c66ac6f47c40d42fb58814706e86f8712f4e0e93ddb0\": container with ID starting with 1f98c74175a51fb1ec71c66ac6f47c40d42fb58814706e86f8712f4e0e93ddb0 not found: ID does not exist"
Sep 09 23:09:08.786766 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.786738    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7878fd6c5b-ffwd9"]
Sep 09 23:09:08.789480 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:08.789449    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7878fd6c5b-ffwd9"]
Sep 09 23:09:09.721687 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:09.721652    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fb09c39-00c7-4de0-bdbe-35cadac25075" path="/var/lib/kubelet/pods/0fb09c39-00c7-4de0-bdbe-35cadac25075/volumes"
Sep 09 23:09:10.865920 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:10.865894    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:09:10.869733 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:10.869708    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5455c87ddc-thckm"
Sep 09 23:09:11.159552 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:11.159522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:11.214381 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:11.214334    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:12.356758 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:12.356725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:12.408640 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:12.408603    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:18.722993 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:18.722953    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:18.777366 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:18.777311    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:32.623267 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:32.623234    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:32.639133 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:32.639101    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:32.874290 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:32.874223    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:45.288513 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:45.288477    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:45.530409 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:45.530377    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:49.566106 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:49.566061    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs\") pod \"network-metrics-daemon-dwb45\" (UID: \"c31b5254-ff30-4381-bcbd-d09e9d6fd177\") " pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:09:49.568326 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:49.568302    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c31b5254-ff30-4381-bcbd-d09e9d6fd177-metrics-certs\") pod \"network-metrics-daemon-dwb45\" (UID: \"c31b5254-ff30-4381-bcbd-d09e9d6fd177\") " pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:09:49.720420 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:49.720385    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-64srt\""
Sep 09 23:09:49.728253 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:49.728232    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dwb45"
Sep 09 23:09:50.000808 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.000762    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dwb45"]
Sep 09 23:09:50.003062 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:09:50.003032    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc31b5254_ff30_4381_bcbd_d09e9d6fd177.slice/crio-0f9cd8daa2c65965a24d4d9b3a674bc3a0c4e549f62caf2e71c14be27ddb4b0f WatchSource:0}: Error finding container 0f9cd8daa2c65965a24d4d9b3a674bc3a0c4e549f62caf2e71c14be27ddb4b0f: Status 404 returned error can't find the container with id 0f9cd8daa2c65965a24d4d9b3a674bc3a0c4e549f62caf2e71c14be27ddb4b0f
Sep 09 23:09:50.677375 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.677017    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:09:50.678271 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.677967    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="prometheus" containerID="cri-o://3fafa11ea2b6f2af70c91f768757682970f90472ab0cf310debe8cc4c2d3afc1" gracePeriod=600
Sep 09 23:09:50.678271 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.677984    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="thanos-sidecar" containerID="cri-o://ec22bad2ded593d21c48346f3627a55166e9679f04be85322f60b05dd2efc267" gracePeriod=600
Sep 09 23:09:50.678271 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.677970    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="kube-rbac-proxy" containerID="cri-o://5ac5b04535f6583cefca5a913322ac94eefceb51838347215876e09dc886ccea" gracePeriod=600
Sep 09 23:09:50.678271 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.678094    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="kube-rbac-proxy-thanos" containerID="cri-o://eaddf9f110c41fece0a1f6e0978b13a31c1862ef6166fdc7f5ed5d5cc37aa31d" gracePeriod=600
Sep 09 23:09:50.678271 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.678153    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="kube-rbac-proxy-web" containerID="cri-o://4b5ab38f2410dcb84035034e54e87fd1cf1b20b40192dba2968a7346de6cf9d5" gracePeriod=600
Sep 09 23:09:50.678271 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.678190    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="config-reloader" containerID="cri-o://b414d3e0e3bf62732c1312324b7a18519b407654c672233b8d0e50cff611c74e" gracePeriod=600
Sep 09 23:09:50.929636 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.929547    2562 generic.go:356] "Generic (PLEG): container finished" podID="1c669e5f-a92a-495d-adae-079b488c6863" containerID="eaddf9f110c41fece0a1f6e0978b13a31c1862ef6166fdc7f5ed5d5cc37aa31d" exitCode=0
Sep 09 23:09:50.929636 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.929578    2562 generic.go:356] "Generic (PLEG): container finished" podID="1c669e5f-a92a-495d-adae-079b488c6863" containerID="5ac5b04535f6583cefca5a913322ac94eefceb51838347215876e09dc886ccea" exitCode=0
Sep 09 23:09:50.929636 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.929589    2562 generic.go:356] "Generic (PLEG): container finished" podID="1c669e5f-a92a-495d-adae-079b488c6863" containerID="4b5ab38f2410dcb84035034e54e87fd1cf1b20b40192dba2968a7346de6cf9d5" exitCode=0
Sep 09 23:09:50.929636 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.929601    2562 generic.go:356] "Generic (PLEG): container finished" podID="1c669e5f-a92a-495d-adae-079b488c6863" containerID="ec22bad2ded593d21c48346f3627a55166e9679f04be85322f60b05dd2efc267" exitCode=0
Sep 09 23:09:50.929636 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.929578    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c669e5f-a92a-495d-adae-079b488c6863","Type":"ContainerDied","Data":"eaddf9f110c41fece0a1f6e0978b13a31c1862ef6166fdc7f5ed5d5cc37aa31d"}
Sep 09 23:09:50.929955 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.929685    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c669e5f-a92a-495d-adae-079b488c6863","Type":"ContainerDied","Data":"5ac5b04535f6583cefca5a913322ac94eefceb51838347215876e09dc886ccea"}
Sep 09 23:09:50.929955 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.929732    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c669e5f-a92a-495d-adae-079b488c6863","Type":"ContainerDied","Data":"4b5ab38f2410dcb84035034e54e87fd1cf1b20b40192dba2968a7346de6cf9d5"}
Sep 09 23:09:50.929955 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.929775    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c669e5f-a92a-495d-adae-079b488c6863","Type":"ContainerDied","Data":"ec22bad2ded593d21c48346f3627a55166e9679f04be85322f60b05dd2efc267"}
Sep 09 23:09:50.929955 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.929816    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c669e5f-a92a-495d-adae-079b488c6863","Type":"ContainerDied","Data":"b414d3e0e3bf62732c1312324b7a18519b407654c672233b8d0e50cff611c74e"}
Sep 09 23:09:50.929955 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.929609    2562 generic.go:356] "Generic (PLEG): container finished" podID="1c669e5f-a92a-495d-adae-079b488c6863" containerID="b414d3e0e3bf62732c1312324b7a18519b407654c672233b8d0e50cff611c74e" exitCode=0
Sep 09 23:09:50.929955 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.929866    2562 generic.go:356] "Generic (PLEG): container finished" podID="1c669e5f-a92a-495d-adae-079b488c6863" containerID="3fafa11ea2b6f2af70c91f768757682970f90472ab0cf310debe8cc4c2d3afc1" exitCode=0
Sep 09 23:09:50.929955 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.929939    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c669e5f-a92a-495d-adae-079b488c6863","Type":"ContainerDied","Data":"3fafa11ea2b6f2af70c91f768757682970f90472ab0cf310debe8cc4c2d3afc1"}
Sep 09 23:09:50.931478 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:50.931377    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dwb45" event={"ID":"c31b5254-ff30-4381-bcbd-d09e9d6fd177","Type":"ContainerStarted","Data":"0f9cd8daa2c65965a24d4d9b3a674bc3a0c4e549f62caf2e71c14be27ddb4b0f"}
Sep 09 23:09:51.109670 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.109645    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:51.181888 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.181790    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-2\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.181999 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.181886    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-serving-certs-ca-bundle\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.181999 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.181943    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-metrics-client-certs\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.181999 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.181968    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-1\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182153 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182074    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-db\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182153 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182114    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-0\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182251 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182151    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-kubelet-serving-ca-bundle\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182251 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182179    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-trusted-ca-bundle\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182251 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182208    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2lqg\" (UniqueName: \"kubernetes.io/projected/1c669e5f-a92a-495d-adae-079b488c6863-kube-api-access-l2lqg\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182251 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182216    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:09:51.182251 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182247    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-config\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182502 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182286    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182502 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182312    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c669e5f-a92a-495d-adae-079b488c6863-config-out\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182502 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182336    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-web-config\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182502 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182383    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-kube-rbac-proxy\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182502 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182339    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:09:51.182502 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182421    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-metrics-client-ca\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182502 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182473    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182829 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182504    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-grpc-tls\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182829 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182551    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c669e5f-a92a-495d-adae-079b488c6863-tls-assets\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182829 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182608    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-tls\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182829 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182639    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-thanos-prometheus-http-client-file\") pod \"1c669e5f-a92a-495d-adae-079b488c6863\" (UID: \"1c669e5f-a92a-495d-adae-079b488c6863\") "
Sep 09 23:09:51.182829 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182697    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:09:51.183036 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182893    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.183036 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182912    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.183036 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.182926    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.185183 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.183845    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:09:51.185183 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.184594    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:09:51.185183 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.184887    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:09:51.185183 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.185135    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:09:51.185552 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.185330    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:09:51.185552 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.185409    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:09:51.188951 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.188875    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:09:51.189114 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.189087    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c669e5f-a92a-495d-adae-079b488c6863-kube-api-access-l2lqg" (OuterVolumeSpecName: "kube-api-access-l2lqg") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "kube-api-access-l2lqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:09:51.189196 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.189182    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:09:51.189292 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.189269    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c669e5f-a92a-495d-adae-079b488c6863-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:09:51.189359 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.189327    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:09:51.189404 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.189382    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c669e5f-a92a-495d-adae-079b488c6863-config-out" (OuterVolumeSpecName: "config-out") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:09:51.189461 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.189425    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:09:51.189513 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.189462    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:09:51.190796 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.190763    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-config" (OuterVolumeSpecName: "config") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:09:51.191240 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.191209    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:09:51.199808 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.199782    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-web-config" (OuterVolumeSpecName: "web-config") pod "1c669e5f-a92a-495d-adae-079b488c6863" (UID: "1c669e5f-a92a-495d-adae-079b488c6863"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:09:51.284445 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284413    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c669e5f-a92a-495d-adae-079b488c6863-tls-assets\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.284445 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284447    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.284655 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284462    2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.284655 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284478    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.284655 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284493    2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-metrics-client-certs\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.284655 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284506    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-db\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.284655 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284521    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.284655 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284563    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.284655 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284577    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2lqg\" (UniqueName: \"kubernetes.io/projected/1c669e5f-a92a-495d-adae-079b488c6863-kube-api-access-l2lqg\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.284655 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284590    2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-config\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.284655 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284605    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.284655 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284622    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c669e5f-a92a-495d-adae-079b488c6863-config-out\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.284655 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284637    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-web-config\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.284655 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284651    2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-kube-rbac-proxy\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.285094 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284665    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c669e5f-a92a-495d-adae-079b488c6863-configmap-metrics-client-ca\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.285094 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284692    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.285094 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.284706    2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c669e5f-a92a-495d-adae-079b488c6863-secret-grpc-tls\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:09:51.937818 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.937783    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c669e5f-a92a-495d-adae-079b488c6863","Type":"ContainerDied","Data":"0c8f2c2c22158c89eb17712eeb8e8a446f808900b074f8d4fe557600313582c1"}
Sep 09 23:09:51.938249 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.937835    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:51.938249 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.937862    2562 scope.go:117] "RemoveContainer" containerID="eaddf9f110c41fece0a1f6e0978b13a31c1862ef6166fdc7f5ed5d5cc37aa31d"
Sep 09 23:09:51.939842 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.939817    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dwb45" event={"ID":"c31b5254-ff30-4381-bcbd-d09e9d6fd177","Type":"ContainerStarted","Data":"3d5541ceb15100ee23c35ba4ae7f3e8ece8dbc50fb9a976974a08430ccc4f9b5"}
Sep 09 23:09:51.939956 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.939864    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dwb45" event={"ID":"c31b5254-ff30-4381-bcbd-d09e9d6fd177","Type":"ContainerStarted","Data":"42a697ed58320967a441e78dec1f17f6fdf0d87749cd6ef2ca3ef13ad2d628ea"}
Sep 09 23:09:51.945924 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.945908    2562 scope.go:117] "RemoveContainer" containerID="5ac5b04535f6583cefca5a913322ac94eefceb51838347215876e09dc886ccea"
Sep 09 23:09:51.952598 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.952570    2562 scope.go:117] "RemoveContainer" containerID="4b5ab38f2410dcb84035034e54e87fd1cf1b20b40192dba2968a7346de6cf9d5"
Sep 09 23:09:51.959102 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.959062    2562 scope.go:117] "RemoveContainer" containerID="ec22bad2ded593d21c48346f3627a55166e9679f04be85322f60b05dd2efc267"
Sep 09 23:09:51.960326 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.960273    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dwb45" podStartSLOduration=374.817820337 podStartE2EDuration="6m15.960256667s" totalImagesPullingTime="1.14243633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:51.959556654 +0000 UTC m=+376.742597040" watchObservedRunningTime="2026-09-09 23:09:51.960256667 +0000 UTC m=+376.743297053"
Sep 09 23:09:51.966526 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.966502    2562 scope.go:117] "RemoveContainer" containerID="b414d3e0e3bf62732c1312324b7a18519b407654c672233b8d0e50cff611c74e"
Sep 09 23:09:51.973480 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.973445    2562 scope.go:117] "RemoveContainer" containerID="3fafa11ea2b6f2af70c91f768757682970f90472ab0cf310debe8cc4c2d3afc1"
Sep 09 23:09:51.975335 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.975315    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:09:51.979112 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.979090    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:09:51.981925 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:51.981909    2562 scope.go:117] "RemoveContainer" containerID="d5f3ddf54f3665817c2b83d125fb83e895d6cd8c29e169bbba792445cc4e7461"
Sep 09 23:09:52.004106 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004080    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:09:52.004327 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004315    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fb09c39-00c7-4de0-bdbe-35cadac25075" containerName="registry"
Sep 09 23:09:52.004327 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004328    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fb09c39-00c7-4de0-bdbe-35cadac25075" containerName="registry"
Sep 09 23:09:52.004448 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004337    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="thanos-sidecar"
Sep 09 23:09:52.004448 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004370    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="thanos-sidecar"
Sep 09 23:09:52.004448 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004384    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="prometheus"
Sep 09 23:09:52.004448 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004400    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="prometheus"
Sep 09 23:09:52.004448 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004409    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="config-reloader"
Sep 09 23:09:52.004448 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004418    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="config-reloader"
Sep 09 23:09:52.004448 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004427    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="kube-rbac-proxy"
Sep 09 23:09:52.004448 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004432    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="kube-rbac-proxy"
Sep 09 23:09:52.004448 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004442    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="init-config-reloader"
Sep 09 23:09:52.004448 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004447    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="init-config-reloader"
Sep 09 23:09:52.004448 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004453    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="kube-rbac-proxy-thanos"
Sep 09 23:09:52.004741 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004459    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="kube-rbac-proxy-thanos"
Sep 09 23:09:52.004741 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004469    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="kube-rbac-proxy-web"
Sep 09 23:09:52.004741 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004474    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="kube-rbac-proxy-web"
Sep 09 23:09:52.004741 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004523    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fb09c39-00c7-4de0-bdbe-35cadac25075" containerName="registry"
Sep 09 23:09:52.004741 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004531    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="thanos-sidecar"
Sep 09 23:09:52.004741 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004536    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="kube-rbac-proxy-thanos"
Sep 09 23:09:52.004741 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004543    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="prometheus"
Sep 09 23:09:52.004741 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004547    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="config-reloader"
Sep 09 23:09:52.004741 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004552    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="kube-rbac-proxy-web"
Sep 09 23:09:52.004741 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.004556    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c669e5f-a92a-495d-adae-079b488c6863" containerName="kube-rbac-proxy"
Sep 09 23:09:52.009485 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.009465    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.011996 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.011978    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 09 23:09:52.012095 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.011979    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e5s4ivbkqpb5o\""
Sep 09 23:09:52.012095 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.011982    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 09 23:09:52.012095 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.012042    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 09 23:09:52.012095 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.012045    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 09 23:09:52.012428 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.012412    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 09 23:09:52.012505 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.012444    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 09 23:09:52.012559 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.012505    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bqpbq\""
Sep 09 23:09:52.012609 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.012590    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 09 23:09:52.012609 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.012597    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 09 23:09:52.013044 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.013024    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 09 23:09:52.013044 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.013037    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 09 23:09:52.013253 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.013234    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 09 23:09:52.013628 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.013544    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 09 23:09:52.015796 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.015776    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 09 23:09:52.018532 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.018513    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 09 23:09:52.022755 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.022736    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:09:52.055904 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.055873    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:52.090164 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090133    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.090164 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090165    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.090442 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.090442 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090223    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.090442 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090258    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvgdv\" (UniqueName: \"kubernetes.io/projected/4dd2aec9-480e-433b-80b3-7c49ecbf965d-kube-api-access-lvgdv\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.090442 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090371    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4dd2aec9-480e-433b-80b3-7c49ecbf965d-config-out\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.090643 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090446    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.090643 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090478    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-web-config\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.090643 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-config\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.090643 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4dd2aec9-480e-433b-80b3-7c49ecbf965d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.090643 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090566    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.090643 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090592    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.090643 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090626    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.091074 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.091074 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090688    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.091074 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090704    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.091074 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4dd2aec9-480e-433b-80b3-7c49ecbf965d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.091074 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090761    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.091074 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.091074 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.090824    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.117468 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.117441    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:52.191621 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.191589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4dd2aec9-480e-433b-80b3-7c49ecbf965d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.191621 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.191622    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.191774 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.191640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.191774 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.191750    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.191855 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.191785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.191855 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.191806    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.191855 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.191824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.191855 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.191847    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4dd2aec9-480e-433b-80b3-7c49ecbf965d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.192036 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.192002    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.192036 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.192025    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4dd2aec9-480e-433b-80b3-7c49ecbf965d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.192142 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.192041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.192450 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.192424    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.192533 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.192496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.192596 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.192544    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.192596 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.192578    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.192702 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.192608    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.192702 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.192634    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.192702 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.192657    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvgdv\" (UniqueName: \"kubernetes.io/projected/4dd2aec9-480e-433b-80b3-7c49ecbf965d-kube-api-access-lvgdv\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.192702 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.192689    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4dd2aec9-480e-433b-80b3-7c49ecbf965d-config-out\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.192941 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.192704    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.192941 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.192725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.192941 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.192761    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-web-config\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.192941 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.192792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-config\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.193504 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.193482    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.195772 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.194158    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.195772 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.194823    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.195772 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.194939    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.196106 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.195271    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4dd2aec9-480e-433b-80b3-7c49ecbf965d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.196106 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.195273    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.196106 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.195433    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.196106 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.195981    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.196371 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.196331    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dd2aec9-480e-433b-80b3-7c49ecbf965d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.197132 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.196845    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.197132 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.196895    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4dd2aec9-480e-433b-80b3-7c49ecbf965d-config-out\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.197406 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.197371    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.197513 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.197497    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-config\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.197810 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.197791    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.198068 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.198049    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-web-config\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.198390 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.198371    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4dd2aec9-480e-433b-80b3-7c49ecbf965d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.203068 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.203014    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvgdv\" (UniqueName: \"kubernetes.io/projected/4dd2aec9-480e-433b-80b3-7c49ecbf965d-kube-api-access-lvgdv\") pod \"prometheus-k8s-0\" (UID: \"4dd2aec9-480e-433b-80b3-7c49ecbf965d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.319031 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.318990    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:09:52.600457 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.600375    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:09:52.603894 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:09:52.603857    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd2aec9_480e_433b_80b3_7c49ecbf965d.slice/crio-32ec0609b6b2e9e3a7d3c4685e4ba6e2346e9e8b0f1f59027d91dc0e84fe34e3 WatchSource:0}: Error finding container 32ec0609b6b2e9e3a7d3c4685e4ba6e2346e9e8b0f1f59027d91dc0e84fe34e3: Status 404 returned error can't find the container with id 32ec0609b6b2e9e3a7d3c4685e4ba6e2346e9e8b0f1f59027d91dc0e84fe34e3
Sep 09 23:09:52.946208 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.946175    2562 generic.go:356] "Generic (PLEG): container finished" podID="4dd2aec9-480e-433b-80b3-7c49ecbf965d" containerID="afb564417192e2551bdb2d9539dfbd05d151555bdb0466bac56cfdae988c8a07" exitCode=0
Sep 09 23:09:52.946602 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.946259    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4dd2aec9-480e-433b-80b3-7c49ecbf965d","Type":"ContainerDied","Data":"afb564417192e2551bdb2d9539dfbd05d151555bdb0466bac56cfdae988c8a07"}
Sep 09 23:09:52.946602 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:52.946321    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4dd2aec9-480e-433b-80b3-7c49ecbf965d","Type":"ContainerStarted","Data":"32ec0609b6b2e9e3a7d3c4685e4ba6e2346e9e8b0f1f59027d91dc0e84fe34e3"}
Sep 09 23:09:53.209578 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:53.209546    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:53.304056 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:53.304022    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:53.404562 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:53.404524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:53.451620 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:53.451588    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:53.723076 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:53.723041    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c669e5f-a92a-495d-adae-079b488c6863" path="/var/lib/kubelet/pods/1c669e5f-a92a-495d-adae-079b488c6863/volumes"
Sep 09 23:09:53.954177 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:53.954139    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4dd2aec9-480e-433b-80b3-7c49ecbf965d","Type":"ContainerStarted","Data":"13f5ee101648b92e01fa0455564342fc4de8407ca89d1126ccfbd0978ef9831e"}
Sep 09 23:09:53.954591 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:53.954221    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4dd2aec9-480e-433b-80b3-7c49ecbf965d","Type":"ContainerStarted","Data":"8447e6d56381ae0ab3d170e8e287e4f5b58b019df02f0f6da56c142dfa92d826"}
Sep 09 23:09:53.954591 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:53.954265    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4dd2aec9-480e-433b-80b3-7c49ecbf965d","Type":"ContainerStarted","Data":"c49c3ca83e1ae498fb885375d267b3b5961c703788f7c84c4fa4a4e98f1a6abd"}
Sep 09 23:09:53.954591 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:53.954301    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4dd2aec9-480e-433b-80b3-7c49ecbf965d","Type":"ContainerStarted","Data":"7a1f320b33dff728d426169d5e42698adae800f0ffe12820806ef9721be9df15"}
Sep 09 23:09:53.954591 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:53.954338    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4dd2aec9-480e-433b-80b3-7c49ecbf965d","Type":"ContainerStarted","Data":"a2b2f07565d041b74849cbce61ffb5b02c096d85e445e74c368bd484a2587c61"}
Sep 09 23:09:53.954591 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:53.954394    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4dd2aec9-480e-433b-80b3-7c49ecbf965d","Type":"ContainerStarted","Data":"51c446d89fc57c9e09585904c1a29b43796c8be2e113eff701f9360db0d8d7da"}
Sep 09 23:09:53.979558 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:53.979436    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.959310968 podStartE2EDuration="2.979413412s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.102444ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:53.978079581 +0000 UTC m=+378.761120004" watchObservedRunningTime="2026-09-09 23:09:53.979413412 +0000 UTC m=+378.762453797"
Sep 09 23:09:54.212660 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:54.212629    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:54.263335 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:54.263261    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:57.319729 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:09:57.319689    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:10:04.478391 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:10:04.478333    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:10:04.576779 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:10:04.576747    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:10:04.627856 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:10:04.627822    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:10:34.189536 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:10:34.189504    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:10:34.238773 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:10:34.238747    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:10:43.135722 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:10:43.135689    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:10:52.319804 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:10:52.319767    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:10:52.335206 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:10:52.335184    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:10:53.187517 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:10:53.187490    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:11:00.525274 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:11:00.525193    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:11:00.576976 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:11:00.576945    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:11:06.804928 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:11:06.804881    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:11:08.630445 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:11:08.630413    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:11:12.448800 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:11:12.448765    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:11:12.547779 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:11:12.547751    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:11:19.770159 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:11:19.770125    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:11:19.820775 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:11:19.820742    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:11:19.886719 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:11:19.886683    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:11:19.940381 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:11:19.940305    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:11:27.353141 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:11:27.353111    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:11:27.453968 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:11:27.453938    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:11:27.499585 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:11:27.499536    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:11:27.598069 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:11:27.598036    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:01.204561 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:01.204522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:01.302263 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:01.302226    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:27.775913 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:27.775868    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:28.555494 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:28.555421    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:31.374597 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:31.374560    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:31.419961 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:31.419930    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:32.391264 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:32.391231    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:32.483561 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:32.483517    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:33.439063 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:33.439028    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:33.543857 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:33.543828    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:35.481875 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:35.481842    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:35.839099 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:35.839025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:38.173354 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:38.173324    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:38.237491 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:38.237458    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:40.197626 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:40.197590    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:40.286576 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:40.286546    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:44.062660 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:44.062628    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:45.650059 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:45.650029    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:45.751425 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:45.751395    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:51.343587 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:51.343553    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:51.443880 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:51.443847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:12:53.479233 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:12:53.479203    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:04.821893 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:04.821860    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:04.921562 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:04.921531    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:05.330566 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.330535    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:05.494192 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.494162    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:05.600804 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.600722    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:05.680180 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.680153    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"]
Sep 09 23:13:05.683423 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.683406    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:05.687442 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.687419    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jprld\""
Sep 09 23:13:05.687928 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.687912    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 23:13:05.687984 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.687911    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 23:13:05.688444 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.688415    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 23:13:05.688778 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.688760    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 23:13:05.715434 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.715410    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"]
Sep 09 23:13:05.814821 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.814792    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:05.836018 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.835995    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9b22aea7-0279-4345-bc72-cb92a46b1f7d-manifests\") pod \"opendatahub-operator-controller-manager-76cbb89f58-tqm4v\" (UID: \"9b22aea7-0279-4345-bc72-cb92a46b1f7d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:05.836384 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.836033    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b22aea7-0279-4345-bc72-cb92a46b1f7d-tmp\") pod \"opendatahub-operator-controller-manager-76cbb89f58-tqm4v\" (UID: \"9b22aea7-0279-4345-bc72-cb92a46b1f7d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:05.836384 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.836059    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b22aea7-0279-4345-bc72-cb92a46b1f7d-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-tqm4v\" (UID: \"9b22aea7-0279-4345-bc72-cb92a46b1f7d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:05.836384 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.836077    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9b22aea7-0279-4345-bc72-cb92a46b1f7d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-tqm4v\" (UID: \"9b22aea7-0279-4345-bc72-cb92a46b1f7d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:05.836384 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.836183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgcm9\" (UniqueName: \"kubernetes.io/projected/9b22aea7-0279-4345-bc72-cb92a46b1f7d-kube-api-access-zgcm9\") pod \"opendatahub-operator-controller-manager-76cbb89f58-tqm4v\" (UID: \"9b22aea7-0279-4345-bc72-cb92a46b1f7d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:05.916594 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.916560    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:05.936788 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.936759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgcm9\" (UniqueName: \"kubernetes.io/projected/9b22aea7-0279-4345-bc72-cb92a46b1f7d-kube-api-access-zgcm9\") pod \"opendatahub-operator-controller-manager-76cbb89f58-tqm4v\" (UID: \"9b22aea7-0279-4345-bc72-cb92a46b1f7d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:05.936890 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.936802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9b22aea7-0279-4345-bc72-cb92a46b1f7d-manifests\") pod \"opendatahub-operator-controller-manager-76cbb89f58-tqm4v\" (UID: \"9b22aea7-0279-4345-bc72-cb92a46b1f7d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:05.936890 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.936838    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b22aea7-0279-4345-bc72-cb92a46b1f7d-tmp\") pod \"opendatahub-operator-controller-manager-76cbb89f58-tqm4v\" (UID: \"9b22aea7-0279-4345-bc72-cb92a46b1f7d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:05.936890 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.936867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b22aea7-0279-4345-bc72-cb92a46b1f7d-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-tqm4v\" (UID: \"9b22aea7-0279-4345-bc72-cb92a46b1f7d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:05.936890 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.936883    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9b22aea7-0279-4345-bc72-cb92a46b1f7d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-tqm4v\" (UID: \"9b22aea7-0279-4345-bc72-cb92a46b1f7d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:05.937316 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.937289    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9b22aea7-0279-4345-bc72-cb92a46b1f7d-manifests\") pod \"opendatahub-operator-controller-manager-76cbb89f58-tqm4v\" (UID: \"9b22aea7-0279-4345-bc72-cb92a46b1f7d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:05.939295 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.939269    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b22aea7-0279-4345-bc72-cb92a46b1f7d-tmp\") pod \"opendatahub-operator-controller-manager-76cbb89f58-tqm4v\" (UID: \"9b22aea7-0279-4345-bc72-cb92a46b1f7d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:05.939411 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.939366    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9b22aea7-0279-4345-bc72-cb92a46b1f7d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-tqm4v\" (UID: \"9b22aea7-0279-4345-bc72-cb92a46b1f7d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:05.939411 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.939396    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b22aea7-0279-4345-bc72-cb92a46b1f7d-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-tqm4v\" (UID: \"9b22aea7-0279-4345-bc72-cb92a46b1f7d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:05.944730 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.944707    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgcm9\" (UniqueName: \"kubernetes.io/projected/9b22aea7-0279-4345-bc72-cb92a46b1f7d-kube-api-access-zgcm9\") pod \"opendatahub-operator-controller-manager-76cbb89f58-tqm4v\" (UID: \"9b22aea7-0279-4345-bc72-cb92a46b1f7d\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:05.993108 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:05.993088    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:06.015449 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:06.015419    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:06.116649 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:06.116612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:06.186501 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:06.186432    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:06.265010 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:06.264896    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"]
Sep 09 23:13:06.267273 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:13:06.267245    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b22aea7_0279_4345_bc72_cb92a46b1f7d.slice/crio-6a97765e36dda0eda259892640ddf6f37a13d1e0654fb2e2864d5fe6bc6e061e WatchSource:0}: Error finding container 6a97765e36dda0eda259892640ddf6f37a13d1e0654fb2e2864d5fe6bc6e061e: Status 404 returned error can't find the container with id 6a97765e36dda0eda259892640ddf6f37a13d1e0654fb2e2864d5fe6bc6e061e
Sep 09 23:13:06.665282 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:06.665249    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v" event={"ID":"9b22aea7-0279-4345-bc72-cb92a46b1f7d","Type":"ContainerStarted","Data":"6a97765e36dda0eda259892640ddf6f37a13d1e0654fb2e2864d5fe6bc6e061e"}
Sep 09 23:13:09.681537 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:09.681501    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v" event={"ID":"9b22aea7-0279-4345-bc72-cb92a46b1f7d","Type":"ContainerStarted","Data":"ddf405743334a34ed31fa2f3da8d2f2dc36c2aef987770ab1fe6345bfa520d9b"}
Sep 09 23:13:10.686919 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:10.686884    2562 generic.go:356] "Generic (PLEG): container finished" podID="9b22aea7-0279-4345-bc72-cb92a46b1f7d" containerID="ddf405743334a34ed31fa2f3da8d2f2dc36c2aef987770ab1fe6345bfa520d9b" exitCode=0
Sep 09 23:13:10.687238 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:10.686958    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v" event={"ID":"9b22aea7-0279-4345-bc72-cb92a46b1f7d","Type":"ContainerDied","Data":"ddf405743334a34ed31fa2f3da8d2f2dc36c2aef987770ab1fe6345bfa520d9b"}
Sep 09 23:13:11.693362 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:11.693323    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v" event={"ID":"9b22aea7-0279-4345-bc72-cb92a46b1f7d","Type":"ContainerStarted","Data":"4a29c5efcb5ee720a2327dd9acd15139f7a4929a578c3645ddab139e3ace89f6"}
Sep 09 23:13:11.693741 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:11.693450    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:11.722382 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:11.722184    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v" podStartSLOduration=1.983241697 podStartE2EDuration="6.722164365s" totalImagesPullingTime="3.679530319s" totalInitContainerRuntime="1.059392349s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:11.719559634 +0000 UTC m=+576.502600066" watchObservedRunningTime="2026-09-09 23:13:11.722164365 +0000 UTC m=+576.505204748"
Sep 09 23:13:20.664888 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:20.664848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:20.781035 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:20.781009    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:22.699750 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:22.699716    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-tqm4v"
Sep 09 23:13:22.811058 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:22.811025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:22.886097 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:22.886069    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"]
Sep 09 23:13:22.896787 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:22.896767    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"
Sep 09 23:13:22.899263 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:22.899173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:22.899826 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:22.899799    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"]
Sep 09 23:13:22.900032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:22.900015    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-s2fvs\""
Sep 09 23:13:22.900122 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:22.900038    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 09 23:13:22.900122 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:22.900069    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 23:13:22.900227 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:22.900117    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 09 23:13:22.900407 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:22.900392    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:13:22.900501 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:22.900444    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 09 23:13:22.976017 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:22.975935    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnszr\" (UniqueName: \"kubernetes.io/projected/2a902752-9311-4f93-85cb-609664eb9c9c-kube-api-access-xnszr\") pod \"lws-controller-manager-758bd7d86f-k69sb\" (UID: \"2a902752-9311-4f93-85cb-609664eb9c9c\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"
Sep 09 23:13:22.976017 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:22.975979    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a902752-9311-4f93-85cb-609664eb9c9c-cert\") pod \"lws-controller-manager-758bd7d86f-k69sb\" (UID: \"2a902752-9311-4f93-85cb-609664eb9c9c\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"
Sep 09 23:13:22.976180 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:22.976016    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2a902752-9311-4f93-85cb-609664eb9c9c-manager-config\") pod \"lws-controller-manager-758bd7d86f-k69sb\" (UID: \"2a902752-9311-4f93-85cb-609664eb9c9c\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"
Sep 09 23:13:22.976180 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:22.976037    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a902752-9311-4f93-85cb-609664eb9c9c-metrics-cert\") pod \"lws-controller-manager-758bd7d86f-k69sb\" (UID: \"2a902752-9311-4f93-85cb-609664eb9c9c\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"
Sep 09 23:13:23.076667 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:23.076633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a902752-9311-4f93-85cb-609664eb9c9c-cert\") pod \"lws-controller-manager-758bd7d86f-k69sb\" (UID: \"2a902752-9311-4f93-85cb-609664eb9c9c\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"
Sep 09 23:13:23.076813 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:23.076676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2a902752-9311-4f93-85cb-609664eb9c9c-manager-config\") pod \"lws-controller-manager-758bd7d86f-k69sb\" (UID: \"2a902752-9311-4f93-85cb-609664eb9c9c\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"
Sep 09 23:13:23.076813 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:23.076696    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a902752-9311-4f93-85cb-609664eb9c9c-metrics-cert\") pod \"lws-controller-manager-758bd7d86f-k69sb\" (UID: \"2a902752-9311-4f93-85cb-609664eb9c9c\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"
Sep 09 23:13:23.076813 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:23.076760    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnszr\" (UniqueName: \"kubernetes.io/projected/2a902752-9311-4f93-85cb-609664eb9c9c-kube-api-access-xnszr\") pod \"lws-controller-manager-758bd7d86f-k69sb\" (UID: \"2a902752-9311-4f93-85cb-609664eb9c9c\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"
Sep 09 23:13:23.077468 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:23.077444    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2a902752-9311-4f93-85cb-609664eb9c9c-manager-config\") pod \"lws-controller-manager-758bd7d86f-k69sb\" (UID: \"2a902752-9311-4f93-85cb-609664eb9c9c\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"
Sep 09 23:13:23.079065 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:23.079045    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a902752-9311-4f93-85cb-609664eb9c9c-metrics-cert\") pod \"lws-controller-manager-758bd7d86f-k69sb\" (UID: \"2a902752-9311-4f93-85cb-609664eb9c9c\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"
Sep 09 23:13:23.079143 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:23.079087    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a902752-9311-4f93-85cb-609664eb9c9c-cert\") pod \"lws-controller-manager-758bd7d86f-k69sb\" (UID: \"2a902752-9311-4f93-85cb-609664eb9c9c\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"
Sep 09 23:13:23.085117 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:23.085080    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnszr\" (UniqueName: \"kubernetes.io/projected/2a902752-9311-4f93-85cb-609664eb9c9c-kube-api-access-xnszr\") pod \"lws-controller-manager-758bd7d86f-k69sb\" (UID: \"2a902752-9311-4f93-85cb-609664eb9c9c\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"
Sep 09 23:13:23.208706 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:23.208676    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"
Sep 09 23:13:23.481101 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:23.481074    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"]
Sep 09 23:13:23.483685 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:13:23.483656    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a902752_9311_4f93_85cb_609664eb9c9c.slice/crio-d694fd8c2f0d569156fce242fe2ddbd7912101f4e2f22b137b28b88979e9a4f9 WatchSource:0}: Error finding container d694fd8c2f0d569156fce242fe2ddbd7912101f4e2f22b137b28b88979e9a4f9: Status 404 returned error can't find the container with id d694fd8c2f0d569156fce242fe2ddbd7912101f4e2f22b137b28b88979e9a4f9
Sep 09 23:13:23.745103 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:23.745069    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb" event={"ID":"2a902752-9311-4f93-85cb-609664eb9c9c","Type":"ContainerStarted","Data":"d694fd8c2f0d569156fce242fe2ddbd7912101f4e2f22b137b28b88979e9a4f9"}
Sep 09 23:13:24.848793 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:24.848761    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:24.952330 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:24.952292    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:25.154155 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.154123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:25.181938 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.181906    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4"]
Sep 09 23:13:25.186402 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.186380    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4"
Sep 09 23:13:25.189044 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.189025    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 23:13:25.190294 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.190278    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cprw4\""
Sep 09 23:13:25.190376 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.190328    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 09 23:13:25.196592 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.196283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4b9z\" (UniqueName: \"kubernetes.io/projected/53980b28-324a-463f-a182-8790e00fd9d5-kube-api-access-w4b9z\") pod \"kube-auth-proxy-55cf6889dc-ldjc4\" (UID: \"53980b28-324a-463f-a182-8790e00fd9d5\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4"
Sep 09 23:13:25.196592 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.196402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53980b28-324a-463f-a182-8790e00fd9d5-tmp\") pod \"kube-auth-proxy-55cf6889dc-ldjc4\" (UID: \"53980b28-324a-463f-a182-8790e00fd9d5\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4"
Sep 09 23:13:25.196592 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.196444    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53980b28-324a-463f-a182-8790e00fd9d5-tls-certs\") pod \"kube-auth-proxy-55cf6889dc-ldjc4\" (UID: \"53980b28-324a-463f-a182-8790e00fd9d5\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4"
Sep 09 23:13:25.198314 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.198288    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4"]
Sep 09 23:13:25.250004 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.249979    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:25.297383 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.297332    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53980b28-324a-463f-a182-8790e00fd9d5-tls-certs\") pod \"kube-auth-proxy-55cf6889dc-ldjc4\" (UID: \"53980b28-324a-463f-a182-8790e00fd9d5\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4"
Sep 09 23:13:25.297519 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.297427    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4b9z\" (UniqueName: \"kubernetes.io/projected/53980b28-324a-463f-a182-8790e00fd9d5-kube-api-access-w4b9z\") pod \"kube-auth-proxy-55cf6889dc-ldjc4\" (UID: \"53980b28-324a-463f-a182-8790e00fd9d5\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4"
Sep 09 23:13:25.297576 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.297530    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53980b28-324a-463f-a182-8790e00fd9d5-tmp\") pod \"kube-auth-proxy-55cf6889dc-ldjc4\" (UID: \"53980b28-324a-463f-a182-8790e00fd9d5\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4"
Sep 09 23:13:25.299709 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.299682    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53980b28-324a-463f-a182-8790e00fd9d5-tmp\") pod \"kube-auth-proxy-55cf6889dc-ldjc4\" (UID: \"53980b28-324a-463f-a182-8790e00fd9d5\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4"
Sep 09 23:13:25.299825 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.299797    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53980b28-324a-463f-a182-8790e00fd9d5-tls-certs\") pod \"kube-auth-proxy-55cf6889dc-ldjc4\" (UID: \"53980b28-324a-463f-a182-8790e00fd9d5\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4"
Sep 09 23:13:25.304941 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.304920    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4b9z\" (UniqueName: \"kubernetes.io/projected/53980b28-324a-463f-a182-8790e00fd9d5-kube-api-access-w4b9z\") pod \"kube-auth-proxy-55cf6889dc-ldjc4\" (UID: \"53980b28-324a-463f-a182-8790e00fd9d5\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4"
Sep 09 23:13:25.497836 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.497762    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4"
Sep 09 23:13:25.776665 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:25.776640    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4"]
Sep 09 23:13:26.335266 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:26.335234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:26.420241 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:26.420209    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:26.760145 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:26.760110    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4" event={"ID":"53980b28-324a-463f-a182-8790e00fd9d5","Type":"ContainerStarted","Data":"11d09f2aeed2f9b555dedcf8d73329464c1a120ba699ea65592b667821c67535"}
Sep 09 23:13:27.250892 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:27.250862    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:28.773065 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:28.772804    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4" event={"ID":"53980b28-324a-463f-a182-8790e00fd9d5","Type":"ContainerStarted","Data":"1b8b578880163e60a0827c5a9fb60410eb93bc7db6280713b54a79b90d3fdcb6"}
Sep 09 23:13:28.790291 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:28.790235    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55cf6889dc-ldjc4" podStartSLOduration=0.913541883 podStartE2EDuration="3.790213519s" totalImagesPullingTime="2.876671636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:28.788221873 +0000 UTC m=+593.571262271" watchObservedRunningTime="2026-09-09 23:13:28.790213519 +0000 UTC m=+593.573253904"
Sep 09 23:13:30.783451 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:30.783322    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb" event={"ID":"2a902752-9311-4f93-85cb-609664eb9c9c","Type":"ContainerStarted","Data":"426fcf5a7e4458da7d5cc51da74806b278489ac68d997be9d3eef49d2bbf62f7"}
Sep 09 23:13:30.783875 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:30.783489    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"
Sep 09 23:13:30.806850 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:30.806795    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb" podStartSLOduration=1.852332712 podStartE2EDuration="8.806778635s" totalImagesPullingTime="6.954445923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:30.806454397 +0000 UTC m=+595.589494807" watchObservedRunningTime="2026-09-09 23:13:30.806778635 +0000 UTC m=+595.589819019"
Sep 09 23:13:31.018768 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:31.018735    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:31.078501 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:31.078427    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:31.430054 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:31.430024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:31.533971 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:31.533945    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:31.656913 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:31.656881    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:31.741181 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:31.741106    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:36.144211 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:36.144174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:36.242683 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:36.242645    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:36.342924 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:36.342888    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:36.443621 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:36.443535    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:36.543177 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:36.543146    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:36.744579 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:36.744501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:36.947169 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:36.947135    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:41.790702 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:41.790670    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-k69sb"
Sep 09 23:13:45.003944 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:45.003901    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:13:46.375772 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:13:46.375724    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:04.574721 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:04.574629    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:04.625673 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:04.625632    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:06.516769 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:06.516729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:06.618017 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:06.617981    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:17.307511 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:17.307483    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:17.403896 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:17.403857    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:37.011354 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:37.011324    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:37.107000 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:37.106971    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:49.968437 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:49.968406    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:52.788032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:52.787994    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:54.009489 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:54.009454    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dckpb"]
Sep 09 23:14:54.013152 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:54.013129    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dckpb"
Sep 09 23:14:54.015776 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:54.015750    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 23:14:54.015776 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:54.015770    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 09 23:14:54.015972 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:54.015898    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 23:14:54.016041 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:54.016023    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-fv8w5\""
Sep 09 23:14:54.022775 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:54.022755    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dckpb"]
Sep 09 23:14:54.051327 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:54.051302    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb62f\" (UniqueName: \"kubernetes.io/projected/5ee9ab2a-cf5b-46e2-928f-5ea719cf9a43-kube-api-access-gb62f\") pod \"dns-operator-controller-manager-7b84cd7c9c-dckpb\" (UID: \"5ee9ab2a-cf5b-46e2-928f-5ea719cf9a43\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dckpb"
Sep 09 23:14:54.152647 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:54.152608    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb62f\" (UniqueName: \"kubernetes.io/projected/5ee9ab2a-cf5b-46e2-928f-5ea719cf9a43-kube-api-access-gb62f\") pod \"dns-operator-controller-manager-7b84cd7c9c-dckpb\" (UID: \"5ee9ab2a-cf5b-46e2-928f-5ea719cf9a43\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dckpb"
Sep 09 23:14:54.164185 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:54.164152    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb62f\" (UniqueName: \"kubernetes.io/projected/5ee9ab2a-cf5b-46e2-928f-5ea719cf9a43-kube-api-access-gb62f\") pod \"dns-operator-controller-manager-7b84cd7c9c-dckpb\" (UID: \"5ee9ab2a-cf5b-46e2-928f-5ea719cf9a43\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dckpb"
Sep 09 23:14:54.323608 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:54.323522    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dckpb"
Sep 09 23:14:54.582020 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:54.581943    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:54.599974 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:54.599944    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dckpb"]
Sep 09 23:14:54.604410 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:14:54.604384    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee9ab2a_cf5b_46e2_928f_5ea719cf9a43.slice/crio-94d20e084cc69967c42cdc3ec879337edf22aac341b92a5a8b6fae252bb9f2ba WatchSource:0}: Error finding container 94d20e084cc69967c42cdc3ec879337edf22aac341b92a5a8b6fae252bb9f2ba: Status 404 returned error can't find the container with id 94d20e084cc69967c42cdc3ec879337edf22aac341b92a5a8b6fae252bb9f2ba
Sep 09 23:14:54.607130 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:54.607114    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:14:54.807952 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:54.807918    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:54.962782 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:54.962754    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:55.127419 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:55.127380    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dckpb" event={"ID":"5ee9ab2a-cf5b-46e2-928f-5ea719cf9a43","Type":"ContainerStarted","Data":"94d20e084cc69967c42cdc3ec879337edf22aac341b92a5a8b6fae252bb9f2ba"}
Sep 09 23:14:55.554681 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:55.554645    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:55.888744 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:55.888715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:56.202963 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:56.202880    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:57.139644 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:57.139544    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dckpb" event={"ID":"5ee9ab2a-cf5b-46e2-928f-5ea719cf9a43","Type":"ContainerStarted","Data":"4301c3df86a39626fb68fb7edb2298b12e5d6a3b3b8b40bb5088f97545ca0962"}
Sep 09 23:14:57.139814 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:57.139760    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dckpb"
Sep 09 23:14:57.205246 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:57.205187    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dckpb" podStartSLOduration=1.751395219 podStartE2EDuration="4.205170007s" totalImagesPullingTime="2.453774788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:14:57.202216069 +0000 UTC m=+681.985256454" watchObservedRunningTime="2026-09-09 23:14:57.205170007 +0000 UTC m=+681.988210390"
Sep 09 23:14:57.244242 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:57.244211    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:57.345809 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:57.345722    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:58.553506 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:58.553474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:58.783514 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:58.783483    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:58.993728 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:58.993699    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:14:59.094496 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:14:59.094463    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:02.435600 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:02.435569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:02.535852 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:02.535819    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:05.366315 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:05.366281    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:05.466523 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:05.466489    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:05.836785 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:05.836758    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:05.843429 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:05.843341    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9"]
Sep 09 23:15:05.846569 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:05.846543    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9"
Sep 09 23:15:05.849144 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:05.849099    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bp97q\""
Sep 09 23:15:05.849269 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:05.849149    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 09 23:15:05.849269 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:05.849154    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 09 23:15:05.853988 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:05.853963    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9"]
Sep 09 23:15:05.952172 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:05.952134    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8czzq\" (UniqueName: \"kubernetes.io/projected/b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a-kube-api-access-8czzq\") pod \"kuadrant-console-plugin-fbdd4f445-9tpn9\" (UID: \"b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9"
Sep 09 23:15:05.952392 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:05.952182    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-9tpn9\" (UID: \"b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9"
Sep 09 23:15:05.952392 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:05.952247    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-9tpn9\" (UID: \"b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9"
Sep 09 23:15:06.053131 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:06.053093    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-9tpn9\" (UID: \"b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9"
Sep 09 23:15:06.053438 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:06.053180    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8czzq\" (UniqueName: \"kubernetes.io/projected/b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a-kube-api-access-8czzq\") pod \"kuadrant-console-plugin-fbdd4f445-9tpn9\" (UID: \"b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9"
Sep 09 23:15:06.053438 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:06.053217    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-9tpn9\" (UID: \"b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9"
Sep 09 23:15:06.053764 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:06.053742    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-9tpn9\" (UID: \"b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9"
Sep 09 23:15:06.055739 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:06.055716    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-9tpn9\" (UID: \"b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9"
Sep 09 23:15:06.061056 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:06.061036    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8czzq\" (UniqueName: \"kubernetes.io/projected/b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a-kube-api-access-8czzq\") pod \"kuadrant-console-plugin-fbdd4f445-9tpn9\" (UID: \"b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9"
Sep 09 23:15:06.087601 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:06.087545    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:06.163736 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:06.163702    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9"
Sep 09 23:15:06.431838 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:06.431812    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9"]
Sep 09 23:15:06.434550 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:15:06.434519    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1a6f3c2_d7e6_4d67_a36b_4bec27b1fd8a.slice/crio-ff13868af14943bc825c428bf1ca8288ccd21e9f47f3f14aecc35a65b7758f81 WatchSource:0}: Error finding container ff13868af14943bc825c428bf1ca8288ccd21e9f47f3f14aecc35a65b7758f81: Status 404 returned error can't find the container with id ff13868af14943bc825c428bf1ca8288ccd21e9f47f3f14aecc35a65b7758f81
Sep 09 23:15:07.182227 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:07.182194    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9" event={"ID":"b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a","Type":"ContainerStarted","Data":"ff13868af14943bc825c428bf1ca8288ccd21e9f47f3f14aecc35a65b7758f81"}
Sep 09 23:15:08.146334 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:08.146302    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dckpb"
Sep 09 23:15:08.540304 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:08.540227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:08.637985 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:08.637951    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:10.389818 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:10.389783    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:10.487935 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:10.487900    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:10.551789 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:10.551758    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:12.211329 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:12.211293    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9" event={"ID":"b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a","Type":"ContainerStarted","Data":"059887cdf734d3766c9b1f120e5631926a0cea26a7906f47cf414664d7d98c2c"}
Sep 09 23:15:12.225761 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:12.225713    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9tpn9" podStartSLOduration=2.361001003 podStartE2EDuration="7.225696858s" totalImagesPullingTime="4.864695855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:12.225467201 +0000 UTC m=+697.008507585" watchObservedRunningTime="2026-09-09 23:15:12.225696858 +0000 UTC m=+697.008737244"
Sep 09 23:15:19.149115 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:19.149055    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:19.244627 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:19.244593    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:21.756553 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:21.756512    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:21.856738 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:21.856707    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:24.728071 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:24.728038    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:24.828919 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:24.828887    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:29.510767 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:29.510682    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:29.607149 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:29.607110    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:30.350419 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:30.350390    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:30.436502 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:30.436473    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:31.338477 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:31.338438    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:31.438461 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:31.438432    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:38.300321 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:38.300287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:38.401277 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:38.401247    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:45.906745 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:45.906708    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:46.149577 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:46.149543    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:59.548477 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:59.548442    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4s6ht"]
Sep 09 23:15:59.552237 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:59.552204    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:59.571839 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:59.571817    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4s6ht"]
Sep 09 23:15:59.571954 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:59.571904    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-4s6ht"
Sep 09 23:15:59.574669 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:59.574650    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 23:15:59.619726 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:59.619702    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/380a6b49-246f-4c62-be26-dddbd8dc2d93-config-file\") pod \"limitador-limitador-8588749977-4s6ht\" (UID: \"380a6b49-246f-4c62-be26-dddbd8dc2d93\") " pod="kuadrant-system/limitador-limitador-8588749977-4s6ht"
Sep 09 23:15:59.619852 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:59.619750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m47d7\" (UniqueName: \"kubernetes.io/projected/380a6b49-246f-4c62-be26-dddbd8dc2d93-kube-api-access-m47d7\") pod \"limitador-limitador-8588749977-4s6ht\" (UID: \"380a6b49-246f-4c62-be26-dddbd8dc2d93\") " pod="kuadrant-system/limitador-limitador-8588749977-4s6ht"
Sep 09 23:15:59.647519 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:59.647490    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4s6ht"]
Sep 09 23:15:59.649441 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:59.649416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:59.700706 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:59.700675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:15:59.720838 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:59.720816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/380a6b49-246f-4c62-be26-dddbd8dc2d93-config-file\") pod \"limitador-limitador-8588749977-4s6ht\" (UID: \"380a6b49-246f-4c62-be26-dddbd8dc2d93\") " pod="kuadrant-system/limitador-limitador-8588749977-4s6ht"
Sep 09 23:15:59.720971 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:59.720881    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m47d7\" (UniqueName: \"kubernetes.io/projected/380a6b49-246f-4c62-be26-dddbd8dc2d93-kube-api-access-m47d7\") pod \"limitador-limitador-8588749977-4s6ht\" (UID: \"380a6b49-246f-4c62-be26-dddbd8dc2d93\") " pod="kuadrant-system/limitador-limitador-8588749977-4s6ht"
Sep 09 23:15:59.721526 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:59.721509    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/380a6b49-246f-4c62-be26-dddbd8dc2d93-config-file\") pod \"limitador-limitador-8588749977-4s6ht\" (UID: \"380a6b49-246f-4c62-be26-dddbd8dc2d93\") " pod="kuadrant-system/limitador-limitador-8588749977-4s6ht"
Sep 09 23:15:59.728887 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:59.728865    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m47d7\" (UniqueName: \"kubernetes.io/projected/380a6b49-246f-4c62-be26-dddbd8dc2d93-kube-api-access-m47d7\") pod \"limitador-limitador-8588749977-4s6ht\" (UID: \"380a6b49-246f-4c62-be26-dddbd8dc2d93\") " pod="kuadrant-system/limitador-limitador-8588749977-4s6ht"
Sep 09 23:15:59.881225 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:15:59.881197    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-4s6ht"
Sep 09 23:16:00.151678 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:00.151598    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4s6ht"]
Sep 09 23:16:00.153896 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:16:00.153869    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod380a6b49_246f_4c62_be26_dddbd8dc2d93.slice/crio-89e2f3907d2641891a6903df521b555f185dc886cbc488863eaf81fda66c0673 WatchSource:0}: Error finding container 89e2f3907d2641891a6903df521b555f185dc886cbc488863eaf81fda66c0673: Status 404 returned error can't find the container with id 89e2f3907d2641891a6903df521b555f185dc886cbc488863eaf81fda66c0673
Sep 09 23:16:00.422458 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:00.422377    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-4s6ht" event={"ID":"380a6b49-246f-4c62-be26-dddbd8dc2d93","Type":"ContainerStarted","Data":"89e2f3907d2641891a6903df521b555f185dc886cbc488863eaf81fda66c0673"}
Sep 09 23:16:00.457697 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:00.457667    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:16:00.548591 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:00.548554    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:16:00.668403 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:00.668372    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-fn5qs"]
Sep 09 23:16:00.672954 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:00.672903    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-fn5qs"
Sep 09 23:16:00.675527 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:00.675505    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ffljt\""
Sep 09 23:16:00.675816 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:00.675796    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-fn5qs"]
Sep 09 23:16:00.730244 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:00.730211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64gzh\" (UniqueName: \"kubernetes.io/projected/1f76e127-9534-4c30-a2c0-977efaaaa518-kube-api-access-64gzh\") pod \"authorino-59c974bd48-fn5qs\" (UID: \"1f76e127-9534-4c30-a2c0-977efaaaa518\") " pod="kuadrant-system/authorino-59c974bd48-fn5qs"
Sep 09 23:16:00.831129 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:00.831100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64gzh\" (UniqueName: \"kubernetes.io/projected/1f76e127-9534-4c30-a2c0-977efaaaa518-kube-api-access-64gzh\") pod \"authorino-59c974bd48-fn5qs\" (UID: \"1f76e127-9534-4c30-a2c0-977efaaaa518\") " pod="kuadrant-system/authorino-59c974bd48-fn5qs"
Sep 09 23:16:00.839099 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:00.839075    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64gzh\" (UniqueName: \"kubernetes.io/projected/1f76e127-9534-4c30-a2c0-977efaaaa518-kube-api-access-64gzh\") pod \"authorino-59c974bd48-fn5qs\" (UID: \"1f76e127-9534-4c30-a2c0-977efaaaa518\") " pod="kuadrant-system/authorino-59c974bd48-fn5qs"
Sep 09 23:16:00.982881 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:00.982792    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-fn5qs"
Sep 09 23:16:01.252908 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:01.252869    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-fn5qs"]
Sep 09 23:16:01.256038 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:16:01.256011    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f76e127_9534_4c30_a2c0_977efaaaa518.slice/crio-bebbe4159c79a8ad356e588b748427b7e8369c2c03f95cd30db25eeb9be6fa04 WatchSource:0}: Error finding container bebbe4159c79a8ad356e588b748427b7e8369c2c03f95cd30db25eeb9be6fa04: Status 404 returned error can't find the container with id bebbe4159c79a8ad356e588b748427b7e8369c2c03f95cd30db25eeb9be6fa04
Sep 09 23:16:01.428728 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:01.428693    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-4s6ht" event={"ID":"380a6b49-246f-4c62-be26-dddbd8dc2d93","Type":"ContainerStarted","Data":"8eaef20383b74d1dd86249ab64e1bf674cbe65b4e852d861334f42d240a3bc33"}
Sep 09 23:16:01.428928 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:01.428799    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-4s6ht"
Sep 09 23:16:01.430014 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:01.429989    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-fn5qs" event={"ID":"1f76e127-9534-4c30-a2c0-977efaaaa518","Type":"ContainerStarted","Data":"bebbe4159c79a8ad356e588b748427b7e8369c2c03f95cd30db25eeb9be6fa04"}
Sep 09 23:16:01.443572 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:01.443523    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-4s6ht" podStartSLOduration=1.361264859 podStartE2EDuration="2.443506682s" totalImagesPullingTime="1.082241823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:01.443079877 +0000 UTC m=+746.226120298" watchObservedRunningTime="2026-09-09 23:16:01.443506682 +0000 UTC m=+746.226547088"
Sep 09 23:16:03.440740 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:03.440707    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-fn5qs" event={"ID":"1f76e127-9534-4c30-a2c0-977efaaaa518","Type":"ContainerStarted","Data":"818533afe06e1b553c4056ec4f8b42d53a46e48537df1e3b6c1bd103d89ba525"}
Sep 09 23:16:03.456127 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:03.456042    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-fn5qs" podStartSLOduration=1.515839684 podStartE2EDuration="3.456029195s" totalImagesPullingTime="1.940189511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:03.455772417 +0000 UTC m=+748.238812799" watchObservedRunningTime="2026-09-09 23:16:03.456029195 +0000 UTC m=+748.239069578"
Sep 09 23:16:10.773482 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:10.773450    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:16:12.436415 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:12.436376    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-4s6ht"
Sep 09 23:16:12.617727 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:12.617696    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4s6ht"]
Sep 09 23:16:12.617938 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:12.617918    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-4s6ht" podUID="380a6b49-246f-4c62-be26-dddbd8dc2d93" containerName="limitador" containerID="cri-o://8eaef20383b74d1dd86249ab64e1bf674cbe65b4e852d861334f42d240a3bc33" gracePeriod=30
Sep 09 23:16:13.173075 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.173051    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-4s6ht"
Sep 09 23:16:13.344097 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.344012    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/380a6b49-246f-4c62-be26-dddbd8dc2d93-config-file\") pod \"380a6b49-246f-4c62-be26-dddbd8dc2d93\" (UID: \"380a6b49-246f-4c62-be26-dddbd8dc2d93\") "
Sep 09 23:16:13.344097 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.344066    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m47d7\" (UniqueName: \"kubernetes.io/projected/380a6b49-246f-4c62-be26-dddbd8dc2d93-kube-api-access-m47d7\") pod \"380a6b49-246f-4c62-be26-dddbd8dc2d93\" (UID: \"380a6b49-246f-4c62-be26-dddbd8dc2d93\") "
Sep 09 23:16:13.344473 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.344447    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/380a6b49-246f-4c62-be26-dddbd8dc2d93-config-file" (OuterVolumeSpecName: "config-file") pod "380a6b49-246f-4c62-be26-dddbd8dc2d93" (UID: "380a6b49-246f-4c62-be26-dddbd8dc2d93"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:16:13.346235 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.346214    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/380a6b49-246f-4c62-be26-dddbd8dc2d93-kube-api-access-m47d7" (OuterVolumeSpecName: "kube-api-access-m47d7") pod "380a6b49-246f-4c62-be26-dddbd8dc2d93" (UID: "380a6b49-246f-4c62-be26-dddbd8dc2d93"). InnerVolumeSpecName "kube-api-access-m47d7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:16:13.445682 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.445650    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/380a6b49-246f-4c62-be26-dddbd8dc2d93-config-file\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:16:13.445682 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.445678    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m47d7\" (UniqueName: \"kubernetes.io/projected/380a6b49-246f-4c62-be26-dddbd8dc2d93-kube-api-access-m47d7\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:16:13.485594 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.485560    2562 generic.go:356] "Generic (PLEG): container finished" podID="380a6b49-246f-4c62-be26-dddbd8dc2d93" containerID="8eaef20383b74d1dd86249ab64e1bf674cbe65b4e852d861334f42d240a3bc33" exitCode=0
Sep 09 23:16:13.485749 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.485610    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-4s6ht"
Sep 09 23:16:13.485749 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.485620    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-4s6ht" event={"ID":"380a6b49-246f-4c62-be26-dddbd8dc2d93","Type":"ContainerDied","Data":"8eaef20383b74d1dd86249ab64e1bf674cbe65b4e852d861334f42d240a3bc33"}
Sep 09 23:16:13.485749 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.485666    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-4s6ht" event={"ID":"380a6b49-246f-4c62-be26-dddbd8dc2d93","Type":"ContainerDied","Data":"89e2f3907d2641891a6903df521b555f185dc886cbc488863eaf81fda66c0673"}
Sep 09 23:16:13.485749 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.485689    2562 scope.go:117] "RemoveContainer" containerID="8eaef20383b74d1dd86249ab64e1bf674cbe65b4e852d861334f42d240a3bc33"
Sep 09 23:16:13.499327 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.499308    2562 scope.go:117] "RemoveContainer" containerID="8eaef20383b74d1dd86249ab64e1bf674cbe65b4e852d861334f42d240a3bc33"
Sep 09 23:16:13.499613 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:16:13.499595    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eaef20383b74d1dd86249ab64e1bf674cbe65b4e852d861334f42d240a3bc33\": container with ID starting with 8eaef20383b74d1dd86249ab64e1bf674cbe65b4e852d861334f42d240a3bc33 not found: ID does not exist" containerID="8eaef20383b74d1dd86249ab64e1bf674cbe65b4e852d861334f42d240a3bc33"
Sep 09 23:16:13.499653 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.499628    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eaef20383b74d1dd86249ab64e1bf674cbe65b4e852d861334f42d240a3bc33"} err="failed to get container status \"8eaef20383b74d1dd86249ab64e1bf674cbe65b4e852d861334f42d240a3bc33\": rpc error: code = NotFound desc = could not find container \"8eaef20383b74d1dd86249ab64e1bf674cbe65b4e852d861334f42d240a3bc33\": container with ID starting with 8eaef20383b74d1dd86249ab64e1bf674cbe65b4e852d861334f42d240a3bc33 not found: ID does not exist"
Sep 09 23:16:13.509161 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.509137    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4s6ht"]
Sep 09 23:16:13.516013 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.515992    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4s6ht"]
Sep 09 23:16:13.721642 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:13.721605    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="380a6b49-246f-4c62-be26-dddbd8dc2d93" path="/var/lib/kubelet/pods/380a6b49-246f-4c62-be26-dddbd8dc2d93/volumes"
Sep 09 23:16:14.452940 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:14.452895    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:16:14.556109 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:14.556080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:16:14.906602 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:14.906566    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gn7d8"]
Sep 09 23:16:14.907076 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:14.907061    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="380a6b49-246f-4c62-be26-dddbd8dc2d93" containerName="limitador"
Sep 09 23:16:14.907124 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:14.907080    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="380a6b49-246f-4c62-be26-dddbd8dc2d93" containerName="limitador"
Sep 09 23:16:14.907175 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:14.907163    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="380a6b49-246f-4c62-be26-dddbd8dc2d93" containerName="limitador"
Sep 09 23:16:14.911843 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:14.911818    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gn7d8"
Sep 09 23:16:14.914591 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:14.914570    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 23:16:14.914933 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:14.914906    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 23:16:14.915046 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:14.914977    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-lpn5d\""
Sep 09 23:16:14.915274 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:14.915227    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 09 23:16:14.915760 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:14.915735    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gn7d8"]
Sep 09 23:16:14.939294 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:14.939254    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:16:15.059700 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:15.059661    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b515cad5-5189-4769-b7f7-9970ab43e035-data\") pod \"postgres-69fb4594cf-gn7d8\" (UID: \"b515cad5-5189-4769-b7f7-9970ab43e035\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gn7d8"
Sep 09 23:16:15.059873 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:15.059792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft2qf\" (UniqueName: \"kubernetes.io/projected/b515cad5-5189-4769-b7f7-9970ab43e035-kube-api-access-ft2qf\") pod \"postgres-69fb4594cf-gn7d8\" (UID: \"b515cad5-5189-4769-b7f7-9970ab43e035\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gn7d8"
Sep 09 23:16:15.160626 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:15.160542    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft2qf\" (UniqueName: \"kubernetes.io/projected/b515cad5-5189-4769-b7f7-9970ab43e035-kube-api-access-ft2qf\") pod \"postgres-69fb4594cf-gn7d8\" (UID: \"b515cad5-5189-4769-b7f7-9970ab43e035\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gn7d8"
Sep 09 23:16:15.160626 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:15.160595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b515cad5-5189-4769-b7f7-9970ab43e035-data\") pod \"postgres-69fb4594cf-gn7d8\" (UID: \"b515cad5-5189-4769-b7f7-9970ab43e035\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gn7d8"
Sep 09 23:16:15.160935 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:15.160900    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b515cad5-5189-4769-b7f7-9970ab43e035-data\") pod \"postgres-69fb4594cf-gn7d8\" (UID: \"b515cad5-5189-4769-b7f7-9970ab43e035\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gn7d8"
Sep 09 23:16:15.168550 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:15.168522    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft2qf\" (UniqueName: \"kubernetes.io/projected/b515cad5-5189-4769-b7f7-9970ab43e035-kube-api-access-ft2qf\") pod \"postgres-69fb4594cf-gn7d8\" (UID: \"b515cad5-5189-4769-b7f7-9970ab43e035\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gn7d8"
Sep 09 23:16:15.224488 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:15.224456    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gn7d8"
Sep 09 23:16:15.494771 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:15.494746    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gn7d8"]
Sep 09 23:16:15.496633 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:16:15.496602    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb515cad5_5189_4769_b7f7_9970ab43e035.slice/crio-a165a43c87d563d4fa40ec9a72c44b1ad1901b7b5ee36c4ee2e5e4df539de7ea WatchSource:0}: Error finding container a165a43c87d563d4fa40ec9a72c44b1ad1901b7b5ee36c4ee2e5e4df539de7ea: Status 404 returned error can't find the container with id a165a43c87d563d4fa40ec9a72c44b1ad1901b7b5ee36c4ee2e5e4df539de7ea
Sep 09 23:16:16.501599 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:16.501565    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gn7d8" event={"ID":"b515cad5-5189-4769-b7f7-9970ab43e035","Type":"ContainerStarted","Data":"a165a43c87d563d4fa40ec9a72c44b1ad1901b7b5ee36c4ee2e5e4df539de7ea"}
Sep 09 23:16:19.516615 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:19.516571    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gn7d8" event={"ID":"b515cad5-5189-4769-b7f7-9970ab43e035","Type":"ContainerStarted","Data":"55b72bdbdc9d5c00a62aae521e856fd86d26c6b58e139a4e0207ba402912eef1"}
Sep 09 23:16:19.517031 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:19.516694    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gn7d8"
Sep 09 23:16:19.532955 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:19.532906    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gn7d8" podStartSLOduration=2.473595264 podStartE2EDuration="5.532891731s" totalImagesPullingTime="3.059296467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:19.531063514 +0000 UTC m=+764.314103898" watchObservedRunningTime="2026-09-09 23:16:19.532891731 +0000 UTC m=+764.315932115"
Sep 09 23:16:20.665099 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:20.665065    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:16:20.712524 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:20.712480    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:16:25.550494 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:25.550464    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gn7d8"
Sep 09 23:16:25.862417 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:25.862330    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:16:26.195985 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:26.195955    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:16:26.356320 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:26.356289    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6cd44987b6-v65kl"]
Sep 09 23:16:26.364918 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:26.364894    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cd44987b6-v65kl"
Sep 09 23:16:26.365456 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:26.365434    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cd44987b6-v65kl"]
Sep 09 23:16:26.367968 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:26.367947    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 09 23:16:26.555638 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:26.555566    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/78fa3d8f-e5e3-4ea0-a411-18cd0652f429-tls-cert\") pod \"authorino-6cd44987b6-v65kl\" (UID: \"78fa3d8f-e5e3-4ea0-a411-18cd0652f429\") " pod="kuadrant-system/authorino-6cd44987b6-v65kl"
Sep 09 23:16:26.555638 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:26.555617    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrc54\" (UniqueName: \"kubernetes.io/projected/78fa3d8f-e5e3-4ea0-a411-18cd0652f429-kube-api-access-xrc54\") pod \"authorino-6cd44987b6-v65kl\" (UID: \"78fa3d8f-e5e3-4ea0-a411-18cd0652f429\") " pod="kuadrant-system/authorino-6cd44987b6-v65kl"
Sep 09 23:16:26.656706 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:26.656673    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrc54\" (UniqueName: \"kubernetes.io/projected/78fa3d8f-e5e3-4ea0-a411-18cd0652f429-kube-api-access-xrc54\") pod \"authorino-6cd44987b6-v65kl\" (UID: \"78fa3d8f-e5e3-4ea0-a411-18cd0652f429\") " pod="kuadrant-system/authorino-6cd44987b6-v65kl"
Sep 09 23:16:26.656852 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:26.656741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/78fa3d8f-e5e3-4ea0-a411-18cd0652f429-tls-cert\") pod \"authorino-6cd44987b6-v65kl\" (UID: \"78fa3d8f-e5e3-4ea0-a411-18cd0652f429\") " pod="kuadrant-system/authorino-6cd44987b6-v65kl"
Sep 09 23:16:26.659109 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:26.659081    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/78fa3d8f-e5e3-4ea0-a411-18cd0652f429-tls-cert\") pod \"authorino-6cd44987b6-v65kl\" (UID: \"78fa3d8f-e5e3-4ea0-a411-18cd0652f429\") " pod="kuadrant-system/authorino-6cd44987b6-v65kl"
Sep 09 23:16:26.664280 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:26.664255    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrc54\" (UniqueName: \"kubernetes.io/projected/78fa3d8f-e5e3-4ea0-a411-18cd0652f429-kube-api-access-xrc54\") pod \"authorino-6cd44987b6-v65kl\" (UID: \"78fa3d8f-e5e3-4ea0-a411-18cd0652f429\") " pod="kuadrant-system/authorino-6cd44987b6-v65kl"
Sep 09 23:16:26.676061 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:26.676042    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cd44987b6-v65kl"
Sep 09 23:16:26.943019 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:26.942993    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cd44987b6-v65kl"]
Sep 09 23:16:26.945224 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:16:26.945200    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78fa3d8f_e5e3_4ea0_a411_18cd0652f429.slice/crio-b6608487bf62607d56123c297bca956733cffddf9b5f4334a426c598fcd5a7a9 WatchSource:0}: Error finding container b6608487bf62607d56123c297bca956733cffddf9b5f4334a426c598fcd5a7a9: Status 404 returned error can't find the container with id b6608487bf62607d56123c297bca956733cffddf9b5f4334a426c598fcd5a7a9
Sep 09 23:16:27.552748 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:27.552711    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cd44987b6-v65kl" event={"ID":"78fa3d8f-e5e3-4ea0-a411-18cd0652f429","Type":"ContainerStarted","Data":"b6608487bf62607d56123c297bca956733cffddf9b5f4334a426c598fcd5a7a9"}
Sep 09 23:16:28.558236 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:28.558202    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cd44987b6-v65kl" event={"ID":"78fa3d8f-e5e3-4ea0-a411-18cd0652f429","Type":"ContainerStarted","Data":"bb5bc223a5d451cb708ed1db9f8cbcb2b9305d475b03ff64e946838bca67ef52"}
Sep 09 23:16:28.574238 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:28.574192    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6cd44987b6-v65kl" podStartSLOduration=1.6692781399999999 podStartE2EDuration="2.574178147s" totalImagesPullingTime="904.900007ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:28.572597522 +0000 UTC m=+773.355637887" watchObservedRunningTime="2026-09-09 23:16:28.574178147 +0000 UTC m=+773.357218525"
Sep 09 23:16:28.596290 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:28.596261    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-fn5qs"]
Sep 09 23:16:28.596505 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:28.596468    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-fn5qs" podUID="1f76e127-9534-4c30-a2c0-977efaaaa518" containerName="authorino" containerID="cri-o://818533afe06e1b553c4056ec4f8b42d53a46e48537df1e3b6c1bd103d89ba525" gracePeriod=30
Sep 09 23:16:28.832333 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:28.832311    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-fn5qs"
Sep 09 23:16:28.875404 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:28.875376    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64gzh\" (UniqueName: \"kubernetes.io/projected/1f76e127-9534-4c30-a2c0-977efaaaa518-kube-api-access-64gzh\") pod \"1f76e127-9534-4c30-a2c0-977efaaaa518\" (UID: \"1f76e127-9534-4c30-a2c0-977efaaaa518\") "
Sep 09 23:16:28.877391 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:28.877366    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f76e127-9534-4c30-a2c0-977efaaaa518-kube-api-access-64gzh" (OuterVolumeSpecName: "kube-api-access-64gzh") pod "1f76e127-9534-4c30-a2c0-977efaaaa518" (UID: "1f76e127-9534-4c30-a2c0-977efaaaa518"). InnerVolumeSpecName "kube-api-access-64gzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:16:28.976286 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:28.976260    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64gzh\" (UniqueName: \"kubernetes.io/projected/1f76e127-9534-4c30-a2c0-977efaaaa518-kube-api-access-64gzh\") on node \"ip-10-0-131-73.ec2.internal\" DevicePath \"\""
Sep 09 23:16:29.563869 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:29.563835    2562 generic.go:356] "Generic (PLEG): container finished" podID="1f76e127-9534-4c30-a2c0-977efaaaa518" containerID="818533afe06e1b553c4056ec4f8b42d53a46e48537df1e3b6c1bd103d89ba525" exitCode=0
Sep 09 23:16:29.564312 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:29.563879    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-fn5qs"
Sep 09 23:16:29.564312 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:29.563923    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-fn5qs" event={"ID":"1f76e127-9534-4c30-a2c0-977efaaaa518","Type":"ContainerDied","Data":"818533afe06e1b553c4056ec4f8b42d53a46e48537df1e3b6c1bd103d89ba525"}
Sep 09 23:16:29.564312 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:29.563973    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-fn5qs" event={"ID":"1f76e127-9534-4c30-a2c0-977efaaaa518","Type":"ContainerDied","Data":"bebbe4159c79a8ad356e588b748427b7e8369c2c03f95cd30db25eeb9be6fa04"}
Sep 09 23:16:29.564312 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:29.563996    2562 scope.go:117] "RemoveContainer" containerID="818533afe06e1b553c4056ec4f8b42d53a46e48537df1e3b6c1bd103d89ba525"
Sep 09 23:16:29.572294 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:29.572277    2562 scope.go:117] "RemoveContainer" containerID="818533afe06e1b553c4056ec4f8b42d53a46e48537df1e3b6c1bd103d89ba525"
Sep 09 23:16:29.572639 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:16:29.572600    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"818533afe06e1b553c4056ec4f8b42d53a46e48537df1e3b6c1bd103d89ba525\": container with ID starting with 818533afe06e1b553c4056ec4f8b42d53a46e48537df1e3b6c1bd103d89ba525 not found: ID does not exist" containerID="818533afe06e1b553c4056ec4f8b42d53a46e48537df1e3b6c1bd103d89ba525"
Sep 09 23:16:29.572692 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:29.572648    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"818533afe06e1b553c4056ec4f8b42d53a46e48537df1e3b6c1bd103d89ba525"} err="failed to get container status \"818533afe06e1b553c4056ec4f8b42d53a46e48537df1e3b6c1bd103d89ba525\": rpc error: code = NotFound desc = could not find container \"818533afe06e1b553c4056ec4f8b42d53a46e48537df1e3b6c1bd103d89ba525\": container with ID starting with 818533afe06e1b553c4056ec4f8b42d53a46e48537df1e3b6c1bd103d89ba525 not found: ID does not exist"
Sep 09 23:16:29.583792 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:29.583770    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-fn5qs"]
Sep 09 23:16:29.585288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:29.585270    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-fn5qs"]
Sep 09 23:16:29.722473 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:29.722438    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f76e127-9534-4c30-a2c0-977efaaaa518" path="/var/lib/kubelet/pods/1f76e127-9534-4c30-a2c0-977efaaaa518/volumes"
Sep 09 23:16:33.339013 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:33.338976    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:16:33.439759 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:33.439728    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:16:33.487728 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:33.487702    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:16:36.909207 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:36.909171    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:16:37.009240 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:16:37.009207    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:17:09.036299 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:09.036210    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:17:09.135755 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:09.135722    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:17:10.493224 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:10.493173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:17:10.580294 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:10.580258    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:17:10.725229 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:10.725199    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:17:10.825203 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:10.825111    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:17:11.061126 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.061093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:17:11.151830 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.151800    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:17:11.155597 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.155571    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2597q"]
Sep 09 23:17:11.155911 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.155897    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f76e127-9534-4c30-a2c0-977efaaaa518" containerName="authorino"
Sep 09 23:17:11.155956 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.155913    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f76e127-9534-4c30-a2c0-977efaaaa518" containerName="authorino"
Sep 09 23:17:11.156002 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.155976    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f76e127-9534-4c30-a2c0-977efaaaa518" containerName="authorino"
Sep 09 23:17:11.159098 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.159080    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2597q"
Sep 09 23:17:11.162197 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.162180    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4cdmw\""
Sep 09 23:17:11.162571 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.162553    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 09 23:17:11.168498 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.168470    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2597q"]
Sep 09 23:17:11.341737 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.341702    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b931968-d5f9-4bbb-a82d-057b6693b53a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2597q\" (UID: \"5b931968-d5f9-4bbb-a82d-057b6693b53a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2597q"
Sep 09 23:17:11.341919 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.341845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4trh\" (UniqueName: \"kubernetes.io/projected/5b931968-d5f9-4bbb-a82d-057b6693b53a-kube-api-access-m4trh\") pod \"payload-pre-processing-59fbc47bf8-2597q\" (UID: \"5b931968-d5f9-4bbb-a82d-057b6693b53a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2597q"
Sep 09 23:17:11.443000 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.442898    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4trh\" (UniqueName: \"kubernetes.io/projected/5b931968-d5f9-4bbb-a82d-057b6693b53a-kube-api-access-m4trh\") pod \"payload-pre-processing-59fbc47bf8-2597q\" (UID: \"5b931968-d5f9-4bbb-a82d-057b6693b53a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2597q"
Sep 09 23:17:11.443000 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.442947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b931968-d5f9-4bbb-a82d-057b6693b53a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2597q\" (UID: \"5b931968-d5f9-4bbb-a82d-057b6693b53a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2597q"
Sep 09 23:17:11.443629 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.443606    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b931968-d5f9-4bbb-a82d-057b6693b53a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2597q\" (UID: \"5b931968-d5f9-4bbb-a82d-057b6693b53a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2597q"
Sep 09 23:17:11.453641 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.453606    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4trh\" (UniqueName: \"kubernetes.io/projected/5b931968-d5f9-4bbb-a82d-057b6693b53a-kube-api-access-m4trh\") pod \"payload-pre-processing-59fbc47bf8-2597q\" (UID: \"5b931968-d5f9-4bbb-a82d-057b6693b53a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2597q"
Sep 09 23:17:11.470527 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.470490    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2597q"
Sep 09 23:17:11.749058 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:11.748839    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2597q"]
Sep 09 23:17:11.751729 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:17:11.751702    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b931968_d5f9_4bbb_a82d_057b6693b53a.slice/crio-93733afd97d05ff38480174fb921ca1fd50d03185ec4763fba11483eff160a15 WatchSource:0}: Error finding container 93733afd97d05ff38480174fb921ca1fd50d03185ec4763fba11483eff160a15: Status 404 returned error can't find the container with id 93733afd97d05ff38480174fb921ca1fd50d03185ec4763fba11483eff160a15
Sep 09 23:17:12.752705 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:12.752667    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2597q" event={"ID":"5b931968-d5f9-4bbb-a82d-057b6693b53a","Type":"ContainerStarted","Data":"93733afd97d05ff38480174fb921ca1fd50d03185ec4763fba11483eff160a15"}
Sep 09 23:17:14.765323 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:14.765288    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2597q" event={"ID":"5b931968-d5f9-4bbb-a82d-057b6693b53a","Type":"ContainerStarted","Data":"28664a1e690b759a6851ee5365788b04895598ce5dc7ded2390d3e4df9aa7976"}
Sep 09 23:17:14.765833 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:14.765422    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2597q"
Sep 09 23:17:14.781096 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:14.781045    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2597q" podStartSLOduration=1.27573982 podStartE2EDuration="3.781030252s" totalImagesPullingTime="2.505290432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:14.779382313 +0000 UTC m=+819.562422694" watchObservedRunningTime="2026-09-09 23:17:14.781030252 +0000 UTC m=+819.564070667"
Sep 09 23:17:20.681773 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:20.681735    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:17:20.781210 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:20.781174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:17:25.772077 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:25.772046    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2597q"
Sep 09 23:17:27.627941 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:27.627880    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:17:27.729073 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:27.729044    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:17:44.090258 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.090225    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"]
Sep 09 23:17:44.093573 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.093558    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.097032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.096996    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 09 23:17:44.097032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.096998    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 23:17:44.097215 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.097037    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 23:17:44.097215 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.097062    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jr9l5\""
Sep 09 23:17:44.101961 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.101939    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"]
Sep 09 23:17:44.194564 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.194537    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:17:44.204760 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.204735    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.204852 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.204776    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.204900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.204879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.204942 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.204921    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.204981 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.204963    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2kfp\" (UniqueName: \"kubernetes.io/projected/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-kube-api-access-k2kfp\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.205037 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.205025    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.305428 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.305394    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2kfp\" (UniqueName: \"kubernetes.io/projected/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-kube-api-access-k2kfp\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.305600 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.305439    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.305600 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.305468    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.305600 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.305491    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.305600 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.305538    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.305600 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.305562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.305937 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.305912    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.305983 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.305932    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.306075 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.306059    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.307896 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.307876    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.308033 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.308015    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.312262 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.312241    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2kfp\" (UniqueName: \"kubernetes.io/projected/52ff2360-1da2-4e0e-8469-a225d7e2f7f1-kube-api-access-k2kfp\") pod \"e2e-distinct-2-simulated-kserve-859856b874-mmdpm\" (UID: \"52ff2360-1da2-4e0e-8469-a225d7e2f7f1\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.403940 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.403911    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:44.673709 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.673620    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"]
Sep 09 23:17:44.902276 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:44.902235    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" event={"ID":"52ff2360-1da2-4e0e-8469-a225d7e2f7f1","Type":"ContainerStarted","Data":"dffc3076bd3a137914e03dc6fa53cbd5566590a5dfd8d12d83bd118f0895763d"}
Sep 09 23:17:45.908081 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:45.908054    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" event={"ID":"52ff2360-1da2-4e0e-8469-a225d7e2f7f1","Type":"ContainerStarted","Data":"c21401f6ec645330d52f95afb569050eecbbd082e95b2dd954db4054f4c7d87f"}
Sep 09 23:17:45.926390 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:45.926320    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podStartSLOduration=0.765639544 podStartE2EDuration="1.926297997s" totalImagesPullingTime="1.160658453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:45.92422051 +0000 UTC m=+850.707260898" watchObservedRunningTime="2026-09-09 23:17:45.926297997 +0000 UTC m=+850.709338383"
Sep 09 23:17:46.913641 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:46.913605    2562 generic.go:356] "Generic (PLEG): container finished" podID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1" containerID="c21401f6ec645330d52f95afb569050eecbbd082e95b2dd954db4054f4c7d87f" exitCode=0
Sep 09 23:17:46.914070 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:46.913690    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" event={"ID":"52ff2360-1da2-4e0e-8469-a225d7e2f7f1","Type":"ContainerDied","Data":"c21401f6ec645330d52f95afb569050eecbbd082e95b2dd954db4054f4c7d87f"}
Sep 09 23:17:46.914070 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:46.913898    2562 scope.go:117] "RemoveContainer" containerID="c21401f6ec645330d52f95afb569050eecbbd082e95b2dd954db4054f4c7d87f"
Sep 09 23:17:47.920511 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:47.920476    2562 generic.go:356] "Generic (PLEG): container finished" podID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1" containerID="4b872a5bbe2d89e7f09a760a790fa68d8a76bd3cb800967a852481b73e5e6b5c" exitCode=0
Sep 09 23:17:47.920910 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:47.920557    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" event={"ID":"52ff2360-1da2-4e0e-8469-a225d7e2f7f1","Type":"ContainerDied","Data":"4b872a5bbe2d89e7f09a760a790fa68d8a76bd3cb800967a852481b73e5e6b5c"}
Sep 09 23:17:47.920910 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:47.920653    2562 scope.go:117] "RemoveContainer" containerID="c21401f6ec645330d52f95afb569050eecbbd082e95b2dd954db4054f4c7d87f"
Sep 09 23:17:47.920989 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:47.920959    2562 scope.go:117] "RemoveContainer" containerID="4b872a5bbe2d89e7f09a760a790fa68d8a76bd3cb800967a852481b73e5e6b5c"
Sep 09 23:17:47.921171 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:17:47.921151    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:17:48.926455 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:48.926426    2562 scope.go:117] "RemoveContainer" containerID="4b872a5bbe2d89e7f09a760a790fa68d8a76bd3cb800967a852481b73e5e6b5c"
Sep 09 23:17:48.926820 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:17:48.926597    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:17:54.404895 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:54.404863    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:54.405251 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:54.404918    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:54.405251 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:54.404934    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:54.405251 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:54.404948    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:17:54.405401 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:54.405276    2562 scope.go:117] "RemoveContainer" containerID="4b872a5bbe2d89e7f09a760a790fa68d8a76bd3cb800967a852481b73e5e6b5c"
Sep 09 23:17:54.405488 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:17:54.405468    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:17:57.782696 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:17:57.782650    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:18:08.717777 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:08.717746    2562 scope.go:117] "RemoveContainer" containerID="4b872a5bbe2d89e7f09a760a790fa68d8a76bd3cb800967a852481b73e5e6b5c"
Sep 09 23:18:08.981205 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:08.981135    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:18:09.016960 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:09.016931    2562 generic.go:356] "Generic (PLEG): container finished" podID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1" containerID="b32e03c6c314891b1b77b9ad04576ae524ed5a7b4ccd7f078932e28cbc81a657" exitCode=0
Sep 09 23:18:09.017063 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:09.016996    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" event={"ID":"52ff2360-1da2-4e0e-8469-a225d7e2f7f1","Type":"ContainerDied","Data":"b32e03c6c314891b1b77b9ad04576ae524ed5a7b4ccd7f078932e28cbc81a657"}
Sep 09 23:18:09.017063 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:09.017044    2562 scope.go:117] "RemoveContainer" containerID="4b872a5bbe2d89e7f09a760a790fa68d8a76bd3cb800967a852481b73e5e6b5c"
Sep 09 23:18:09.017414 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:09.017390    2562 scope.go:117] "RemoveContainer" containerID="b32e03c6c314891b1b77b9ad04576ae524ed5a7b4ccd7f078932e28cbc81a657"
Sep 09 23:18:09.017627 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:18:09.017601    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:18:14.404950 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:14.404893    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:18:14.405400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:14.404988    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:18:14.405400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:14.405005    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:18:14.405400 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:14.405018    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:18:14.405506 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:14.405430    2562 scope.go:117] "RemoveContainer" containerID="b32e03c6c314891b1b77b9ad04576ae524ed5a7b4ccd7f078932e28cbc81a657"
Sep 09 23:18:14.405631 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:18:14.405611    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:18:19.991749 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:19.991713    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"]
Sep 09 23:18:19.996990 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:19.996968    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:19.999448 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:19.999427    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 09 23:18:20.005612 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.005591    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"]
Sep 09 23:18:20.027782 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.027755    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrhnm\" (UniqueName: \"kubernetes.io/projected/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-kube-api-access-qrhnm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.027940 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.027789    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.027940 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.027810    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.027940 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.027840    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.028407 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.027984    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.028407 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.028021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.028677 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.028632    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:18:20.129205 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.129172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrhnm\" (UniqueName: \"kubernetes.io/projected/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-kube-api-access-qrhnm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.129205 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.129207    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.129507 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.129230    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.129507 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.129254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.129507 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.129302    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.129507 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.129316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.129727 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.129663    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.129807 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.129777    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.129934 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.129864    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.131637 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.131612    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.131771 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.131755    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.136924 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.136903    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrhnm\" (UniqueName: \"kubernetes.io/projected/8b4c9592-dedb-4fbf-86a5-79f5ce072dcd-kube-api-access-qrhnm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qdzx\" (UID: \"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.308987 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.308908    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:20.579244 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:20.579222    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"]
Sep 09 23:18:20.581609 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:18:20.581582    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b4c9592_dedb_4fbf_86a5_79f5ce072dcd.slice/crio-a7842f44b059b2d0dec69ab0e1a2643348ec7bee968aa4a73a7dfb021f599c36 WatchSource:0}: Error finding container a7842f44b059b2d0dec69ab0e1a2643348ec7bee968aa4a73a7dfb021f599c36: Status 404 returned error can't find the container with id a7842f44b059b2d0dec69ab0e1a2643348ec7bee968aa4a73a7dfb021f599c36
Sep 09 23:18:21.075330 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:21.075299    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx" event={"ID":"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd","Type":"ContainerStarted","Data":"ece8f4302441440776e5e521295eaf7b3bae7091c3a5a63a43c8df4e20d3fbdf"}
Sep 09 23:18:21.075763 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:21.075361    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx" event={"ID":"8b4c9592-dedb-4fbf-86a5-79f5ce072dcd","Type":"ContainerStarted","Data":"a7842f44b059b2d0dec69ab0e1a2643348ec7bee968aa4a73a7dfb021f599c36"}
Sep 09 23:18:21.092290 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:21.092203    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx" podStartSLOduration=1.8901074549999999 podStartE2EDuration="2.092187285s" totalImagesPullingTime="202.07983ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:21.091106541 +0000 UTC m=+885.874146925" watchObservedRunningTime="2026-09-09 23:18:21.092187285 +0000 UTC m=+885.875227669"
Sep 09 23:18:24.191765 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:24.191738    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:18:25.719884 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:25.719857    2562 scope.go:117] "RemoveContainer" containerID="b32e03c6c314891b1b77b9ad04576ae524ed5a7b4ccd7f078932e28cbc81a657"
Sep 09 23:18:25.720328 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:18:25.720047    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:18:30.309397 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:30.309326    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:30.309769 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:30.309411    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:30.322482 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:30.322455    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:31.131846 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:31.131818    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qdzx"
Sep 09 23:18:33.422015 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:33.421976    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:18:37.716800 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:37.716762    2562 scope.go:117] "RemoveContainer" containerID="b32e03c6c314891b1b77b9ad04576ae524ed5a7b4ccd7f078932e28cbc81a657"
Sep 09 23:18:38.155648 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:38.155619    2562 generic.go:356] "Generic (PLEG): container finished" podID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1" containerID="dc73f6e50c25bf20cc7a6d0f598d7aff9f663868e0c95d32eef5e634c4ea1d62" exitCode=0
Sep 09 23:18:38.155825 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:38.155703    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" event={"ID":"52ff2360-1da2-4e0e-8469-a225d7e2f7f1","Type":"ContainerDied","Data":"dc73f6e50c25bf20cc7a6d0f598d7aff9f663868e0c95d32eef5e634c4ea1d62"}
Sep 09 23:18:38.155825 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:38.155768    2562 scope.go:117] "RemoveContainer" containerID="b32e03c6c314891b1b77b9ad04576ae524ed5a7b4ccd7f078932e28cbc81a657"
Sep 09 23:18:38.156105 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:38.156091    2562 scope.go:117] "RemoveContainer" containerID="dc73f6e50c25bf20cc7a6d0f598d7aff9f663868e0c95d32eef5e634c4ea1d62"
Sep 09 23:18:38.156286 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:18:38.156270    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:18:41.382870 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.382836    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"]
Sep 09 23:18:41.387442 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.387419    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.389803 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.389780    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 09 23:18:41.400929 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.400906    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"]
Sep 09 23:18:41.404041 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.404021    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:18:41.513119 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.513082    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0faee5b-901c-476f-b3f4-4f43eb219036-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.513119 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.513121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0faee5b-901c-476f-b3f4-4f43eb219036-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.513404 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.513150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vs8p\" (UniqueName: \"kubernetes.io/projected/b0faee5b-901c-476f-b3f4-4f43eb219036-kube-api-access-5vs8p\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.513404 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.513177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0faee5b-901c-476f-b3f4-4f43eb219036-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.513404 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.513248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0faee5b-901c-476f-b3f4-4f43eb219036-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.513404 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.513379    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0faee5b-901c-476f-b3f4-4f43eb219036-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.614144 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.614110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0faee5b-901c-476f-b3f4-4f43eb219036-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.614282 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.614155    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0faee5b-901c-476f-b3f4-4f43eb219036-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.614282 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.614187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0faee5b-901c-476f-b3f4-4f43eb219036-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.614282 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.614220    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vs8p\" (UniqueName: \"kubernetes.io/projected/b0faee5b-901c-476f-b3f4-4f43eb219036-kube-api-access-5vs8p\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.614282 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.614249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0faee5b-901c-476f-b3f4-4f43eb219036-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.614451 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.614284    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0faee5b-901c-476f-b3f4-4f43eb219036-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.614604 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.614583    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0faee5b-901c-476f-b3f4-4f43eb219036-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.614651 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.614632    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0faee5b-901c-476f-b3f4-4f43eb219036-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.614714 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.614683    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0faee5b-901c-476f-b3f4-4f43eb219036-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.616604 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.616571    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0faee5b-901c-476f-b3f4-4f43eb219036-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.616763 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.616748    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0faee5b-901c-476f-b3f4-4f43eb219036-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.621975 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.621936    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vs8p\" (UniqueName: \"kubernetes.io/projected/b0faee5b-901c-476f-b3f4-4f43eb219036-kube-api-access-5vs8p\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg\" (UID: \"b0faee5b-901c-476f-b3f4-4f43eb219036\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.696512 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.696456    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:41.967900 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:41.967848    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"]
Sep 09 23:18:41.970468 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:18:41.970443    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0faee5b_901c_476f_b3f4_4f43eb219036.slice/crio-643a6dae47a2bf5c7e2c2bc66e1a699766316de06d4b0cfe434f5d1a953a4a4b WatchSource:0}: Error finding container 643a6dae47a2bf5c7e2c2bc66e1a699766316de06d4b0cfe434f5d1a953a4a4b: Status 404 returned error can't find the container with id 643a6dae47a2bf5c7e2c2bc66e1a699766316de06d4b0cfe434f5d1a953a4a4b
Sep 09 23:18:42.175827 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:42.175787    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" event={"ID":"b0faee5b-901c-476f-b3f4-4f43eb219036","Type":"ContainerStarted","Data":"643a6dae47a2bf5c7e2c2bc66e1a699766316de06d4b0cfe434f5d1a953a4a4b"}
Sep 09 23:18:43.182428 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:43.182393    2562 generic.go:356] "Generic (PLEG): container finished" podID="b0faee5b-901c-476f-b3f4-4f43eb219036" containerID="640cf4d44bca113c4df007ac7fe43a20768c7f29a941deebe1631b28ab507138" exitCode=0
Sep 09 23:18:43.182844 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:43.182442    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" event={"ID":"b0faee5b-901c-476f-b3f4-4f43eb219036","Type":"ContainerDied","Data":"640cf4d44bca113c4df007ac7fe43a20768c7f29a941deebe1631b28ab507138"}
Sep 09 23:18:43.182844 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:43.182797    2562 scope.go:117] "RemoveContainer" containerID="640cf4d44bca113c4df007ac7fe43a20768c7f29a941deebe1631b28ab507138"
Sep 09 23:18:44.190724 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:44.190693    2562 generic.go:356] "Generic (PLEG): container finished" podID="b0faee5b-901c-476f-b3f4-4f43eb219036" containerID="68e1a3ad431cffbcb63e791f1a2185c3378e9f6bcb9eb32169bc80adce2a4f0f" exitCode=0
Sep 09 23:18:44.191157 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:44.190783    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" event={"ID":"b0faee5b-901c-476f-b3f4-4f43eb219036","Type":"ContainerDied","Data":"68e1a3ad431cffbcb63e791f1a2185c3378e9f6bcb9eb32169bc80adce2a4f0f"}
Sep 09 23:18:44.191157 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:44.190845    2562 scope.go:117] "RemoveContainer" containerID="640cf4d44bca113c4df007ac7fe43a20768c7f29a941deebe1631b28ab507138"
Sep 09 23:18:44.191157 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:44.191107    2562 scope.go:117] "RemoveContainer" containerID="68e1a3ad431cffbcb63e791f1a2185c3378e9f6bcb9eb32169bc80adce2a4f0f"
Sep 09 23:18:44.191369 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:18:44.191330    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:18:44.404874 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:44.404837    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:18:44.405031 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:44.404902    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:18:44.405031 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:44.404922    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:18:44.405031 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:44.404934    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:18:44.405317 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:44.405291    2562 scope.go:117] "RemoveContainer" containerID="dc73f6e50c25bf20cc7a6d0f598d7aff9f663868e0c95d32eef5e634c4ea1d62"
Sep 09 23:18:44.405528 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:18:44.405510    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:18:45.196814 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:45.196786    2562 scope.go:117] "RemoveContainer" containerID="68e1a3ad431cffbcb63e791f1a2185c3378e9f6bcb9eb32169bc80adce2a4f0f"
Sep 09 23:18:45.197167 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:18:45.196964    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:18:51.697398 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:51.697335    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:51.697873 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:51.697409    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:51.697873 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:51.697424    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:51.697873 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:51.697437    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:18:51.698029 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:51.697905    2562 scope.go:117] "RemoveContainer" containerID="68e1a3ad431cffbcb63e791f1a2185c3378e9f6bcb9eb32169bc80adce2a4f0f"
Sep 09 23:18:51.698135 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:18:51.698110    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:18:58.717240 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:58.717209    2562 scope.go:117] "RemoveContainer" containerID="dc73f6e50c25bf20cc7a6d0f598d7aff9f663868e0c95d32eef5e634c4ea1d62"
Sep 09 23:18:58.717630 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:18:58.717401    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:18:59.976326 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:18:59.976286    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:19:03.717188 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:03.717161    2562 scope.go:117] "RemoveContainer" containerID="68e1a3ad431cffbcb63e791f1a2185c3378e9f6bcb9eb32169bc80adce2a4f0f"
Sep 09 23:19:04.285710 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:04.285621    2562 generic.go:356] "Generic (PLEG): container finished" podID="b0faee5b-901c-476f-b3f4-4f43eb219036" containerID="2456e6c4ddd032f131ab119a7209f108c36d39c0de15cec7813c9738ccb124e5" exitCode=0
Sep 09 23:19:04.285710 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:04.285661    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" event={"ID":"b0faee5b-901c-476f-b3f4-4f43eb219036","Type":"ContainerDied","Data":"2456e6c4ddd032f131ab119a7209f108c36d39c0de15cec7813c9738ccb124e5"}
Sep 09 23:19:04.285710 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:04.285705    2562 scope.go:117] "RemoveContainer" containerID="68e1a3ad431cffbcb63e791f1a2185c3378e9f6bcb9eb32169bc80adce2a4f0f"
Sep 09 23:19:04.286114 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:04.286098    2562 scope.go:117] "RemoveContainer" containerID="2456e6c4ddd032f131ab119a7209f108c36d39c0de15cec7813c9738ccb124e5"
Sep 09 23:19:04.286293 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:19:04.286269    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:19:09.717483 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:09.717448    2562 scope.go:117] "RemoveContainer" containerID="dc73f6e50c25bf20cc7a6d0f598d7aff9f663868e0c95d32eef5e634c4ea1d62"
Sep 09 23:19:09.718061 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:19:09.717623    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:19:11.697362 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:11.697319    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:19:11.697729 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:11.697390    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:19:11.697729 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:11.697401    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:19:11.697729 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:11.697411    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:19:11.697828 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:11.697740    2562 scope.go:117] "RemoveContainer" containerID="2456e6c4ddd032f131ab119a7209f108c36d39c0de15cec7813c9738ccb124e5"
Sep 09 23:19:11.697914 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:19:11.697896    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:19:21.716855 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:21.716826    2562 scope.go:117] "RemoveContainer" containerID="dc73f6e50c25bf20cc7a6d0f598d7aff9f663868e0c95d32eef5e634c4ea1d62"
Sep 09 23:19:22.368768 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:22.368682    2562 generic.go:356] "Generic (PLEG): container finished" podID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1" containerID="41eccfdffb745497c6e886e0de4605099186eb8f33081fcccf1d3671b7d96ab1" exitCode=0
Sep 09 23:19:22.368768 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:22.368754    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" event={"ID":"52ff2360-1da2-4e0e-8469-a225d7e2f7f1","Type":"ContainerDied","Data":"41eccfdffb745497c6e886e0de4605099186eb8f33081fcccf1d3671b7d96ab1"}
Sep 09 23:19:22.368956 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:22.368816    2562 scope.go:117] "RemoveContainer" containerID="dc73f6e50c25bf20cc7a6d0f598d7aff9f663868e0c95d32eef5e634c4ea1d62"
Sep 09 23:19:22.369167 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:22.369147    2562 scope.go:117] "RemoveContainer" containerID="41eccfdffb745497c6e886e0de4605099186eb8f33081fcccf1d3671b7d96ab1"
Sep 09 23:19:22.369421 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:19:22.369399    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:19:23.717193 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:23.717164    2562 scope.go:117] "RemoveContainer" containerID="2456e6c4ddd032f131ab119a7209f108c36d39c0de15cec7813c9738ccb124e5"
Sep 09 23:19:23.717639 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:19:23.717396    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:19:24.404142 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:24.404108    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:19:24.404315 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:24.404165    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:19:24.404315 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:24.404184    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:19:24.404315 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:24.404201    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:19:24.404593 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:24.404578    2562 scope.go:117] "RemoveContainer" containerID="41eccfdffb745497c6e886e0de4605099186eb8f33081fcccf1d3671b7d96ab1"
Sep 09 23:19:24.404785 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:19:24.404766    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:19:27.443812 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:27.443782    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:19:35.719182 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:35.719154    2562 scope.go:117] "RemoveContainer" containerID="41eccfdffb745497c6e886e0de4605099186eb8f33081fcccf1d3671b7d96ab1"
Sep 09 23:19:35.719617 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:19:35.719336    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:19:36.717122 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:36.717092    2562 scope.go:117] "RemoveContainer" containerID="2456e6c4ddd032f131ab119a7209f108c36d39c0de15cec7813c9738ccb124e5"
Sep 09 23:19:37.440801 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:37.440770    2562 generic.go:356] "Generic (PLEG): container finished" podID="b0faee5b-901c-476f-b3f4-4f43eb219036" containerID="6300d2ffa635782250c93c19791b506e4ef939957f57e62e5a0c1087f083fb11" exitCode=0
Sep 09 23:19:37.441269 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:37.440841    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" event={"ID":"b0faee5b-901c-476f-b3f4-4f43eb219036","Type":"ContainerDied","Data":"6300d2ffa635782250c93c19791b506e4ef939957f57e62e5a0c1087f083fb11"}
Sep 09 23:19:37.441269 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:37.440887    2562 scope.go:117] "RemoveContainer" containerID="2456e6c4ddd032f131ab119a7209f108c36d39c0de15cec7813c9738ccb124e5"
Sep 09 23:19:37.441423 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:37.441286    2562 scope.go:117] "RemoveContainer" containerID="6300d2ffa635782250c93c19791b506e4ef939957f57e62e5a0c1087f083fb11"
Sep 09 23:19:37.441560 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:19:37.441535    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:19:41.697191 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:41.697158    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:19:41.697191 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:41.697197    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:19:41.697690 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:41.697232    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:19:41.697690 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:41.697264    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:19:41.697690 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:41.697521    2562 scope.go:117] "RemoveContainer" containerID="6300d2ffa635782250c93c19791b506e4ef939957f57e62e5a0c1087f083fb11"
Sep 09 23:19:41.697690 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:19:41.697676    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:19:42.467716 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:42.467690    2562 scope.go:117] "RemoveContainer" containerID="6300d2ffa635782250c93c19791b506e4ef939957f57e62e5a0c1087f083fb11"
Sep 09 23:19:42.467938 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:19:42.467915    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:19:48.717455 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:48.717421    2562 scope.go:117] "RemoveContainer" containerID="41eccfdffb745497c6e886e0de4605099186eb8f33081fcccf1d3671b7d96ab1"
Sep 09 23:19:48.717907 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:19:48.717581    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:19:54.716539 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:19:54.716504    2562 scope.go:117] "RemoveContainer" containerID="6300d2ffa635782250c93c19791b506e4ef939957f57e62e5a0c1087f083fb11"
Sep 09 23:19:54.717020 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:19:54.716684    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:20:02.717222 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:02.717147    2562 scope.go:117] "RemoveContainer" containerID="41eccfdffb745497c6e886e0de4605099186eb8f33081fcccf1d3671b7d96ab1"
Sep 09 23:20:02.717682 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:20:02.717390    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:20:07.717328 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:07.717294    2562 scope.go:117] "RemoveContainer" containerID="6300d2ffa635782250c93c19791b506e4ef939957f57e62e5a0c1087f083fb11"
Sep 09 23:20:07.717738 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:20:07.717501    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:20:14.717032 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:14.717000    2562 scope.go:117] "RemoveContainer" containerID="41eccfdffb745497c6e886e0de4605099186eb8f33081fcccf1d3671b7d96ab1"
Sep 09 23:20:14.717464 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:20:14.717185    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:20:20.716674 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:20.716645    2562 scope.go:117] "RemoveContainer" containerID="6300d2ffa635782250c93c19791b506e4ef939957f57e62e5a0c1087f083fb11"
Sep 09 23:20:20.717065 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:20.716916    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:20:21.644315 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:21.644282    2562 generic.go:356] "Generic (PLEG): container finished" podID="b0faee5b-901c-476f-b3f4-4f43eb219036" containerID="001413a4c7b1d94339f9c6966fbdb1c9ab9567256067f258241b0fdd0ca3b055" exitCode=0
Sep 09 23:20:21.644489 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:21.644367    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" event={"ID":"b0faee5b-901c-476f-b3f4-4f43eb219036","Type":"ContainerDied","Data":"001413a4c7b1d94339f9c6966fbdb1c9ab9567256067f258241b0fdd0ca3b055"}
Sep 09 23:20:21.644489 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:21.644423    2562 scope.go:117] "RemoveContainer" containerID="6300d2ffa635782250c93c19791b506e4ef939957f57e62e5a0c1087f083fb11"
Sep 09 23:20:21.644785 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:21.644768    2562 scope.go:117] "RemoveContainer" containerID="001413a4c7b1d94339f9c6966fbdb1c9ab9567256067f258241b0fdd0ca3b055"
Sep 09 23:20:21.644969 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:20:21.644947    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:20:21.697207 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:21.697177    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:20:21.697314 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:21.697225    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:20:21.697314 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:21.697242    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:20:21.697314 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:21.697256    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:20:22.650952 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:22.650926    2562 scope.go:117] "RemoveContainer" containerID="001413a4c7b1d94339f9c6966fbdb1c9ab9567256067f258241b0fdd0ca3b055"
Sep 09 23:20:22.651321 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:20:22.651082    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:20:25.718756 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:25.718722    2562 scope.go:117] "RemoveContainer" containerID="41eccfdffb745497c6e886e0de4605099186eb8f33081fcccf1d3671b7d96ab1"
Sep 09 23:20:25.719149 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:20:25.718977    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:20:36.716759 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:36.716729    2562 scope.go:117] "RemoveContainer" containerID="001413a4c7b1d94339f9c6966fbdb1c9ab9567256067f258241b0fdd0ca3b055"
Sep 09 23:20:36.717211 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:20:36.716890    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:20:38.717224 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:38.717192    2562 scope.go:117] "RemoveContainer" containerID="41eccfdffb745497c6e886e0de4605099186eb8f33081fcccf1d3671b7d96ab1"
Sep 09 23:20:38.717631 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:20:38.717411    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:20:49.717477 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:49.717439    2562 scope.go:117] "RemoveContainer" containerID="001413a4c7b1d94339f9c6966fbdb1c9ab9567256067f258241b0fdd0ca3b055"
Sep 09 23:20:49.717965 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:20:49.717619    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:20:50.717112 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:50.717084    2562 scope.go:117] "RemoveContainer" containerID="41eccfdffb745497c6e886e0de4605099186eb8f33081fcccf1d3671b7d96ab1"
Sep 09 23:20:51.780671 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:51.780638    2562 generic.go:356] "Generic (PLEG): container finished" podID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1" containerID="e927ebc53f366de798bd181f544095f119ded033e805175ba25fceeab3c6a9b9" exitCode=0
Sep 09 23:20:51.781068 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:51.780682    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" event={"ID":"52ff2360-1da2-4e0e-8469-a225d7e2f7f1","Type":"ContainerDied","Data":"e927ebc53f366de798bd181f544095f119ded033e805175ba25fceeab3c6a9b9"}
Sep 09 23:20:51.781068 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:51.780738    2562 scope.go:117] "RemoveContainer" containerID="41eccfdffb745497c6e886e0de4605099186eb8f33081fcccf1d3671b7d96ab1"
Sep 09 23:20:51.781172 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:51.781077    2562 scope.go:117] "RemoveContainer" containerID="e927ebc53f366de798bd181f544095f119ded033e805175ba25fceeab3c6a9b9"
Sep 09 23:20:51.781315 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:20:51.781292    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:20:54.404157 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:54.404120    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:20:54.404564 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:54.404189    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:20:54.404564 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:54.404209    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:20:54.404564 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:54.404223    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm"
Sep 09 23:20:54.404682 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:20:54.404652    2562 scope.go:117] "RemoveContainer" containerID="e927ebc53f366de798bd181f544095f119ded033e805175ba25fceeab3c6a9b9"
Sep 09 23:20:54.404853 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:20:54.404835    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:21:03.717671 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:03.717632    2562 scope.go:117] "RemoveContainer" containerID="001413a4c7b1d94339f9c6966fbdb1c9ab9567256067f258241b0fdd0ca3b055"
Sep 09 23:21:03.718101 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:21:03.717791    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:21:05.718599 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:05.718568    2562 scope.go:117] "RemoveContainer" containerID="e927ebc53f366de798bd181f544095f119ded033e805175ba25fceeab3c6a9b9"
Sep 09 23:21:05.719090 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:21:05.718761    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:21:16.716541 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:16.716507    2562 scope.go:117] "RemoveContainer" containerID="001413a4c7b1d94339f9c6966fbdb1c9ab9567256067f258241b0fdd0ca3b055"
Sep 09 23:21:16.717040 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:21:16.716690    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:21:17.717539 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:17.717507    2562 scope.go:117] "RemoveContainer" containerID="e927ebc53f366de798bd181f544095f119ded033e805175ba25fceeab3c6a9b9"
Sep 09 23:21:17.717905 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:21:17.717682    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:21:28.717288 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:28.717203    2562 scope.go:117] "RemoveContainer" containerID="001413a4c7b1d94339f9c6966fbdb1c9ab9567256067f258241b0fdd0ca3b055"
Sep 09 23:21:28.717781 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:21:28.717425    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:21:31.717518 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:31.717479    2562 scope.go:117] "RemoveContainer" containerID="e927ebc53f366de798bd181f544095f119ded033e805175ba25fceeab3c6a9b9"
Sep 09 23:21:31.718023 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:21:31.717669    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:21:41.717360 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:41.717319    2562 scope.go:117] "RemoveContainer" containerID="001413a4c7b1d94339f9c6966fbdb1c9ab9567256067f258241b0fdd0ca3b055"
Sep 09 23:21:42.010082 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:42.010053    2562 generic.go:356] "Generic (PLEG): container finished" podID="b0faee5b-901c-476f-b3f4-4f43eb219036" containerID="5ac3b9a2141b0546a22bab3d553e4fa70927f0ac7bfbb14ad4bb6c03312c3d01" exitCode=0
Sep 09 23:21:42.010220 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:42.010127    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" event={"ID":"b0faee5b-901c-476f-b3f4-4f43eb219036","Type":"ContainerDied","Data":"5ac3b9a2141b0546a22bab3d553e4fa70927f0ac7bfbb14ad4bb6c03312c3d01"}
Sep 09 23:21:42.010220 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:42.010176    2562 scope.go:117] "RemoveContainer" containerID="001413a4c7b1d94339f9c6966fbdb1c9ab9567256067f258241b0fdd0ca3b055"
Sep 09 23:21:42.010535 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:42.010516    2562 scope.go:117] "RemoveContainer" containerID="5ac3b9a2141b0546a22bab3d553e4fa70927f0ac7bfbb14ad4bb6c03312c3d01"
Sep 09 23:21:42.010720 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:21:42.010699    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:21:42.717086 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:42.717053    2562 scope.go:117] "RemoveContainer" containerID="e927ebc53f366de798bd181f544095f119ded033e805175ba25fceeab3c6a9b9"
Sep 09 23:21:42.717264 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:21:42.717212    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:21:51.697020 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:51.696983    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:21:51.697432 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:51.697042    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:21:51.697432 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:51.697056    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:21:51.697432 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:51.697066    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg"
Sep 09 23:21:51.697554 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:51.697475    2562 scope.go:117] "RemoveContainer" containerID="5ac3b9a2141b0546a22bab3d553e4fa70927f0ac7bfbb14ad4bb6c03312c3d01"
Sep 09 23:21:51.697709 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:21:51.697687    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:21:54.717413 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:21:54.717378    2562 scope.go:117] "RemoveContainer" containerID="e927ebc53f366de798bd181f544095f119ded033e805175ba25fceeab3c6a9b9"
Sep 09 23:21:54.717811 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:21:54.717591    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:22:02.717658 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:02.717624    2562 scope.go:117] "RemoveContainer" containerID="5ac3b9a2141b0546a22bab3d553e4fa70927f0ac7bfbb14ad4bb6c03312c3d01"
Sep 09 23:22:02.718124 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:22:02.717796    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:22:06.716599 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:06.716567    2562 scope.go:117] "RemoveContainer" containerID="e927ebc53f366de798bd181f544095f119ded033e805175ba25fceeab3c6a9b9"
Sep 09 23:22:06.716993 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:22:06.716746    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:22:17.717204 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:17.717169    2562 scope.go:117] "RemoveContainer" containerID="5ac3b9a2141b0546a22bab3d553e4fa70927f0ac7bfbb14ad4bb6c03312c3d01"
Sep 09 23:22:17.717640 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:22:17.717325    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:22:20.717026 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:20.716991    2562 scope.go:117] "RemoveContainer" containerID="e927ebc53f366de798bd181f544095f119ded033e805175ba25fceeab3c6a9b9"
Sep 09 23:22:20.717425 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:22:20.717185    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:22:25.300622 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:25.300587    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cd44987b6-v65kl_78fa3d8f-e5e3-4ea0-a411-18cd0652f429/authorino/0.log"
Sep 09 23:22:30.658914 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:30.658878    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:31.270432 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:31.270400    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cbb89f58-tqm4v_9b22aea7-0279-4345-bc72-cb92a46b1f7d/copy-manifests/0.log"
Sep 09 23:22:31.282930 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:31.282896    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cbb89f58-tqm4v_9b22aea7-0279-4345-bc72-cb92a46b1f7d/manager/0.log"
Sep 09 23:22:31.716811 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:31.716772    2562 scope.go:117] "RemoveContainer" containerID="5ac3b9a2141b0546a22bab3d553e4fa70927f0ac7bfbb14ad4bb6c03312c3d01"
Sep 09 23:22:31.717290 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:22:31.717011    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:22:31.733571 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:31.733546    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-gn7d8_b515cad5-5189-4769-b7f7-9970ab43e035/postgres/0.log"
Sep 09 23:22:32.493685 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:32.493649    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cd44987b6-v65kl_78fa3d8f-e5e3-4ea0-a411-18cd0652f429/authorino/0.log"
Sep 09 23:22:32.709576 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:32.709548    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-dckpb_5ee9ab2a-cf5b-46e2-928f-5ea719cf9a43/manager/0.log"
Sep 09 23:22:32.817999 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:32.817919    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-9tpn9_b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a/kuadrant-console-plugin/0.log"
Sep 09 23:22:33.717875 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:33.717814    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55cf6889dc-ldjc4_53980b28-324a-463f-a182-8790e00fd9d5/kube-auth-proxy/0.log"
Sep 09 23:22:34.040825 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:34.040716    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2597q_5b931968-d5f9-4bbb-a82d-057b6693b53a/payload-pre-processing/0.log"
Sep 09 23:22:34.256555 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:34.256527    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d775859d6-bqmkj_d313f23b-e292-497c-93e9-9c321609462e/router/0.log"
Sep 09 23:22:34.590060 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:34.590028    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-859856b874-mmdpm_52ff2360-1da2-4e0e-8469-a225d7e2f7f1/main/5.log"
Sep 09 23:22:34.914955 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:34.914921    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-4qdzx_8b4c9592-dedb-4fbf-86a5-79f5ce072dcd/main/0.log"
Sep 09 23:22:35.238319 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:35.238238    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_b0faee5b-901c-476f-b3f4-4f43eb219036/main/5.log"
Sep 09 23:22:35.718895 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:35.718869    2562 scope.go:117] "RemoveContainer" containerID="e927ebc53f366de798bd181f544095f119ded033e805175ba25fceeab3c6a9b9"
Sep 09 23:22:35.719093 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:22:35.719075    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:22:40.935929 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:40.935896    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:41.030415 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:41.030383    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:42.717711 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:42.717673    2562 scope.go:117] "RemoveContainer" containerID="5ac3b9a2141b0546a22bab3d553e4fa70927f0ac7bfbb14ad4bb6c03312c3d01"
Sep 09 23:22:42.718112 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:22:42.717840    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:22:43.858298 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:43.858261    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tblgp_b32f3790-a36e-4aeb-ac84-96e6ce77d480/global-pull-secret-syncer/0.log"
Sep 09 23:22:43.899402 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:43.899374    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5rbbz_fdbd95d9-1df0-4a1d-a42e-e1c93b3c5bea/konnectivity-agent/0.log"
Sep 09 23:22:43.975052 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:43.975020    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-73.ec2.internal_afe036642cdfcb6c198b1022c1ca77eb/haproxy/0.log"
Sep 09 23:22:47.716976 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:47.716936    2562 scope.go:117] "RemoveContainer" containerID="e927ebc53f366de798bd181f544095f119ded033e805175ba25fceeab3c6a9b9"
Sep 09 23:22:47.717484 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:22:47.717152    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:22:47.964810 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:47.964777    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cd44987b6-v65kl_78fa3d8f-e5e3-4ea0-a411-18cd0652f429/authorino/0.log"
Sep 09 23:22:48.122542 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:48.122459    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-dckpb_5ee9ab2a-cf5b-46e2-928f-5ea719cf9a43/manager/0.log"
Sep 09 23:22:48.241382 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:48.241334    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-9tpn9_b1a6f3c2-d7e6-4d67-a36b-4bec27b1fd8a/kuadrant-console-plugin/0.log"
Sep 09 23:22:50.411819 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:50.411791    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-8zbnp_eae5ea0f-bf18-4270-bf88-4564d3876dfd/kube-state-metrics/0.log"
Sep 09 23:22:50.435547 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:50.435521    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-8zbnp_eae5ea0f-bf18-4270-bf88-4564d3876dfd/kube-rbac-proxy-main/0.log"
Sep 09 23:22:50.470390 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:50.470358    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-8zbnp_eae5ea0f-bf18-4270-bf88-4564d3876dfd/kube-rbac-proxy-self/0.log"
Sep 09 23:22:50.512506 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:50.512477    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5455c87ddc-thckm_b56b7c45-7fa7-409a-8934-614719953032/metrics-server/0.log"
Sep 09 23:22:50.535908 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:50.535881    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-xt4fn_b144d33e-1109-4b2b-9f9b-016913916e84/monitoring-plugin/0.log"
Sep 09 23:22:50.568813 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:50.568789    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-588f5_a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f/node-exporter/0.log"
Sep 09 23:22:50.592236 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:50.592210    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-588f5_a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f/kube-rbac-proxy/0.log"
Sep 09 23:22:50.615840 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:50.615815    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-588f5_a4aa34dc-e7b3-450b-b3ee-ee24d6f3300f/init-textfile/0.log"
Sep 09 23:22:50.882167 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:50.882141    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4dd2aec9-480e-433b-80b3-7c49ecbf965d/prometheus/0.log"
Sep 09 23:22:50.905860 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:50.905833    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4dd2aec9-480e-433b-80b3-7c49ecbf965d/config-reloader/0.log"
Sep 09 23:22:50.922089 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:50.922062    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4dd2aec9-480e-433b-80b3-7c49ecbf965d/thanos-sidecar/0.log"
Sep 09 23:22:50.941151 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:50.941128    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4dd2aec9-480e-433b-80b3-7c49ecbf965d/kube-rbac-proxy-web/0.log"
Sep 09 23:22:50.959999 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:50.959975    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4dd2aec9-480e-433b-80b3-7c49ecbf965d/kube-rbac-proxy/0.log"
Sep 09 23:22:50.979752 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:50.979730    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4dd2aec9-480e-433b-80b3-7c49ecbf965d/kube-rbac-proxy-thanos/0.log"
Sep 09 23:22:50.999198 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:50.999173    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4dd2aec9-480e-433b-80b3-7c49ecbf965d/init-config-reloader/0.log"
Sep 09 23:22:51.035094 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:51.035068    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-czkr5_710cab43-d10f-4aa3-af4c-0eecab1218b7/prometheus-operator/0.log"
Sep 09 23:22:51.058642 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:51.058613    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-czkr5_710cab43-d10f-4aa3-af4c-0eecab1218b7/kube-rbac-proxy/0.log"
Sep 09 23:22:52.910939 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:52.910901    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-2rs4x_31ee7939-0118-47d2-8a82-21f99709bf37/networking-console-plugin/0.log"
Sep 09 23:22:53.717504 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:53.717471    2562 scope.go:117] "RemoveContainer" containerID="5ac3b9a2141b0546a22bab3d553e4fa70927f0ac7bfbb14ad4bb6c03312c3d01"
Sep 09 23:22:53.717715 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:22:53.717664    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:22:54.708644 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.708609    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"]
Sep 09 23:22:54.711931 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.711910    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:54.714291 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.714267    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4rw5c\"/\"kube-root-ca.crt\""
Sep 09 23:22:54.714431 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.714271    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4rw5c\"/\"openshift-service-ca.crt\""
Sep 09 23:22:54.715222 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.715205    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4rw5c\"/\"default-dockercfg-ltxmt\""
Sep 09 23:22:54.721133 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.721111    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"]
Sep 09 23:22:54.750686 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.750652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a4641b7-8250-49b4-923b-4d743f60d52d-proc\") pod \"perf-node-gather-daemonset-94q82\" (UID: \"1a4641b7-8250-49b4-923b-4d743f60d52d\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:54.750686 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.750692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a4641b7-8250-49b4-923b-4d743f60d52d-lib-modules\") pod \"perf-node-gather-daemonset-94q82\" (UID: \"1a4641b7-8250-49b4-923b-4d743f60d52d\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:54.750914 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.750714    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a4641b7-8250-49b4-923b-4d743f60d52d-sys\") pod \"perf-node-gather-daemonset-94q82\" (UID: \"1a4641b7-8250-49b4-923b-4d743f60d52d\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:54.750914 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.750827    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a4641b7-8250-49b4-923b-4d743f60d52d-podres\") pod \"perf-node-gather-daemonset-94q82\" (UID: \"1a4641b7-8250-49b4-923b-4d743f60d52d\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:54.750914 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.750902    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rncxw\" (UniqueName: \"kubernetes.io/projected/1a4641b7-8250-49b4-923b-4d743f60d52d-kube-api-access-rncxw\") pod \"perf-node-gather-daemonset-94q82\" (UID: \"1a4641b7-8250-49b4-923b-4d743f60d52d\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:54.851979 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.851938    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a4641b7-8250-49b4-923b-4d743f60d52d-proc\") pod \"perf-node-gather-daemonset-94q82\" (UID: \"1a4641b7-8250-49b4-923b-4d743f60d52d\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:54.852176 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.851988    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a4641b7-8250-49b4-923b-4d743f60d52d-lib-modules\") pod \"perf-node-gather-daemonset-94q82\" (UID: \"1a4641b7-8250-49b4-923b-4d743f60d52d\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:54.852176 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.852017    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a4641b7-8250-49b4-923b-4d743f60d52d-sys\") pod \"perf-node-gather-daemonset-94q82\" (UID: \"1a4641b7-8250-49b4-923b-4d743f60d52d\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:54.852176 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.852068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a4641b7-8250-49b4-923b-4d743f60d52d-podres\") pod \"perf-node-gather-daemonset-94q82\" (UID: \"1a4641b7-8250-49b4-923b-4d743f60d52d\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:54.852176 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.852076    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a4641b7-8250-49b4-923b-4d743f60d52d-proc\") pod \"perf-node-gather-daemonset-94q82\" (UID: \"1a4641b7-8250-49b4-923b-4d743f60d52d\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:54.852176 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.852135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rncxw\" (UniqueName: \"kubernetes.io/projected/1a4641b7-8250-49b4-923b-4d743f60d52d-kube-api-access-rncxw\") pod \"perf-node-gather-daemonset-94q82\" (UID: \"1a4641b7-8250-49b4-923b-4d743f60d52d\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:54.852176 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.852158    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a4641b7-8250-49b4-923b-4d743f60d52d-sys\") pod \"perf-node-gather-daemonset-94q82\" (UID: \"1a4641b7-8250-49b4-923b-4d743f60d52d\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:54.852176 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.852155    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a4641b7-8250-49b4-923b-4d743f60d52d-lib-modules\") pod \"perf-node-gather-daemonset-94q82\" (UID: \"1a4641b7-8250-49b4-923b-4d743f60d52d\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:54.852465 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.852177    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a4641b7-8250-49b4-923b-4d743f60d52d-podres\") pod \"perf-node-gather-daemonset-94q82\" (UID: \"1a4641b7-8250-49b4-923b-4d743f60d52d\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:54.859849 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:54.859827    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rncxw\" (UniqueName: \"kubernetes.io/projected/1a4641b7-8250-49b4-923b-4d743f60d52d-kube-api-access-rncxw\") pod \"perf-node-gather-daemonset-94q82\" (UID: \"1a4641b7-8250-49b4-923b-4d743f60d52d\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:55.022578 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:55.022479    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:55.291209 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:55.291182    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"]
Sep 09 23:22:55.293494 ip-10-0-131-73 kubenswrapper[2562]: W0909 23:22:55.293470    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1a4641b7_8250_49b4_923b_4d743f60d52d.slice/crio-ea8a4ffa3a3a6e68c9ea5c457805c7425e422c8ca12c77fe99fa88ba3087e577 WatchSource:0}: Error finding container ea8a4ffa3a3a6e68c9ea5c457805c7425e422c8ca12c77fe99fa88ba3087e577: Status 404 returned error can't find the container with id ea8a4ffa3a3a6e68c9ea5c457805c7425e422c8ca12c77fe99fa88ba3087e577
Sep 09 23:22:55.357590 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:55.357564    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82" event={"ID":"1a4641b7-8250-49b4-923b-4d743f60d52d","Type":"ContainerStarted","Data":"690b0e1a12a08de7756dd268ac80a1124f48416bbd723197fb6c3f0504e0e99e"}
Sep 09 23:22:55.357698 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:55.357613    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82" event={"ID":"1a4641b7-8250-49b4-923b-4d743f60d52d","Type":"ContainerStarted","Data":"ea8a4ffa3a3a6e68c9ea5c457805c7425e422c8ca12c77fe99fa88ba3087e577"}
Sep 09 23:22:55.357742 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:55.357726    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:22:55.373097 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:55.373051    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82" podStartSLOduration=1.373034547 podStartE2EDuration="1.373034547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:55.370873894 +0000 UTC m=+1160.153914290" watchObservedRunningTime="2026-09-09 23:22:55.373034547 +0000 UTC m=+1160.156074930"
Sep 09 23:22:56.001555 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:56.001530    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v4q9p_bd1fe099-faf9-4290-a81b-824f9630f31c/dns/0.log"
Sep 09 23:22:56.020205 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:56.020177    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v4q9p_bd1fe099-faf9-4290-a81b-824f9630f31c/kube-rbac-proxy/0.log"
Sep 09 23:22:56.041457 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:56.041437    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5sd94_6397c170-a04a-4a23-8705-2d1033baca7e/dns-node-resolver/0.log"
Sep 09 23:22:56.619281 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:56.619250    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-chj99_e6ce54c2-4e66-4b37-96fe-d348247d7628/node-ca/0.log"
Sep 09 23:22:57.591872 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:57.591846    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55cf6889dc-ldjc4_53980b28-324a-463f-a182-8790e00fd9d5/kube-auth-proxy/0.log"
Sep 09 23:22:57.662937 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:57.662905    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2597q_5b931968-d5f9-4bbb-a82d-057b6693b53a/payload-pre-processing/0.log"
Sep 09 23:22:57.713893 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:57.713858    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d775859d6-bqmkj_d313f23b-e292-497c-93e9-9c321609462e/router/0.log"
Sep 09 23:22:58.342166 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:58.342075    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hrpfl_0c3b7480-0c2a-4f3d-97af-ad331496274a/serve-healthcheck-canary/0.log"
Sep 09 23:22:58.717171 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:58.717141    2562 scope.go:117] "RemoveContainer" containerID="e927ebc53f366de798bd181f544095f119ded033e805175ba25fceeab3c6a9b9"
Sep 09 23:22:58.717565 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:22:58.717335    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:22:58.905548 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:58.905513    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dzlv2_ccdd862f-4d28-40b9-a758-97289f68ee44/kube-rbac-proxy/0.log"
Sep 09 23:22:58.923992 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:58.923969    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dzlv2_ccdd862f-4d28-40b9-a758-97289f68ee44/exporter/0.log"
Sep 09 23:22:58.943566 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:22:58.943544    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dzlv2_ccdd862f-4d28-40b9-a758-97289f68ee44/extractor/0.log"
Sep 09 23:23:01.372415 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:01.372381    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-94q82"
Sep 09 23:23:01.429552 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:01.429520    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cbb89f58-tqm4v_9b22aea7-0279-4345-bc72-cb92a46b1f7d/manager/0.log"
Sep 09 23:23:01.446235 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:01.446201    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cbb89f58-tqm4v_9b22aea7-0279-4345-bc72-cb92a46b1f7d/copy-manifests/0.log"
Sep 09 23:23:02.575559 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:02.575530    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-758bd7d86f-k69sb_2a902752-9311-4f93-85cb-609664eb9c9c/manager/0.log"
Sep 09 23:23:05.394335 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:05.394298    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55cf6889dc-ldjc4_53980b28-324a-463f-a182-8790e00fd9d5/kube-auth-proxy/0.log"
Sep 09 23:23:05.443698 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:05.443667    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2597q_5b931968-d5f9-4bbb-a82d-057b6693b53a/payload-pre-processing/0.log"
Sep 09 23:23:05.476676 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:05.476625    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d775859d6-bqmkj_d313f23b-e292-497c-93e9-9c321609462e/router/0.log"
Sep 09 23:23:06.717049 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:06.717015    2562 scope.go:117] "RemoveContainer" containerID="5ac3b9a2141b0546a22bab3d553e4fa70927f0ac7bfbb14ad4bb6c03312c3d01"
Sep 09 23:23:06.717460 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:23:06.717179    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg_llm(b0faee5b-901c-476f-b3f4-4f43eb219036)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-l5fsg" podUID="b0faee5b-901c-476f-b3f4-4f43eb219036"
Sep 09 23:23:06.767085 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:06.767058    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55cf6889dc-ldjc4_53980b28-324a-463f-a182-8790e00fd9d5/kube-auth-proxy/0.log"
Sep 09 23:23:06.824670 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:06.824637    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2597q_5b931968-d5f9-4bbb-a82d-057b6693b53a/payload-pre-processing/0.log"
Sep 09 23:23:06.867324 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:06.867295    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d775859d6-bqmkj_d313f23b-e292-497c-93e9-9c321609462e/router/0.log"
Sep 09 23:23:08.498098 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:08.498067    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-kxh8l_aa82f387-b993-4bc4-ace1-41bccc668560/kube-storage-version-migrator-operator/1.log"
Sep 09 23:23:08.498882 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:08.498862    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-kxh8l_aa82f387-b993-4bc4-ace1-41bccc668560/kube-storage-version-migrator-operator/0.log"
Sep 09 23:23:09.717647 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:09.717610    2562 scope.go:117] "RemoveContainer" containerID="e927ebc53f366de798bd181f544095f119ded033e805175ba25fceeab3c6a9b9"
Sep 09 23:23:09.718140 ip-10-0-131-73 kubenswrapper[2562]: E0909 23:23:09.717821    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-mmdpm_llm(52ff2360-1da2-4e0e-8469-a225d7e2f7f1)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-mmdpm" podUID="52ff2360-1da2-4e0e-8469-a225d7e2f7f1"
Sep 09 23:23:09.732041 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:09.732019    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwl6c_276a69fc-219e-4197-95e9-9de1e887a864/kube-multus-additional-cni-plugins/0.log"
Sep 09 23:23:09.751443 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:09.751417    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwl6c_276a69fc-219e-4197-95e9-9de1e887a864/egress-router-binary-copy/0.log"
Sep 09 23:23:09.769339 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:09.769315    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwl6c_276a69fc-219e-4197-95e9-9de1e887a864/cni-plugins/0.log"
Sep 09 23:23:09.787242 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:09.787220    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwl6c_276a69fc-219e-4197-95e9-9de1e887a864/bond-cni-plugin/0.log"
Sep 09 23:23:09.805011 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:09.804990    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwl6c_276a69fc-219e-4197-95e9-9de1e887a864/routeoverride-cni/0.log"
Sep 09 23:23:09.822967 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:09.822944    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwl6c_276a69fc-219e-4197-95e9-9de1e887a864/whereabouts-cni-bincopy/0.log"
Sep 09 23:23:09.843054 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:09.843024    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwl6c_276a69fc-219e-4197-95e9-9de1e887a864/whereabouts-cni/0.log"
Sep 09 23:23:09.872936 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:09.872911    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-h6244_3f2eed98-b9e8-4d97-92d6-51d5d3e9d0ba/kube-multus/0.log"
Sep 09 23:23:09.996590 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:09.996507    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dwb45_c31b5254-ff30-4381-bcbd-d09e9d6fd177/network-metrics-daemon/0.log"
Sep 09 23:23:10.013414 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:10.013385    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dwb45_c31b5254-ff30-4381-bcbd-d09e9d6fd177/kube-rbac-proxy/0.log"
Sep 09 23:23:11.064209 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:11.064138    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ffztl_77e2c92a-84a7-43d7-adca-a801a8d698ec/ovn-controller/0.log"
Sep 09 23:23:11.080069 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:11.080046    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ffztl_77e2c92a-84a7-43d7-adca-a801a8d698ec/ovn-acl-logging/0.log"
Sep 09 23:23:11.103730 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:11.103701    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ffztl_77e2c92a-84a7-43d7-adca-a801a8d698ec/kube-rbac-proxy-node/0.log"
Sep 09 23:23:11.121954 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:11.121931    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ffztl_77e2c92a-84a7-43d7-adca-a801a8d698ec/kube-rbac-proxy-ovn-metrics/0.log"
Sep 09 23:23:11.136412 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:11.136388    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ffztl_77e2c92a-84a7-43d7-adca-a801a8d698ec/northd/0.log"
Sep 09 23:23:11.156386 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:11.156364    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ffztl_77e2c92a-84a7-43d7-adca-a801a8d698ec/nbdb/0.log"
Sep 09 23:23:11.175655 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:11.175631    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ffztl_77e2c92a-84a7-43d7-adca-a801a8d698ec/sbdb/0.log"
Sep 09 23:23:11.211091 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:11.211060    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ffztl_77e2c92a-84a7-43d7-adca-a801a8d698ec/ovnkube-controller/0.log"
Sep 09 23:23:12.501300 ip-10-0-131-73 kubenswrapper[2562]: I0909 23:23:12.501267    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rbfm8_93c766f9-7d3d-472f-ac3e-232f9b925b1a/network-check-target-container/0.log"