Sep 18 16:49:07.825156 ip-10-0-142-7 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 16:49:11.236456 ip-10-0-142-7 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 16:49:11.236456 ip-10-0-142-7 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 16:49:11.236456 ip-10-0-142-7 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 16:49:11.236456 ip-10-0-142-7 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 16:49:11.236456 ip-10-0-142-7 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 16:49:11.237245 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.236551    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 16:49:11.240522 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240478    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:49:11.240522 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240505    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:49:11.240522 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240511    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:49:11.240522 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240516    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:49:11.240522 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240520    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:49:11.240522 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240524    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:49:11.240522 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240528    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:49:11.240522 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240532    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240536    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240540    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240544    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240548    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240552    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240556    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240560    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240564    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240567    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240573    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240578    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240582    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240586    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240591    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240595    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240599    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240603    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240608    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240611    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:49:11.241000 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240615    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240618    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240622    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240626    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240629    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240633    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240637    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240640    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240644    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240648    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240652    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240656    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240660    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240664    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240668    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240672    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240676    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240682    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240689    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240696    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:49:11.241878 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240700    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240704    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240710    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240714    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240718    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240723    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240727    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240731    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240736    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240741    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240748    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240752    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240757    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240762    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240767    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240771    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240776    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240781    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240786    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:49:11.242737 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240791    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240796    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240800    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240804    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240808    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240833    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240837    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240842    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240846    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240851    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240858    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240862    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240866    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240871    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240875    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240879    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240883    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240889    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240893    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240897    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:49:11.243620 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240902    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240906    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240910    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240914    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240918    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240922    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240926    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240930    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240935    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240939    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240944    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240948    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.240952    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242206    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242220    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242225    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242229    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242233    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242237    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242242    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:49:11.244477 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242247    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242251    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242255    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242260    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242265    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242269    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242273    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242277    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242282    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242286    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242291    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242296    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242300    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242304    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242308    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242312    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242316    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242321    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242325    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:49:11.245369 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242329    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242333    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242338    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242344    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242350    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242356    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242360    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242365    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242370    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242374    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242378    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242382    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242387    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242392    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242396    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242400    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242404    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242408    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242413    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:49:11.245989 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242417    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242421    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242425    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242429    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242434    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242439    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242444    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242448    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242454    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242459    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242463    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242467    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242472    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242476    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242480    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242487    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242492    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242496    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242501    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242505    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:49:11.246568 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242510    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242515    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242519    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242524    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242528    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242533    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242537    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242541    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242545    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242550    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242554    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242558    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242563    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242567    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242571    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242575    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242579    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242583    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242590    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242596    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:49:11.247136 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242600    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242606    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242610    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242614    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242618    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242622    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242627    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242631    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242636    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242640    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242644    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242648    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242652    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.242656    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243331    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243341    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243346    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243351    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243356    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243360    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:49:11.247801 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243364    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243368    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243373    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243380    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243386    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243391    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243396    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243400    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243404    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243409    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243414    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243419    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243423    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243431    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243435    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243440    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243444    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243449    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243453    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:49:11.248446 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243457    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243461    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243465    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243470    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243474    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243478    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243482    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243487    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243491    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243495    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243499    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243504    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243508    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243511    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243516    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243520    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243524    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243528    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243532    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243537    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243541    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:49:11.248943 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243546    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243550    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243554    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243565    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243569    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243575    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243579    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243584    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243588    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243593    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243597    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243601    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243605    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243609    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243613    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243617    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243621    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243625    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243629    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:49:11.249551 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243635    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243640    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243645    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243650    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243654    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243659    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243663    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243669    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243676    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243681    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243685    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243689    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243693    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243697    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243701    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243705    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243710    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243718    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243724    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243728    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:49:11.250049 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243733    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243737    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243741    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243745    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243749    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243753    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243758    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243762    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243766    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243770    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243774    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243778    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243782    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.243787    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.243924    2583 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.243983    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.243993    2583 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244000    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244006    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244011    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244018    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 16:49:11.250540 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244025    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244030    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244035    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244040    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244046    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244051    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244055    2583 flags.go:64] FLAG: --cgroup-root=""
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244060    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244065    2583 flags.go:64] FLAG: --client-ca-file=""
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244074    2583 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244079    2583 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244087    2583 flags.go:64] FLAG: --cluster-domain=""
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244091    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244097    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244102    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244107    2583 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244114    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244118    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244124    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244129    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244134    2583 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244139    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244143    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244148    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 16:49:11.251083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244152    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244162    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244167    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244172    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244177    2583 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244182    2583 flags.go:64] FLAG: --enable-server="true"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244186    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244193    2583 flags.go:64] FLAG: --event-burst="100"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244198    2583 flags.go:64] FLAG: --event-qps="50"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244203    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244208    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244213    2583 flags.go:64] FLAG: --eviction-hard=""
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244219    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244224    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244229    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244233    2583 flags.go:64] FLAG: --eviction-soft=""
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244238    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244245    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244250    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244255    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244260    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244265    2583 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244269    2583 flags.go:64] FLAG: --feature-gates=""
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244275    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244280    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 16:49:11.251663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244285    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244290    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244294    2583 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244299    2583 flags.go:64] FLAG: --help="false"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244304    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244309    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244314    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244318    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244326    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244332    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244338    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244342    2583 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244347    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244351    2583 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244356    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244361    2583 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244366    2583 flags.go:64] FLAG: --kube-reserved=""
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244371    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244376    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244381    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244385    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244390    2583 flags.go:64] FLAG: --lock-file=""
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244394    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244399    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 16:49:11.252446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244408    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244417    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244430    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244435    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244439    2583 flags.go:64] FLAG: --logging-format="text"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244444    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244450    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244454    2583 flags.go:64] FLAG: --manifest-url=""
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244459    2583 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244467    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244471    2583 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244478    2583 flags.go:64] FLAG: --max-pods="110"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244482    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244487    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244491    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244495    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244502    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244507    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244512    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244526    2583 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244531    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244535    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244540    2583 flags.go:64] FLAG: --pod-cidr=""
Sep 18 16:49:11.253094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244545    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244556    2583 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244561    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244565    2583 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244570    2583 flags.go:64] FLAG: --port="10250"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244575    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244580    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0943d1ecb41b103b9"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244585    2583 flags.go:64] FLAG: --qos-reserved=""
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244589    2583 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244594    2583 flags.go:64] FLAG: --register-node="true"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244601    2583 flags.go:64] FLAG: --register-with-taints=""
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244607    2583 flags.go:64] FLAG: --registry-burst="10"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244616    2583 flags.go:64] FLAG: --registry-qps="5"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244621    2583 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244626    2583 flags.go:64] FLAG: --reserved-memory=""
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244632    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244637    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244642    2583 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244646    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244651    2583 flags.go:64] FLAG: --runonce="false"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244656    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244660    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244665    2583 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244670    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244674    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244681    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 16:49:11.253707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244686    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244691    2583 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244695    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244700    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244704    2583 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244708    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244713    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244717    2583 flags.go:64] FLAG: --system-cgroups=""
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244722    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244730    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244735    2583 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244739    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244747    2583 flags.go:64] FLAG: --tls-min-version=""
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244751    2583 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244756    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244760    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244767    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244772    2583 flags.go:64] FLAG: --v="2"
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244785    2583 flags.go:64] FLAG: --version="false"
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244797    2583 flags.go:64] FLAG: --vmodule=""
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244803    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.244829    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245024    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245033    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:49:11.254394 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245039    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245044    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245049    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245053    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245057    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245061    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245066    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245072    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245077    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245081    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245085    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245089    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245094    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245098    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245102    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245106    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245110    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245114    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245118    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245122    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:49:11.255015 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245126    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245130    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245136    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245140    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245146    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245150    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245155    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245159    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245164    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245168    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245172    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245177    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245181    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245185    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245189    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245193    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245200    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245205    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245209    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:49:11.255503 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245215    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245220    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245224    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245229    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245233    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245237    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245241    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245245    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245249    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245253    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245257    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245262    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245266    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245270    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245274    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245278    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245282    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245288    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245293    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245297    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:49:11.255995 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245301    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245305    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245310    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245315    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245319    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245323    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245330    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245337    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245341    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245345    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245349    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245353    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245360    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245364    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245367    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245371    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245375    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245379    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245383    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:49:11.256488 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245387    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245391    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245395    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245399    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245404    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245408    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245412    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245416    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245420    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245425    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245431    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245435    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245440    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245444    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245448    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245452    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245457    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245462    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:49:11.256979 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.245466    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:49:11.257426 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.246160    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 16:49:11.257426 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.254359    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 16:49:11.257426 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.254381    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 16:49:11.257426 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.254403    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 16:49:11.257426 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.254409    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 16:49:11.257426 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254475    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:49:11.257426 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254481    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:49:11.257426 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254485    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:49:11.257426 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254488    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:49:11.257426 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254491    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:49:11.257426 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254494    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:49:11.257426 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254497    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:49:11.257426 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254500    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:49:11.257426 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254503    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:49:11.257426 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254506    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254509    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254511    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254515    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254519    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254522    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254525    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254528    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254531    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254533    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254535    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254538    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254540    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254544    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254546    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254549    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254551    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254554    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254557    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:49:11.257838 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254560    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254569    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254572    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254574    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254577    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254580    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254584    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254587    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254590    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254593    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254595    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254598    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254601    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254604    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254607    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254610    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254612    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254615    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254617    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:49:11.258327 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254620    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254623    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254625    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254627    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254630    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254633    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254635    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254638    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254640    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254642    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254645    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254647    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254650    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254652    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254656    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254664    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254667    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254669    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254672    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254674    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:49:11.258804 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254677    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254680    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254682    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254684    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254688    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254692    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254695    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254697    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254699    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254702    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254704    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254707    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254709    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254712    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254714    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254716    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254719    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254722    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254724    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254726    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:49:11.259343 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254729    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:49:11.259858 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254731    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:49:11.259858 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254734    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:49:11.259858 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254736    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:49:11.259858 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254739    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:49:11.259858 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254743    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:49:11.259858 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254746    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:49:11.259858 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254748    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:49:11.259858 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254757    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:49:11.259858 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254759    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:49:11.259858 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254762    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:49:11.259858 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254764    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:49:11.259858 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.254771    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 16:49:11.259858 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254963    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:49:11.259858 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254970    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:49:11.259858 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254973    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254976    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254979    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254982    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254985    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254987    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254990    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254993    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.254997    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255000    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255002    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255005    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255007    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255010    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255012    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255015    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255017    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255020    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255023    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255025    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:49:11.260248 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255028    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255031    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255034    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255037    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255039    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255042    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255050    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255053    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255056    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255058    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255061    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255064    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255066    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255068    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255071    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255073    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255076    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255079    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255081    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255084    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:49:11.260763 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255086    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255089    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255091    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255093    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255096    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255098    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255101    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255103    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255106    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255110    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255113    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255116    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255119    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255122    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255125    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255128    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255131    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255133    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255136    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:49:11.261273 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255144    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255147    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255149    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255151    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255154    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255156    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255159    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255161    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255164    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255166    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255169    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255171    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255174    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255176    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255178    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255181    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255183    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255186    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255188    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255191    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:49:11.261741 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255193    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255196    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255199    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255201    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255204    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255206    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255209    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255211    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255214    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255216    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255219    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255221    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255224    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255233    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255236    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255239    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255242    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:49:11.262423 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:11.255245    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:49:11.262893 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.255250    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 16:49:11.262893 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.255418    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 16:49:11.262893 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.257407    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 16:49:11.262893 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.258154    2583 server.go:1019] "Starting client certificate rotation"
Sep 18 16:49:11.262893 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.258253    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 16:49:11.262893 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.258290    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 16:49:11.262893 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.260671    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 16:49:11.264663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.264638    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 16:49:11.268830 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.268797    2583 log.go:25] "Validated CRI v1 runtime API"
Sep 18 16:49:11.270418 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.270405    2583 log.go:25] "Validated CRI v1 image API"
Sep 18 16:49:11.271913 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.271899    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 16:49:11.274217 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.274197    2583 fs.go:135] Filesystem UUIDs: map[6ce30d2c-0b7e-4834-9e93-c93246aff457:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7a5559eb-7f23-4b46-bbe1-0d3246d907ff:/dev/nvme0n1p4]
Sep 18 16:49:11.274288 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.274217    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 16:49:11.278374 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.278209    2583 manager.go:216] Machine: {Timestamp:2026-09-18 16:49:11.277632425 +0000 UTC m=+2.002914161 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2807762 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e577cf1401b6e46ede247a860d55d SystemUUID:ec2e577c-f140-1b6e-46ed-e247a860d55d BootID:c7fef07a-ae9b-4dd9-adbb-44e1b0f35486 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e4:7d:18:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e4:7d:18:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:2e:28:3a:62:7e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 16:49:11.278374 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.278366    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 16:49:11.278481 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.278451    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 16:49:11.279941 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.279911    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 16:49:11.280091 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.279946    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-7.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 16:49:11.280996 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.280984    2583 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 16:49:11.281030 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.280998    2583 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 16:49:11.281030 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.281006    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 16:49:11.281030 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.281025    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 16:49:11.281114 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.281106    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 16:49:11.284736 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.284720    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 16:49:11.284890 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.284879    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 16:49:11.284921 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.284916    2583 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 16:49:11.284948 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.284927    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 16:49:11.284948 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.284941    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 16:49:11.285015 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.284951    2583 kubelet.go:398] "Adding apiserver pod source"
Sep 18 16:49:11.285015 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.284960    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 16:49:11.285559 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.285547    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 16:49:11.285607 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.285572    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 16:49:11.287907 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.287885    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 16:49:11.290028 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.290010    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 16:49:11.290139 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.290049    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 16:49:11.291039 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.291021    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 16:49:11.291139 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.291043    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 16:49:11.291139 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.291051    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 16:49:11.291139 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.291059    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 16:49:11.291139 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.291071    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 16:49:11.291139 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.291079    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 16:49:11.291139 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.291097    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 16:49:11.291139 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.291105    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 16:49:11.291139 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.291115    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 16:49:11.291139 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.291123    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 16:49:11.291139 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.291135    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 16:49:11.291139 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.291143    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 16:49:11.291475 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.291185    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 16:49:11.291475 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.291194    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 16:49:11.292504 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.292480    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 16:49:11.295008 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.294991    2583 server.go:1268] "Started kubelet"
Sep 18 16:49:11.295084 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.295046    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 16:49:11.295204 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.295143    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 16:49:11.295268 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.295232    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 16:49:11.333076 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.333035    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dk2w4"
Sep 18 16:49:11.333883 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.333857    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 16:49:11.335133 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.335104    2583 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 16:49:11.335153 ip-10-0-142-7 systemd[1]: Started Kubernetes Kubelet.
Sep 18 16:49:11.336111 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.336030    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-7.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 16:49:11.336269 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.336236    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 16:49:11.336453 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.336419    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 16:49:11.338782 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.338008    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-7.ec2.internal.18d67847b4a343c1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-7.ec2.internal,UID:ip-10-0-142-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-7.ec2.internal,},FirstTimestamp:2026-09-18 16:49:11.294960577 +0000 UTC m=+2.020242313,LastTimestamp:2026-09-18 16:49:11.294960577 +0000 UTC m=+2.020242313,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-7.ec2.internal,}"
Sep 18 16:49:11.340298 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.340280    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dk2w4"
Sep 18 16:49:11.344120 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.344094    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 16:49:11.348034 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.348017    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 16:49:11.348034 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.348028    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 16:49:11.348168 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.348108    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-7.ec2.internal\" not found"
Sep 18 16:49:11.348541 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.348519    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 16:49:11.348541 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.348519    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 16:49:11.348846 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.348549    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 16:49:11.348846 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.348623    2583 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 16:49:11.348846 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.348633    2583 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 16:49:11.349034 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.349011    2583 factory.go:55] Registering systemd factory
Sep 18 16:49:11.349034 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.349028    2583 factory.go:223] Registration of the systemd container factory successfully
Sep 18 16:49:11.349288 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.349271    2583 factory.go:153] Registering CRI-O factory
Sep 18 16:49:11.349288 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.349289    2583 factory.go:223] Registration of the crio container factory successfully
Sep 18 16:49:11.349424 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.349347    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 16:49:11.349424 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.349363    2583 factory.go:103] Registering Raw factory
Sep 18 16:49:11.349424 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.349379    2583 manager.go:1196] Started watching for new ooms in manager
Sep 18 16:49:11.349784 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.349767    2583 manager.go:349] Starting recovery of all containers
Sep 18 16:49:11.351196 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.351120    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:49:11.355446 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.355419    2583 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-7.ec2.internal\" not found" node="ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.358711 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.358669    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 16:49:11.361264 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.361209    2583 manager.go:354] Recovery completed
Sep 18 16:49:11.365494 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.365475    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:49:11.367446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.367428    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:49:11.367529 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.367461    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:49:11.367529 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.367472    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:49:11.368097 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.368082    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 16:49:11.368097 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.368094    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 16:49:11.368232 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.368101    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:49:11.368232 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.368114    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 16:49:11.368859 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.368842    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:49:11.368951 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.368873    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:49:11.368951 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.368887    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:49:11.370276 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.370263    2583 policy_none.go:49] "None policy: Start"
Sep 18 16:49:11.370336 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.370279    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 16:49:11.370336 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.370290    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 16:49:11.372235 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.372222    2583 policy_none.go:47] "Start"
Sep 18 16:49:11.410887 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.410670    2583 manager.go:337] "Starting Device Plugin manager"
Sep 18 16:49:11.426805 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.410918    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 16:49:11.426805 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.410933    2583 server.go:87] "Starting device plugin registration server"
Sep 18 16:49:11.426805 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.411167    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 16:49:11.426805 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.411187    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 16:49:11.426805 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.411284    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 16:49:11.426805 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.411367    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 16:49:11.426805 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.411377    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 16:49:11.426805 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.412010    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 16:49:11.426805 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.412064    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-7.ec2.internal\" not found"
Sep 18 16:49:11.458180 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.458143    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 16:49:11.458340 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.458210    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 16:49:11.458340 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.458236    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 16:49:11.458340 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.458275    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 18 16:49:11.460446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.460425    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:49:11.511663 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.511578    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:49:11.512829 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.512800    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:49:11.512941 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.512854    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:49:11.512941 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.512867    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:49:11.512941 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.512893    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.519846 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.519806    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.519951 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.519855    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-7.ec2.internal\": node \"ip-10-0-142-7.ec2.internal\" not found"
Sep 18 16:49:11.532878 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.532849    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-7.ec2.internal\" not found"
Sep 18 16:49:11.558868 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.558804    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-7.ec2.internal"]
Sep 18 16:49:11.558990 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.558919    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:49:11.560405 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.560385    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:49:11.560521 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.560417    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:49:11.560521 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.560427    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:49:11.562664 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.562648    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:49:11.562802 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.562786    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.562882 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.562844    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:49:11.563443 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.563428    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:49:11.563526 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.563447    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:49:11.563526 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.563459    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:49:11.563526 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.563469    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:49:11.563526 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.563472    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:49:11.563526 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.563479    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:49:11.565880 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.565862    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.565929 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.565903    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:49:11.566679 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.566658    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:49:11.566764 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.566690    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:49:11.566764 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.566701    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:49:11.585553 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.585525    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-7.ec2.internal\" not found" node="ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.589368 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.589348    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-7.ec2.internal\" not found" node="ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.633338 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.633310    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-7.ec2.internal\" not found"
Sep 18 16:49:11.650728 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.650699    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2055c856ca58f4636c1d88b7bbb215d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal\" (UID: \"e2055c856ca58f4636c1d88b7bbb215d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.650838 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.650731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2055c856ca58f4636c1d88b7bbb215d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal\" (UID: \"e2055c856ca58f4636c1d88b7bbb215d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.650838 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.650750    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4f4244c68bf26c3467a2f7dbaa7bd7e6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-7.ec2.internal\" (UID: \"4f4244c68bf26c3467a2f7dbaa7bd7e6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.733741 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.733714    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-7.ec2.internal\" not found"
Sep 18 16:49:11.751137 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.751110    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2055c856ca58f4636c1d88b7bbb215d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal\" (UID: \"e2055c856ca58f4636c1d88b7bbb215d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.751204 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.751145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2055c856ca58f4636c1d88b7bbb215d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal\" (UID: \"e2055c856ca58f4636c1d88b7bbb215d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.751204 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.751165    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4f4244c68bf26c3467a2f7dbaa7bd7e6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-7.ec2.internal\" (UID: \"4f4244c68bf26c3467a2f7dbaa7bd7e6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.751281 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.751206    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4f4244c68bf26c3467a2f7dbaa7bd7e6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-7.ec2.internal\" (UID: \"4f4244c68bf26c3467a2f7dbaa7bd7e6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.751281 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.751216    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2055c856ca58f4636c1d88b7bbb215d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal\" (UID: \"e2055c856ca58f4636c1d88b7bbb215d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.751281 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.751223    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2055c856ca58f4636c1d88b7bbb215d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal\" (UID: \"e2055c856ca58f4636c1d88b7bbb215d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.834642 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.834570    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-7.ec2.internal\" not found"
Sep 18 16:49:11.888039 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.887991    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.891978 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:11.891945    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-7.ec2.internal"
Sep 18 16:49:11.934954 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:11.934923    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-7.ec2.internal\" not found"
Sep 18 16:49:12.035488 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.035453    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-7.ec2.internal\" not found"
Sep 18 16:49:12.136054 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.135969    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-7.ec2.internal\" not found"
Sep 18 16:49:12.204448 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.204424    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:49:12.248728 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.248690    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-7.ec2.internal"
Sep 18 16:49:12.249936 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.249918    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:49:12.258036 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.258012    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 16:49:12.258193 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.258170    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 16:49:12.258245 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.258178    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 16:49:12.258245 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.258205    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 16:49:12.258245 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.258222    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 16:49:12.258245 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.258229    2583 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a8581b5aeab4648bb961a726525ca22a-3a9aabd06ff1da41.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-system/pods\": read tcp 10.0.142.7:40604->98.94.202.195:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-7.ec2.internal"
Sep 18 16:49:12.258372 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.258256    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal"
Sep 18 16:49:12.275518 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.275488    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 16:49:12.285662 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.285629    2583 apiserver.go:52] "Watching apiserver"
Sep 18 16:49:12.290732 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.290708    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 16:49:12.291092 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.291073    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-qmx4b","openshift-network-diagnostics/network-check-target-lrm4v","openshift-ovn-kubernetes/ovnkube-node-s746c","openshift-cluster-node-tuning-operator/tuned-wk4h9","openshift-image-registry/node-ca-cfqfc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal","openshift-multus/multus-lkvfz","openshift-network-operator/iptables-alerter-rrlns","kube-system/global-pull-secret-syncer-v7vnw","kube-system/konnectivity-agent-hxlkv","kube-system/kube-apiserver-proxy-ip-10-0-142-7.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr","openshift-multus/multus-additional-cni-plugins-29gsb"]
Sep 18 16:49:12.293611 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.293588    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.295595 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.295572    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9nqlx\""
Sep 18 16:49:12.295693 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.295602    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 16:49:12.295884 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.295867    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 16:49:12.297992 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.296091    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 16:49:12.297992 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.296286    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:12.297992 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.296301    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 16:49:12.297992 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.296410    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:12.298791 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.298767    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.300517 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.300495    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 16:49:12.300680 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.300660    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 16:49:12.300761 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.300726    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 16:49:12.300823 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.300785    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 16:49:12.300929 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.300914    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 16:49:12.301030 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.301016    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 16:49:12.301161 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.301143    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5qjbt\""
Sep 18 16:49:12.301311 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.301298    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.302912 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.302889    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 16:49:12.302999 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.302952    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 16:49:12.302999 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.302958    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8vfz2\""
Sep 18 16:49:12.303569 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.303549    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cfqfc"
Sep 18 16:49:12.305139 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.305121    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rvczh\""
Sep 18 16:49:12.305240 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.305123    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 16:49:12.305446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.305427    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 16:49:12.305523 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.305513    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 16:49:12.305680 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.305663    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:12.305770 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.305749    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:12.308343 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.308325    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrlns"
Sep 18 16:49:12.310005 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.309986    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 16:49:12.310114 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.310038    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p4vr7\""
Sep 18 16:49:12.310331 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.310315    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 16:49:12.310381 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.310320    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 16:49:12.310632 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.310617    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:12.310709 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.310687    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:12.313152 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.313130    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hxlkv"
Sep 18 16:49:12.314987 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.314963    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 16:49:12.315494 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.315476    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k4885\""
Sep 18 16:49:12.315654 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.315633    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.315720 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.315669    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 16:49:12.317384 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.317358    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 16:49:12.317477 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.317396    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-72crf\""
Sep 18 16:49:12.317477 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.317468    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 16:49:12.317633 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.317621    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 16:49:12.318092 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.318073    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.319618 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.319593    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 16:49:12.319796 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.319780    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 16:49:12.319981 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.319969    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s48bl\""
Sep 18 16:49:12.345274 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.345224    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 16:44:11 +0000 UTC" deadline="2028-03-13 15:24:38.427525419 +0000 UTC"
Sep 18 16:49:12.345274 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.345268    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13006h35m26.082259517s"
Sep 18 16:49:12.348367 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.348344    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 16:49:12.349506 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.349491    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 16:49:12.354222 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354196    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4fpr\" (UniqueName: \"kubernetes.io/projected/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-kube-api-access-z4fpr\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.354356 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354229    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-sysconfig\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.354356 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-lib-modules\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.354356 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354296    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c8f58056-1c0d-498e-9518-a3b9654d6cf3-serviceca\") pod \"node-ca-cfqfc\" (UID: \"c8f58056-1c0d-498e-9518-a3b9654d6cf3\") " pod="openshift-image-registry/node-ca-cfqfc"
Sep 18 16:49:12.354356 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-run-multus-certs\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.354478 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354382    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-sysctl-d\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.354478 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354406    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-sysctl-conf\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.354478 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354421    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvk7q\" (UniqueName: \"kubernetes.io/projected/c8f58056-1c0d-498e-9518-a3b9654d6cf3-kube-api-access-jvk7q\") pod \"node-ca-cfqfc\" (UID: \"c8f58056-1c0d-498e-9518-a3b9654d6cf3\") " pod="openshift-image-registry/node-ca-cfqfc"
Sep 18 16:49:12.354478 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354453    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:12.354654 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354478    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30c32c6a-c36c-4433-adff-277ef3fa3b16-agent-certs\") pod \"konnectivity-agent-hxlkv\" (UID: \"30c32c6a-c36c-4433-adff-277ef3fa3b16\") " pod="kube-system/konnectivity-agent-hxlkv"
Sep 18 16:49:12.354654 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354495    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-multus-cni-dir\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.354654 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354541    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-multus-socket-dir-parent\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.354654 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354564    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-var-lib-openvswitch\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.354654 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk5rm\" (UniqueName: \"kubernetes.io/projected/18eb2d6b-f8ae-4a54-80fa-169af7344318-kube-api-access-hk5rm\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.354654 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354598    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-var-lib-kubelet\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.354654 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354612    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/97b45f77-6012-44e8-ad30-564e7d1f2a5d-env-overrides\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.354654 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354642    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e70ff23e-293b-47b9-a239-2d63b2bfb912-host-slash\") pod \"iptables-alerter-rrlns\" (UID: \"e70ff23e-293b-47b9-a239-2d63b2bfb912\") " pod="openshift-network-operator/iptables-alerter-rrlns"
Sep 18 16:49:12.354945 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354659    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-system-cni-dir\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.354945 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354674    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-systemd\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.354945 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354689    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-node-log\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.354945 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354707    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-sys-fs\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.354945 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354728    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.354945 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354744    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-run\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.354945 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354771    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-var-lib-kubelet\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.354945 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354787    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30c32c6a-c36c-4433-adff-277ef3fa3b16-konnectivity-ca\") pod \"konnectivity-agent-hxlkv\" (UID: \"30c32c6a-c36c-4433-adff-277ef3fa3b16\") " pod="kube-system/konnectivity-agent-hxlkv"
Sep 18 16:49:12.354945 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354824    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-run-netns\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.354945 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354840    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-cni-netd\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.354945 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354859    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-sys\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.354945 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354894    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-tuned\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.354945 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354914    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-var-lib-cni-bin\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.354945 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354929    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-kubernetes\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.355543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354950    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-system-cni-dir\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.355543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354973    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2pqs\" (UniqueName: \"kubernetes.io/projected/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-kube-api-access-z2pqs\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.355543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.354993    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-kubelet\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.355543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355014    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-cni-binary-copy\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.355543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355029    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/46fb0981-ac5c-4e2b-8212-adae49d948c4-dbus\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:12.355543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355042    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-etc-kubernetes\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.355543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6ms5\" (UniqueName: \"kubernetes.io/projected/e70ff23e-293b-47b9-a239-2d63b2bfb912-kube-api-access-n6ms5\") pod \"iptables-alerter-rrlns\" (UID: \"e70ff23e-293b-47b9-a239-2d63b2bfb912\") " pod="openshift-network-operator/iptables-alerter-rrlns"
Sep 18 16:49:12.355543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355097    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-log-socket\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.355543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355137    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs\") pod \"network-metrics-daemon-qmx4b\" (UID: \"83b73597-6182-4df7-bcf5-f6ca3ba721cd\") " pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:12.355543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355160    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-device-dir\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.355543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355184    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-multus-daemon-config\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.355543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355221    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-slash\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.355543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355245    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-run-ovn\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.355543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355264    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8f58056-1c0d-498e-9518-a3b9654d6cf3-host\") pod \"node-ca-cfqfc\" (UID: \"c8f58056-1c0d-498e-9518-a3b9654d6cf3\") " pod="openshift-image-registry/node-ca-cfqfc"
Sep 18 16:49:12.355543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355278    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-etc-openvswitch\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.355543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355294    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.356126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355316    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8xht\" (UniqueName: \"kubernetes.io/projected/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-kube-api-access-q8xht\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.356126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355358    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-cnibin\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.356126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355372    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.356126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355388    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.356126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355405    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fgtq\" (UniqueName: \"kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq\") pod \"network-check-target-lrm4v\" (UID: \"1cfbfb52-83e8-4208-aa4f-de27397133d4\") " pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:12.356126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355420    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-hostroot\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.356126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355447    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-systemd-units\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.356126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355466    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/97b45f77-6012-44e8-ad30-564e7d1f2a5d-ovnkube-config\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.356126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355481    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-registration-dir\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.356126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355536    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18eb2d6b-f8ae-4a54-80fa-169af7344318-tmp\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.356126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355558    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/46fb0981-ac5c-4e2b-8212-adae49d948c4-kubelet-config\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:12.356126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-cnibin\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.356126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355600    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-cni-binary-copy\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.356126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355621    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/97b45f77-6012-44e8-ad30-564e7d1f2a5d-ovnkube-script-lib\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.356126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355643    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbgng\" (UniqueName: \"kubernetes.io/projected/83b73597-6182-4df7-bcf5-f6ca3ba721cd-kube-api-access-zbgng\") pod \"network-metrics-daemon-qmx4b\" (UID: \"83b73597-6182-4df7-bcf5-f6ca3ba721cd\") " pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:12.356126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355658    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.356559 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355676    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-modprobe-d\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.356559 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355702    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-var-lib-cni-multus\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.356559 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355728    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-run-openvswitch\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.356559 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355753    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.356559 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355769    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cslcm\" (UniqueName: \"kubernetes.io/projected/97b45f77-6012-44e8-ad30-564e7d1f2a5d-kube-api-access-cslcm\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.356559 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355787    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-socket-dir\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.356559 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355807    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.356559 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355841    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-run-netns\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.356559 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355876    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-run-systemd\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.356559 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355893    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-cni-bin\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.356559 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355907    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/97b45f77-6012-44e8-ad30-564e7d1f2a5d-ovn-node-metrics-cert\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.356559 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355921    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-host\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.356559 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355934    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-run-k8s-cni-cncf-io\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.356559 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355947    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-multus-conf-dir\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.356559 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.355967    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e70ff23e-293b-47b9-a239-2d63b2bfb912-iptables-alerter-script\") pod \"iptables-alerter-rrlns\" (UID: \"e70ff23e-293b-47b9-a239-2d63b2bfb912\") " pod="openshift-network-operator/iptables-alerter-rrlns"
Sep 18 16:49:12.363918 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.363890    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 16:49:12.419652 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.419609    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jvnsl"
Sep 18 16:49:12.432881 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.432850    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jvnsl"
Sep 18 16:49:12.456657 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.456623    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e70ff23e-293b-47b9-a239-2d63b2bfb912-iptables-alerter-script\") pod \"iptables-alerter-rrlns\" (UID: \"e70ff23e-293b-47b9-a239-2d63b2bfb912\") " pod="openshift-network-operator/iptables-alerter-rrlns"
Sep 18 16:49:12.456657 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.456657    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4fpr\" (UniqueName: \"kubernetes.io/projected/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-kube-api-access-z4fpr\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.456990 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.456677    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-sysconfig\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.456990 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.456702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-lib-modules\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.456990 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.456725    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c8f58056-1c0d-498e-9518-a3b9654d6cf3-serviceca\") pod \"node-ca-cfqfc\" (UID: \"c8f58056-1c0d-498e-9518-a3b9654d6cf3\") " pod="openshift-image-registry/node-ca-cfqfc"
Sep 18 16:49:12.456990 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.456796    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-sysconfig\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.456990 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.456886    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-run-multus-certs\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.456990 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.456857    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-run-multus-certs\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.456990 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.456891    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-lib-modules\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.456990 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.456944    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-sysctl-d\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.456990 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.456974    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-sysctl-conf\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.456999    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvk7q\" (UniqueName: \"kubernetes.io/projected/c8f58056-1c0d-498e-9518-a3b9654d6cf3-kube-api-access-jvk7q\") pod \"node-ca-cfqfc\" (UID: \"c8f58056-1c0d-498e-9518-a3b9654d6cf3\") " pod="openshift-image-registry/node-ca-cfqfc"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457022    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457047    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30c32c6a-c36c-4433-adff-277ef3fa3b16-agent-certs\") pod \"konnectivity-agent-hxlkv\" (UID: \"30c32c6a-c36c-4433-adff-277ef3fa3b16\") " pod="kube-system/konnectivity-agent-hxlkv"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-multus-cni-dir\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457096    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-sysctl-d\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-multus-socket-dir-parent\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457146    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-var-lib-openvswitch\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457173    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk5rm\" (UniqueName: \"kubernetes.io/projected/18eb2d6b-f8ae-4a54-80fa-169af7344318-kube-api-access-hk5rm\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457182    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-sysctl-conf\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457192    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c8f58056-1c0d-498e-9518-a3b9654d6cf3-serviceca\") pod \"node-ca-cfqfc\" (UID: \"c8f58056-1c0d-498e-9518-a3b9654d6cf3\") " pod="openshift-image-registry/node-ca-cfqfc"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457201    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-var-lib-kubelet\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457211    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-multus-socket-dir-parent\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457231    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/97b45f77-6012-44e8-ad30-564e7d1f2a5d-env-overrides\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.457278    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457284    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e70ff23e-293b-47b9-a239-2d63b2bfb912-iptables-alerter-script\") pod \"iptables-alerter-rrlns\" (UID: \"e70ff23e-293b-47b9-a239-2d63b2bfb912\") " pod="openshift-network-operator/iptables-alerter-rrlns"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457318    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e70ff23e-293b-47b9-a239-2d63b2bfb912-host-slash\") pod \"iptables-alerter-rrlns\" (UID: \"e70ff23e-293b-47b9-a239-2d63b2bfb912\") " pod="openshift-network-operator/iptables-alerter-rrlns"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457335    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-var-lib-kubelet\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.457394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457341    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-multus-cni-dir\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457283    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e70ff23e-293b-47b9-a239-2d63b2bfb912-host-slash\") pod \"iptables-alerter-rrlns\" (UID: \"e70ff23e-293b-47b9-a239-2d63b2bfb912\") " pod="openshift-network-operator/iptables-alerter-rrlns"
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.457347    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret podName:46fb0981-ac5c-4e2b-8212-adae49d948c4 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:12.957325683 +0000 UTC m=+3.682607424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret") pod "global-pull-secret-syncer-v7vnw" (UID: "46fb0981-ac5c-4e2b-8212-adae49d948c4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457390    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-var-lib-openvswitch\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457398    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-system-cni-dir\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457423    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-systemd\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457431    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-system-cni-dir\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457451    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-node-log\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457478    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-sys-fs\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457482    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-systemd\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457501    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-node-log\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457532    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-sys-fs\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457521    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457503    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457588    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-run\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457624    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-var-lib-kubelet\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30c32c6a-c36c-4433-adff-277ef3fa3b16-konnectivity-ca\") pod \"konnectivity-agent-hxlkv\" (UID: \"30c32c6a-c36c-4433-adff-277ef3fa3b16\") " pod="kube-system/konnectivity-agent-hxlkv"
Sep 18 16:49:12.458266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457693    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-run-netns\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457719    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-cni-netd\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457777    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-sys\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457786    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/97b45f77-6012-44e8-ad30-564e7d1f2a5d-env-overrides\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-tuned\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457872    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-var-lib-cni-bin\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457879    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-run-netns\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457894    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-kubernetes\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457919    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-system-cni-dir\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457933    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-var-lib-kubelet\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457960    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2pqs\" (UniqueName: \"kubernetes.io/projected/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-kube-api-access-z2pqs\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457993    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-kubelet\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-cni-binary-copy\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458038    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458043    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/46fb0981-ac5c-4e2b-8212-adae49d948c4-dbus\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458085    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-etc-kubernetes\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458112    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6ms5\" (UniqueName: \"kubernetes.io/projected/e70ff23e-293b-47b9-a239-2d63b2bfb912-kube-api-access-n6ms5\") pod \"iptables-alerter-rrlns\" (UID: \"e70ff23e-293b-47b9-a239-2d63b2bfb912\") " pod="openshift-network-operator/iptables-alerter-rrlns"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458098    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/46fb0981-ac5c-4e2b-8212-adae49d948c4-dbus\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:12.459131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.457659    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-run\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-log-socket\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458178    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-var-lib-cni-bin\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458182    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs\") pod \"network-metrics-daemon-qmx4b\" (UID: \"83b73597-6182-4df7-bcf5-f6ca3ba721cd\") " pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458211    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-device-dir\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458235    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-multus-daemon-config\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458240    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-log-socket\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458237    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-kubernetes\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458263    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-slash\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458291    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-kubelet\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458296    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-run-ovn\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458321    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8f58056-1c0d-498e-9518-a3b9654d6cf3-host\") pod \"node-ca-cfqfc\" (UID: \"c8f58056-1c0d-498e-9518-a3b9654d6cf3\") " pod="openshift-image-registry/node-ca-cfqfc"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458335    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-system-cni-dir\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458344    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-etc-openvswitch\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458377    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458387    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-etc-openvswitch\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458415    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30c32c6a-c36c-4433-adff-277ef3fa3b16-konnectivity-ca\") pod \"konnectivity-agent-hxlkv\" (UID: \"30c32c6a-c36c-4433-adff-277ef3fa3b16\") " pod="kube-system/konnectivity-agent-hxlkv"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458465    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-device-dir\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.460195 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458213    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-etc-kubernetes\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.458495    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458521    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-cni-netd\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458526    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-slash\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.458552    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs podName:83b73597-6182-4df7-bcf5-f6ca3ba721cd nodeName:}" failed. No retries permitted until 2026-09-18 16:49:12.958534949 +0000 UTC m=+3.683816701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs") pod "network-metrics-daemon-qmx4b" (UID: "83b73597-6182-4df7-bcf5-f6ca3ba721cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458557    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-run-ovn\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458405    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8xht\" (UniqueName: \"kubernetes.io/projected/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-kube-api-access-q8xht\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458597    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-cnibin\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458603    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458608    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8f58056-1c0d-498e-9518-a3b9654d6cf3-host\") pod \"node-ca-cfqfc\" (UID: \"c8f58056-1c0d-498e-9518-a3b9654d6cf3\") " pod="openshift-image-registry/node-ca-cfqfc"
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458623    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458619    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-sys\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458643    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-cnibin\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458676    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fgtq\" (UniqueName: \"kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq\") pod \"network-check-target-lrm4v\" (UID: \"1cfbfb52-83e8-4208-aa4f-de27397133d4\") " pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458701    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-hostroot\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458711    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-cni-binary-copy\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.461051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458724    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-systemd-units\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458755    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/97b45f77-6012-44e8-ad30-564e7d1f2a5d-ovnkube-config\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458763    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-systemd-units\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458784    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-registration-dir\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458777    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458804    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-hostroot\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458838    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18eb2d6b-f8ae-4a54-80fa-169af7344318-tmp\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/46fb0981-ac5c-4e2b-8212-adae49d948c4-kubelet-config\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458880    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-registration-dir\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458888    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-cnibin\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458918    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-cni-binary-copy\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458943    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/97b45f77-6012-44e8-ad30-564e7d1f2a5d-ovnkube-script-lib\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458967    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbgng\" (UniqueName: \"kubernetes.io/projected/83b73597-6182-4df7-bcf5-f6ca3ba721cd-kube-api-access-zbgng\") pod \"network-metrics-daemon-qmx4b\" (UID: \"83b73597-6182-4df7-bcf5-f6ca3ba721cd\") " pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.458991    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459007    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-cnibin\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459014    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-modprobe-d\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459039    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-var-lib-cni-multus\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.461769 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459054    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/46fb0981-ac5c-4e2b-8212-adae49d948c4-kubelet-config\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459058    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-run-openvswitch\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459099    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-run-openvswitch\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459114    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-multus-daemon-config\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459121    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cslcm\" (UniqueName: \"kubernetes.io/projected/97b45f77-6012-44e8-ad30-564e7d1f2a5d-kube-api-access-cslcm\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459147    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-socket-dir\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459184    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459216    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-var-lib-cni-multus\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459335    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459351    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-run-netns\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459410    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/97b45f77-6012-44e8-ad30-564e7d1f2a5d-ovnkube-config\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459415    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-run-systemd\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459445    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-socket-dir\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459457    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-run-systemd\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459485    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.462572 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459487    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-cni-bin\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.463307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459504    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.463307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459457    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-cni-bin\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.463307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.459888    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-modprobe-d\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.463307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.460105    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97b45f77-6012-44e8-ad30-564e7d1f2a5d-host-run-netns\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.463307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.460291    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/97b45f77-6012-44e8-ad30-564e7d1f2a5d-ovnkube-script-lib\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.463307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.460429    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-cni-binary-copy\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.463307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.460507    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/97b45f77-6012-44e8-ad30-564e7d1f2a5d-ovn-node-metrics-cert\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.463307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.460796    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-host\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.463307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.461225    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-run-k8s-cni-cncf-io\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.463307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.461260    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-multus-conf-dir\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.463307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.461314    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18eb2d6b-f8ae-4a54-80fa-169af7344318-host\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.463307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.461352    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-multus-conf-dir\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.463307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.461401    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-host-run-k8s-cni-cncf-io\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.463307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.462209    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18eb2d6b-f8ae-4a54-80fa-169af7344318-tmp\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.463307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.462294    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30c32c6a-c36c-4433-adff-277ef3fa3b16-agent-certs\") pod \"konnectivity-agent-hxlkv\" (UID: \"30c32c6a-c36c-4433-adff-277ef3fa3b16\") " pod="kube-system/konnectivity-agent-hxlkv"
Sep 18 16:49:12.464627 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.464082    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/97b45f77-6012-44e8-ad30-564e7d1f2a5d-ovn-node-metrics-cert\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.465180 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.465161    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/18eb2d6b-f8ae-4a54-80fa-169af7344318-etc-tuned\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.468532 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.468504    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:49:12.468653 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.468537    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:49:12.468653 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.468561    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6fgtq for pod openshift-network-diagnostics/network-check-target-lrm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:49:12.469315 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.468721    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4fpr\" (UniqueName: \"kubernetes.io/projected/80c9ac89-c6b7-463f-aea6-f7be8d982fe6-kube-api-access-z4fpr\") pod \"multus-additional-cni-plugins-29gsb\" (UID: \"80c9ac89-c6b7-463f-aea6-f7be8d982fe6\") " pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.469315 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.468787    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq podName:1cfbfb52-83e8-4208-aa4f-de27397133d4 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:12.968766252 +0000 UTC m=+3.694047996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6fgtq" (UniqueName: "kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq") pod "network-check-target-lrm4v" (UID: "1cfbfb52-83e8-4208-aa4f-de27397133d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:49:12.469315 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.469058    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvk7q\" (UniqueName: \"kubernetes.io/projected/c8f58056-1c0d-498e-9518-a3b9654d6cf3-kube-api-access-jvk7q\") pod \"node-ca-cfqfc\" (UID: \"c8f58056-1c0d-498e-9518-a3b9654d6cf3\") " pod="openshift-image-registry/node-ca-cfqfc"
Sep 18 16:49:12.469761 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.469737    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk5rm\" (UniqueName: \"kubernetes.io/projected/18eb2d6b-f8ae-4a54-80fa-169af7344318-kube-api-access-hk5rm\") pod \"tuned-wk4h9\" (UID: \"18eb2d6b-f8ae-4a54-80fa-169af7344318\") " pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.470207 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.470184    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cslcm\" (UniqueName: \"kubernetes.io/projected/97b45f77-6012-44e8-ad30-564e7d1f2a5d-kube-api-access-cslcm\") pod \"ovnkube-node-s746c\" (UID: \"97b45f77-6012-44e8-ad30-564e7d1f2a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.470936 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.470886    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8xht\" (UniqueName: \"kubernetes.io/projected/ef967c67-dc31-4f9a-ad01-c10b00cbd6a2-kube-api-access-q8xht\") pod \"aws-ebs-csi-driver-node-qbppr\" (UID: \"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.471251 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.471232    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2pqs\" (UniqueName: \"kubernetes.io/projected/3eb943e2-ff5c-4e19-bb28-bbf46c305ed6-kube-api-access-z2pqs\") pod \"multus-lkvfz\" (UID: \"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6\") " pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.472129 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.472102    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbgng\" (UniqueName: \"kubernetes.io/projected/83b73597-6182-4df7-bcf5-f6ca3ba721cd-kube-api-access-zbgng\") pod \"network-metrics-daemon-qmx4b\" (UID: \"83b73597-6182-4df7-bcf5-f6ca3ba721cd\") " pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:12.473398 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.473377    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6ms5\" (UniqueName: \"kubernetes.io/projected/e70ff23e-293b-47b9-a239-2d63b2bfb912-kube-api-access-n6ms5\") pod \"iptables-alerter-rrlns\" (UID: \"e70ff23e-293b-47b9-a239-2d63b2bfb912\") " pod="openshift-network-operator/iptables-alerter-rrlns"
Sep 18 16:49:12.555338 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:12.555289    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2055c856ca58f4636c1d88b7bbb215d.slice/crio-dfbb3b1d6d89c5fc892cd84326c54c1a55c86621dceb8e2deedf6788d40f2505 WatchSource:0}: Error finding container dfbb3b1d6d89c5fc892cd84326c54c1a55c86621dceb8e2deedf6788d40f2505: Status 404 returned error can't find the container with id dfbb3b1d6d89c5fc892cd84326c54c1a55c86621dceb8e2deedf6788d40f2505
Sep 18 16:49:12.555907 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:12.555885    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f4244c68bf26c3467a2f7dbaa7bd7e6.slice/crio-24e680292876aaea646537747c8a975aba1d8e2dbe3671fe49b723cf6704feb3 WatchSource:0}: Error finding container 24e680292876aaea646537747c8a975aba1d8e2dbe3671fe49b723cf6704feb3: Status 404 returned error can't find the container with id 24e680292876aaea646537747c8a975aba1d8e2dbe3671fe49b723cf6704feb3
Sep 18 16:49:12.561234 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.561216    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 16:49:12.631695 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.631643    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lkvfz"
Sep 18 16:49:12.636272 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.636243    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:12.644926 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:12.644898    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb943e2_ff5c_4e19_bb28_bbf46c305ed6.slice/crio-f7c6d42f9a12e8e28e7dad440c79f491d53fa2a3d5e8af16a6319184d23f6c76 WatchSource:0}: Error finding container f7c6d42f9a12e8e28e7dad440c79f491d53fa2a3d5e8af16a6319184d23f6c76: Status 404 returned error can't find the container with id f7c6d42f9a12e8e28e7dad440c79f491d53fa2a3d5e8af16a6319184d23f6c76
Sep 18 16:49:12.648484 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:12.648451    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b45f77_6012_44e8_ad30_564e7d1f2a5d.slice/crio-dfe4775a11b89456c4823e882dcb2cc0fd4d776c0ae52dc2c7a49f97c099bf68 WatchSource:0}: Error finding container dfe4775a11b89456c4823e882dcb2cc0fd4d776c0ae52dc2c7a49f97c099bf68: Status 404 returned error can't find the container with id dfe4775a11b89456c4823e882dcb2cc0fd4d776c0ae52dc2c7a49f97c099bf68
Sep 18 16:49:12.651855 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.651804    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wk4h9"
Sep 18 16:49:12.661185 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:12.661153    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18eb2d6b_f8ae_4a54_80fa_169af7344318.slice/crio-ac1c2b853ee6c2fb6b5de0d19bc3de5ba7cafe6b2b502726e3f84c1e765b609c WatchSource:0}: Error finding container ac1c2b853ee6c2fb6b5de0d19bc3de5ba7cafe6b2b502726e3f84c1e765b609c: Status 404 returned error can't find the container with id ac1c2b853ee6c2fb6b5de0d19bc3de5ba7cafe6b2b502726e3f84c1e765b609c
Sep 18 16:49:12.665327 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.665304    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cfqfc"
Sep 18 16:49:12.672760 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.672736    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrlns"
Sep 18 16:49:12.674115 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:12.674089    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f58056_1c0d_498e_9518_a3b9654d6cf3.slice/crio-4ac783981ab5e3f328fcf0fd015b1f9dfb57dd902b9eab08acdc2cba83288a83 WatchSource:0}: Error finding container 4ac783981ab5e3f328fcf0fd015b1f9dfb57dd902b9eab08acdc2cba83288a83: Status 404 returned error can't find the container with id 4ac783981ab5e3f328fcf0fd015b1f9dfb57dd902b9eab08acdc2cba83288a83
Sep 18 16:49:12.681609 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:12.681586    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode70ff23e_293b_47b9_a239_2d63b2bfb912.slice/crio-a8cdb2b1394d2cd91c00e69cd87eabfb2be261ba13a9c27eb35ea767b1d3f12e WatchSource:0}: Error finding container a8cdb2b1394d2cd91c00e69cd87eabfb2be261ba13a9c27eb35ea767b1d3f12e: Status 404 returned error can't find the container with id a8cdb2b1394d2cd91c00e69cd87eabfb2be261ba13a9c27eb35ea767b1d3f12e
Sep 18 16:49:12.704105 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.704067    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hxlkv"
Sep 18 16:49:12.713005 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:12.712978    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c32c6a_c36c_4433_adff_277ef3fa3b16.slice/crio-a0ac04cc7144b04b419e59f4aa6cc78b3d30912997f051f6cd8466dc48d6526a WatchSource:0}: Error finding container a0ac04cc7144b04b419e59f4aa6cc78b3d30912997f051f6cd8466dc48d6526a: Status 404 returned error can't find the container with id a0ac04cc7144b04b419e59f4aa6cc78b3d30912997f051f6cd8466dc48d6526a
Sep 18 16:49:12.718351 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.718326    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr"
Sep 18 16:49:12.723540 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.723523    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-29gsb"
Sep 18 16:49:12.727429 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:12.727399    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef967c67_dc31_4f9a_ad01_c10b00cbd6a2.slice/crio-eebacde42ee426ab2f1965286b65841109fb3cd1ad6265aa4c20d2c2c8c0f529 WatchSource:0}: Error finding container eebacde42ee426ab2f1965286b65841109fb3cd1ad6265aa4c20d2c2c8c0f529: Status 404 returned error can't find the container with id eebacde42ee426ab2f1965286b65841109fb3cd1ad6265aa4c20d2c2c8c0f529
Sep 18 16:49:12.732465 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:49:12.732443    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c9ac89_c6b7_463f_aea6_f7be8d982fe6.slice/crio-fff6a55f89e6942edf00136f697e6f5066c4961bcdf0674694b0f51c6c8c4334 WatchSource:0}: Error finding container fff6a55f89e6942edf00136f697e6f5066c4961bcdf0674694b0f51c6c8c4334: Status 404 returned error can't find the container with id fff6a55f89e6942edf00136f697e6f5066c4961bcdf0674694b0f51c6c8c4334
Sep 18 16:49:12.963416 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.963336    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:12.963416 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:12.963386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs\") pod \"network-metrics-daemon-qmx4b\" (UID: \"83b73597-6182-4df7-bcf5-f6ca3ba721cd\") " pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:12.963587 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.963488    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:12.963587 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.963501    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:12.963587 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.963547    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs podName:83b73597-6182-4df7-bcf5-f6ca3ba721cd nodeName:}" failed. No retries permitted until 2026-09-18 16:49:13.963532466 +0000 UTC m=+4.688814193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs") pod "network-metrics-daemon-qmx4b" (UID: "83b73597-6182-4df7-bcf5-f6ca3ba721cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:12.963587 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:12.963560    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret podName:46fb0981-ac5c-4e2b-8212-adae49d948c4 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:13.963554486 +0000 UTC m=+4.688836209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret") pod "global-pull-secret-syncer-v7vnw" (UID: "46fb0981-ac5c-4e2b-8212-adae49d948c4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:13.064608 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.064047    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fgtq\" (UniqueName: \"kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq\") pod \"network-check-target-lrm4v\" (UID: \"1cfbfb52-83e8-4208-aa4f-de27397133d4\") " pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:13.064608 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:13.064222    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:49:13.064608 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:13.064242    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:49:13.064608 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:13.064254    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6fgtq for pod openshift-network-diagnostics/network-check-target-lrm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:49:13.064608 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:13.064313    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq podName:1cfbfb52-83e8-4208-aa4f-de27397133d4 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:14.064296098 +0000 UTC m=+4.789577822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6fgtq" (UniqueName: "kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq") pod "network-check-target-lrm4v" (UID: "1cfbfb52-83e8-4208-aa4f-de27397133d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:49:13.318730 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.318636    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:49:13.436246 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.436181    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 16:44:12 +0000 UTC" deadline="2028-06-23 11:51:08.42732768 +0000 UTC"
Sep 18 16:49:13.436246 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.436222    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15451h1m54.99111218s"
Sep 18 16:49:13.461417 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.461382    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:13.461586 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:13.461550    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:13.489596 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.489530    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr" event={"ID":"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2","Type":"ContainerStarted","Data":"eebacde42ee426ab2f1965286b65841109fb3cd1ad6265aa4c20d2c2c8c0f529"}
Sep 18 16:49:13.506791 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.506747    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" event={"ID":"97b45f77-6012-44e8-ad30-564e7d1f2a5d","Type":"ContainerStarted","Data":"dfe4775a11b89456c4823e882dcb2cc0fd4d776c0ae52dc2c7a49f97c099bf68"}
Sep 18 16:49:13.523638 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.523594    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lkvfz" event={"ID":"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6","Type":"ContainerStarted","Data":"f7c6d42f9a12e8e28e7dad440c79f491d53fa2a3d5e8af16a6319184d23f6c76"}
Sep 18 16:49:13.559911 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.559869    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-7.ec2.internal" event={"ID":"4f4244c68bf26c3467a2f7dbaa7bd7e6","Type":"ContainerStarted","Data":"24e680292876aaea646537747c8a975aba1d8e2dbe3671fe49b723cf6704feb3"}
Sep 18 16:49:13.595052 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.594899    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:49:13.617660 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.617582    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-29gsb" event={"ID":"80c9ac89-c6b7-463f-aea6-f7be8d982fe6","Type":"ContainerStarted","Data":"fff6a55f89e6942edf00136f697e6f5066c4961bcdf0674694b0f51c6c8c4334"}
Sep 18 16:49:13.644397 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.644359    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hxlkv" event={"ID":"30c32c6a-c36c-4433-adff-277ef3fa3b16","Type":"ContainerStarted","Data":"a0ac04cc7144b04b419e59f4aa6cc78b3d30912997f051f6cd8466dc48d6526a"}
Sep 18 16:49:13.662479 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.662436    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrlns" event={"ID":"e70ff23e-293b-47b9-a239-2d63b2bfb912","Type":"ContainerStarted","Data":"a8cdb2b1394d2cd91c00e69cd87eabfb2be261ba13a9c27eb35ea767b1d3f12e"}
Sep 18 16:49:13.670744 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.670701    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cfqfc" event={"ID":"c8f58056-1c0d-498e-9518-a3b9654d6cf3","Type":"ContainerStarted","Data":"4ac783981ab5e3f328fcf0fd015b1f9dfb57dd902b9eab08acdc2cba83288a83"}
Sep 18 16:49:13.688757 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.688706    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wk4h9" event={"ID":"18eb2d6b-f8ae-4a54-80fa-169af7344318","Type":"ContainerStarted","Data":"ac1c2b853ee6c2fb6b5de0d19bc3de5ba7cafe6b2b502726e3f84c1e765b609c"}
Sep 18 16:49:13.702595 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.702553    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal" event={"ID":"e2055c856ca58f4636c1d88b7bbb215d","Type":"ContainerStarted","Data":"dfbb3b1d6d89c5fc892cd84326c54c1a55c86621dceb8e2deedf6788d40f2505"}
Sep 18 16:49:13.972053 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.971841    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:13.972053 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.972039    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs\") pod \"network-metrics-daemon-qmx4b\" (UID: \"83b73597-6182-4df7-bcf5-f6ca3ba721cd\") " pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:13.972329 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:13.972165    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:13.972329 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:13.972227    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs podName:83b73597-6182-4df7-bcf5-f6ca3ba721cd nodeName:}" failed. No retries permitted until 2026-09-18 16:49:15.972208992 +0000 UTC m=+6.697490721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs") pod "network-metrics-daemon-qmx4b" (UID: "83b73597-6182-4df7-bcf5-f6ca3ba721cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:13.972571 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:13.971962    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:13.972662 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:13.972606    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret podName:46fb0981-ac5c-4e2b-8212-adae49d948c4 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:15.972590458 +0000 UTC m=+6.697872188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret") pod "global-pull-secret-syncer-v7vnw" (UID: "46fb0981-ac5c-4e2b-8212-adae49d948c4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:13.982921 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:13.982698    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:49:14.072877 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:14.072776    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fgtq\" (UniqueName: \"kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq\") pod \"network-check-target-lrm4v\" (UID: \"1cfbfb52-83e8-4208-aa4f-de27397133d4\") " pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:14.073194 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:14.073042    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:49:14.073194 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:14.073068    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:49:14.073194 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:14.073081    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6fgtq for pod openshift-network-diagnostics/network-check-target-lrm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:49:14.073523 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:14.073501    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq podName:1cfbfb52-83e8-4208-aa4f-de27397133d4 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:16.073475524 +0000 UTC m=+6.798757256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6fgtq" (UniqueName: "kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq") pod "network-check-target-lrm4v" (UID: "1cfbfb52-83e8-4208-aa4f-de27397133d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:49:14.436989 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:14.436845    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 16:44:12 +0000 UTC" deadline="2028-02-17 20:32:49.371428296 +0000 UTC"
Sep 18 16:49:14.436989 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:14.436913    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12411h43m34.934519356s"
Sep 18 16:49:14.458714 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:14.458680    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:14.458939 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:14.458825    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:14.459264 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:14.459243    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:14.459401 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:14.459362    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:14.742549 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:14.742465    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:49:15.459990 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:15.459953    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:15.460536 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:15.460102    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:15.991062 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:15.990778    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:15.991062 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:15.990875    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs\") pod \"network-metrics-daemon-qmx4b\" (UID: \"83b73597-6182-4df7-bcf5-f6ca3ba721cd\") " pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:15.991062 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:15.990933    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:15.991062 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:15.990980    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:15.991062 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:15.991008    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret podName:46fb0981-ac5c-4e2b-8212-adae49d948c4 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:19.99099051 +0000 UTC m=+10.716272255 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret") pod "global-pull-secret-syncer-v7vnw" (UID: "46fb0981-ac5c-4e2b-8212-adae49d948c4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:15.991062 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:15.991033    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs podName:83b73597-6182-4df7-bcf5-f6ca3ba721cd nodeName:}" failed. No retries permitted until 2026-09-18 16:49:19.991016565 +0000 UTC m=+10.716298294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs") pod "network-metrics-daemon-qmx4b" (UID: "83b73597-6182-4df7-bcf5-f6ca3ba721cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:16.092373 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:16.091748    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fgtq\" (UniqueName: \"kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq\") pod \"network-check-target-lrm4v\" (UID: \"1cfbfb52-83e8-4208-aa4f-de27397133d4\") " pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:16.092373 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:16.091942    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:49:16.092373 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:16.091963    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:49:16.092373 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:16.091975    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6fgtq for pod openshift-network-diagnostics/network-check-target-lrm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:49:16.092373 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:16.092042    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq podName:1cfbfb52-83e8-4208-aa4f-de27397133d4 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:20.092024021 +0000 UTC m=+10.817305769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6fgtq" (UniqueName: "kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq") pod "network-check-target-lrm4v" (UID: "1cfbfb52-83e8-4208-aa4f-de27397133d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:49:16.459444 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:16.459411    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:16.459444 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:16.459431    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:16.459739 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:16.459523    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:16.459954 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:16.459931    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:17.461001 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:17.460960    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:17.461430 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:17.461093    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:18.459444 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:18.459403    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:18.459620 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:18.459548    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:18.459937 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:18.459909    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:18.460070 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:18.459991    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:19.459036 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:19.458993    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:19.459520 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:19.459201    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:20.029012 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:20.028969    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:20.029192 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:20.029037    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs\") pod \"network-metrics-daemon-qmx4b\" (UID: \"83b73597-6182-4df7-bcf5-f6ca3ba721cd\") " pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:20.029192 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:20.029144    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:20.029192 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:20.029154    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:20.029312 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:20.029201    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs podName:83b73597-6182-4df7-bcf5-f6ca3ba721cd nodeName:}" failed. No retries permitted until 2026-09-18 16:49:28.029186667 +0000 UTC m=+18.754468395 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs") pod "network-metrics-daemon-qmx4b" (UID: "83b73597-6182-4df7-bcf5-f6ca3ba721cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:20.029312 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:20.029224    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret podName:46fb0981-ac5c-4e2b-8212-adae49d948c4 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:28.029206443 +0000 UTC m=+18.754488173 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret") pod "global-pull-secret-syncer-v7vnw" (UID: "46fb0981-ac5c-4e2b-8212-adae49d948c4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:20.130967 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:20.130290    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fgtq\" (UniqueName: \"kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq\") pod \"network-check-target-lrm4v\" (UID: \"1cfbfb52-83e8-4208-aa4f-de27397133d4\") " pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:20.130967 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:20.130499    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:49:20.130967 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:20.130519    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:49:20.130967 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:20.130532    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6fgtq for pod openshift-network-diagnostics/network-check-target-lrm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:49:20.130967 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:20.130584    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq podName:1cfbfb52-83e8-4208-aa4f-de27397133d4 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:28.130570997 +0000 UTC m=+18.855852721 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6fgtq" (UniqueName: "kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq") pod "network-check-target-lrm4v" (UID: "1cfbfb52-83e8-4208-aa4f-de27397133d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:49:20.459466 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:20.459423    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:20.459968 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:20.459555    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:20.460045 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:20.459984    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:20.460145 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:20.460094    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:21.460131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:21.460092    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:21.460513 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:21.460256    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:22.458974 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:22.458884    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:22.458974 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:22.458938    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:22.459159 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:22.459013    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:22.459159 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:22.459148    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:22.781582 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:22.781503    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-dnzc5"]
Sep 18 16:49:22.787759 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:22.787723    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dnzc5"
Sep 18 16:49:22.789938 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:22.789908    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 16:49:22.790117 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:22.789984    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jxt4w\""
Sep 18 16:49:22.790117 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:22.789912    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 16:49:22.854130 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:22.854089    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqkhw\" (UniqueName: \"kubernetes.io/projected/408e7f72-5486-4ec3-9bd8-1a371f4e8160-kube-api-access-jqkhw\") pod \"node-resolver-dnzc5\" (UID: \"408e7f72-5486-4ec3-9bd8-1a371f4e8160\") " pod="openshift-dns/node-resolver-dnzc5"
Sep 18 16:49:22.854330 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:22.854203    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/408e7f72-5486-4ec3-9bd8-1a371f4e8160-tmp-dir\") pod \"node-resolver-dnzc5\" (UID: \"408e7f72-5486-4ec3-9bd8-1a371f4e8160\") " pod="openshift-dns/node-resolver-dnzc5"
Sep 18 16:49:22.854330 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:22.854235    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/408e7f72-5486-4ec3-9bd8-1a371f4e8160-hosts-file\") pod \"node-resolver-dnzc5\" (UID: \"408e7f72-5486-4ec3-9bd8-1a371f4e8160\") " pod="openshift-dns/node-resolver-dnzc5"
Sep 18 16:49:22.954596 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:22.954555    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/408e7f72-5486-4ec3-9bd8-1a371f4e8160-tmp-dir\") pod \"node-resolver-dnzc5\" (UID: \"408e7f72-5486-4ec3-9bd8-1a371f4e8160\") " pod="openshift-dns/node-resolver-dnzc5"
Sep 18 16:49:22.954786 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:22.954607    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/408e7f72-5486-4ec3-9bd8-1a371f4e8160-hosts-file\") pod \"node-resolver-dnzc5\" (UID: \"408e7f72-5486-4ec3-9bd8-1a371f4e8160\") " pod="openshift-dns/node-resolver-dnzc5"
Sep 18 16:49:22.954786 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:22.954696    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/408e7f72-5486-4ec3-9bd8-1a371f4e8160-hosts-file\") pod \"node-resolver-dnzc5\" (UID: \"408e7f72-5486-4ec3-9bd8-1a371f4e8160\") " pod="openshift-dns/node-resolver-dnzc5"
Sep 18 16:49:22.954786 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:22.954732    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqkhw\" (UniqueName: \"kubernetes.io/projected/408e7f72-5486-4ec3-9bd8-1a371f4e8160-kube-api-access-jqkhw\") pod \"node-resolver-dnzc5\" (UID: \"408e7f72-5486-4ec3-9bd8-1a371f4e8160\") " pod="openshift-dns/node-resolver-dnzc5"
Sep 18 16:49:22.955034 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:22.954987    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/408e7f72-5486-4ec3-9bd8-1a371f4e8160-tmp-dir\") pod \"node-resolver-dnzc5\" (UID: \"408e7f72-5486-4ec3-9bd8-1a371f4e8160\") " pod="openshift-dns/node-resolver-dnzc5"
Sep 18 16:49:22.967334 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:22.967297    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqkhw\" (UniqueName: \"kubernetes.io/projected/408e7f72-5486-4ec3-9bd8-1a371f4e8160-kube-api-access-jqkhw\") pod \"node-resolver-dnzc5\" (UID: \"408e7f72-5486-4ec3-9bd8-1a371f4e8160\") " pod="openshift-dns/node-resolver-dnzc5"
Sep 18 16:49:23.098827 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:23.098716    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dnzc5"
Sep 18 16:49:23.458531 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:23.458493    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:23.458722 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:23.458635    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:24.459171 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:24.459135    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:24.459171 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:24.459179    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:24.459686 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:24.459267    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:24.459686 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:24.459443    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:25.459427 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:25.459380    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:25.459929 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:25.459539    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:26.458726 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:26.458687    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:26.458949 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:26.458687    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:26.458949 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:26.458809    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:26.459064 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:26.458938    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:27.459105 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:27.459066    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:27.459589 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:27.459206    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:28.092481 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:28.092439    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:28.092715 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:28.092505    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs\") pod \"network-metrics-daemon-qmx4b\" (UID: \"83b73597-6182-4df7-bcf5-f6ca3ba721cd\") " pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:28.092715 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:28.092639    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:28.092715 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:28.092648    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:28.092715 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:28.092706    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs podName:83b73597-6182-4df7-bcf5-f6ca3ba721cd nodeName:}" failed. No retries permitted until 2026-09-18 16:49:44.092690117 +0000 UTC m=+34.817971844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs") pod "network-metrics-daemon-qmx4b" (UID: "83b73597-6182-4df7-bcf5-f6ca3ba721cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:28.092887 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:28.092721    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret podName:46fb0981-ac5c-4e2b-8212-adae49d948c4 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:44.092714629 +0000 UTC m=+34.817996353 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret") pod "global-pull-secret-syncer-v7vnw" (UID: "46fb0981-ac5c-4e2b-8212-adae49d948c4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:28.193138 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:28.193093    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fgtq\" (UniqueName: \"kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq\") pod \"network-check-target-lrm4v\" (UID: \"1cfbfb52-83e8-4208-aa4f-de27397133d4\") " pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:28.193333 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:28.193286    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:49:28.193333 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:28.193311    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:49:28.193333 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:28.193321    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6fgtq for pod openshift-network-diagnostics/network-check-target-lrm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:49:28.193482 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:28.193380    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq podName:1cfbfb52-83e8-4208-aa4f-de27397133d4 nodeName:}" failed. No retries permitted until 2026-09-18 16:49:44.193361457 +0000 UTC m=+34.918643206 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6fgtq" (UniqueName: "kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq") pod "network-check-target-lrm4v" (UID: "1cfbfb52-83e8-4208-aa4f-de27397133d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:49:28.458516 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:28.458470    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:28.458739 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:28.458488    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:28.458739 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:28.458606    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:28.458739 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:28.458713    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:29.459086 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:29.459038    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:29.459551 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:29.459174    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:30.459407 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:30.459362    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:30.459407 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:30.459419    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:30.459993 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:30.459522    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:30.459993 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:30.459939    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:31.459123 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:31.459087    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:31.459328 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:31.459201    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:31.741328 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:31.741295    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dnzc5" event={"ID":"408e7f72-5486-4ec3-9bd8-1a371f4e8160","Type":"ContainerStarted","Data":"712292409d67df64654c18eca139275eb7887680b5df0e5204dc6e6f830eb14a"}
Sep 18 16:49:32.458743 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.458472    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:32.458897 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.458509    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:32.458957 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:32.458925    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:32.459046 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:32.459027    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:32.745648 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.745614    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr" event={"ID":"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2","Type":"ContainerStarted","Data":"cd701f03e739fd7a1d8153993e4a202d6c495aaf52505710e4a3d841fad7454a"}
Sep 18 16:49:32.751613 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.751584    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" event={"ID":"97b45f77-6012-44e8-ad30-564e7d1f2a5d","Type":"ContainerStarted","Data":"ef9e669261734c9719174a442bd2d6b0b62d7f704f784aac357c76c9e133e552"}
Sep 18 16:49:32.751715 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.751697    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" event={"ID":"97b45f77-6012-44e8-ad30-564e7d1f2a5d","Type":"ContainerStarted","Data":"3fd8ccdb859d55049caf9f67cd39390b21be98d882526d8e828b174a4fddf9ea"}
Sep 18 16:49:32.751761 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.751737    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" event={"ID":"97b45f77-6012-44e8-ad30-564e7d1f2a5d","Type":"ContainerStarted","Data":"2f73c40623a1ad398a809b0fc99d4bf0bf21c4a7712d81dfcebfc851c44943c8"}
Sep 18 16:49:32.751801 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.751767    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" event={"ID":"97b45f77-6012-44e8-ad30-564e7d1f2a5d","Type":"ContainerStarted","Data":"256e74b77fc279dd9c76cc122c02e82b3428703b490f1159e57f161257056e53"}
Sep 18 16:49:32.751801 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.751796    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" event={"ID":"97b45f77-6012-44e8-ad30-564e7d1f2a5d","Type":"ContainerStarted","Data":"74d0275e1f6a3407a075d3f5f6928a12df6db49cc56593581af7990f06a81039"}
Sep 18 16:49:32.753223 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.753190    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lkvfz" event={"ID":"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6","Type":"ContainerStarted","Data":"a863a874a5e530713bd2241459f860a5f559f6219306802840f9596e692ed399"}
Sep 18 16:49:32.755149 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.755118    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-7.ec2.internal" event={"ID":"4f4244c68bf26c3467a2f7dbaa7bd7e6","Type":"ContainerStarted","Data":"26016ed400b46a23e505d1941470defe4022339ba37180674bc99d68e5f31026"}
Sep 18 16:49:32.756928 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.756897    2583 generic.go:356] "Generic (PLEG): container finished" podID="80c9ac89-c6b7-463f-aea6-f7be8d982fe6" containerID="0c28abd46e43c4c272aab0216002d96acb94364b6e0befc1bc91367682165917" exitCode=0
Sep 18 16:49:32.757050 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.756989    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-29gsb" event={"ID":"80c9ac89-c6b7-463f-aea6-f7be8d982fe6","Type":"ContainerDied","Data":"0c28abd46e43c4c272aab0216002d96acb94364b6e0befc1bc91367682165917"}
Sep 18 16:49:32.758674 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.758651    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hxlkv" event={"ID":"30c32c6a-c36c-4433-adff-277ef3fa3b16","Type":"ContainerStarted","Data":"82b8e7691ff4301c9ad6bfe2672594f29d7d57f4e333a2ade2014e9a74fca018"}
Sep 18 16:49:32.760467 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.760441    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cfqfc" event={"ID":"c8f58056-1c0d-498e-9518-a3b9654d6cf3","Type":"ContainerStarted","Data":"cb2ef91ae14e277a020b58cb4d7849631addf8568504c25ca9d5e69e8d9dd269"}
Sep 18 16:49:32.762013 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.761988    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wk4h9" event={"ID":"18eb2d6b-f8ae-4a54-80fa-169af7344318","Type":"ContainerStarted","Data":"121b9805a609430d1a58fc7e205e1b90d73f9175274ad280824f395c1a6c51fd"}
Sep 18 16:49:32.763894 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.763871    2583 generic.go:356] "Generic (PLEG): container finished" podID="e2055c856ca58f4636c1d88b7bbb215d" containerID="3150e655e793dac92599a572e5899eb3bfde058cc9e6622154c6be300601c173" exitCode=0
Sep 18 16:49:32.763997 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.763943    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal" event={"ID":"e2055c856ca58f4636c1d88b7bbb215d","Type":"ContainerDied","Data":"3150e655e793dac92599a572e5899eb3bfde058cc9e6622154c6be300601c173"}
Sep 18 16:49:32.765276 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.765256    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dnzc5" event={"ID":"408e7f72-5486-4ec3-9bd8-1a371f4e8160","Type":"ContainerStarted","Data":"ac897ca2111dd9df3b48abdb3d22bbd6b8aa67890a6bee59ba7e50b19d4b84a3"}
Sep 18 16:49:32.780503 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.780450    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lkvfz" podStartSLOduration=2.5488078119999997 podStartE2EDuration="21.780434879s" totalImagesPullingTime="19.231627067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:32.779764152 +0000 UTC m=+23.505045898" watchObservedRunningTime="2026-09-18 16:49:32.780434879 +0000 UTC m=+23.505716625"
Sep 18 16:49:32.799280 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.799229    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hxlkv" podStartSLOduration=6.923627877 podStartE2EDuration="21.799213082s" totalImagesPullingTime="14.875585205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:32.798765841 +0000 UTC m=+23.524047587" watchObservedRunningTime="2026-09-18 16:49:32.799213082 +0000 UTC m=+23.524494825"
Sep 18 16:49:32.859562 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.859503    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dnzc5" podStartSLOduration=10.859479265000001 podStartE2EDuration="10.859479265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:49:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:32.840394846 +0000 UTC m=+23.565676592" watchObservedRunningTime="2026-09-18 16:49:32.859479265 +0000 UTC m=+23.584761014"
Sep 18 16:49:32.859795 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.859761    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-7.ec2.internal" podStartSLOduration=20.859749102 podStartE2EDuration="20.859749102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:49:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:32.85956244 +0000 UTC m=+23.584844186" watchObservedRunningTime="2026-09-18 16:49:32.859749102 +0000 UTC m=+23.585030849"
Sep 18 16:49:32.874976 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.874919    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cfqfc" podStartSLOduration=2.951678289 podStartE2EDuration="21.874902693s" totalImagesPullingTime="18.923224404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:32.874454783 +0000 UTC m=+23.599736529" watchObservedRunningTime="2026-09-18 16:49:32.874902693 +0000 UTC m=+23.600184438"
Sep 18 16:49:32.901703 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.901644    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wk4h9" podStartSLOduration=2.909599408 podStartE2EDuration="21.901625762s" totalImagesPullingTime="18.992026354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:32.901461755 +0000 UTC m=+23.626743501" watchObservedRunningTime="2026-09-18 16:49:32.901625762 +0000 UTC m=+23.626907508"
Sep 18 16:49:32.909177 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:32.909145    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:33.010929 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:33.010805    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:33.089353 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:33.089314    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:33.459063 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:33.458840    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:33.459261 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:33.459158    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:33.476871 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:33.476830    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:33.547753 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:33.547662    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:33.567112 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:33.567086    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cfqfc_c8f58056-1c0d-498e-9518-a3b9654d6cf3/node-ca/0.log"
Sep 18 16:49:33.649042 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:33.649001    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:33.769934 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:33.769897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrlns" event={"ID":"e70ff23e-293b-47b9-a239-2d63b2bfb912","Type":"ContainerStarted","Data":"49384231ef04088a93afdbdbc2ae7489db26a854ecc3efe2d80eeb93c1075f25"}
Sep 18 16:49:33.776113 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:33.776081    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" event={"ID":"97b45f77-6012-44e8-ad30-564e7d1f2a5d","Type":"ContainerStarted","Data":"c9b591088827dfea2aff6f6d5fd2d10fd3e3081f153710cba71975c9e65df035"}
Sep 18 16:49:33.791015 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:33.790926    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rrlns" podStartSLOduration=3.875206504 podStartE2EDuration="22.790903938s" totalImagesPullingTime="18.915697434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:33.789760928 +0000 UTC m=+24.515042673" watchObservedRunningTime="2026-09-18 16:49:33.790903938 +0000 UTC m=+24.516185685"
Sep 18 16:49:33.874394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:33.874364    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 16:49:34.020019 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:34.019980    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:34.117751 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:34.117626    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hxlkv"
Sep 18 16:49:34.118463 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:34.118436    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hxlkv"
Sep 18 16:49:34.119868 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:34.119839    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:34.429021 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:34.428796    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T16:49:33.874384594Z","UUID":"c4eab0d9-e17c-488e-a318-1f3870b42850","Handler":null,"Name":"","Endpoint":""}
Sep 18 16:49:34.430507 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:34.430473    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 16:49:34.430507 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:34.430506    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 16:49:34.459295 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:34.459252    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:34.459479 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:34.459250    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:34.459479 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:34.459403    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:34.459479 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:34.459445    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:34.549679 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:34.549641    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:34.781013 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:34.780915    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal" event={"ID":"e2055c856ca58f4636c1d88b7bbb215d","Type":"ContainerStarted","Data":"f292d3a1c7619a2c1f6cb012d64d1402886b72a2a58e359a096417a5e2dd57b1"}
Sep 18 16:49:34.784296 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:34.784255    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr" event={"ID":"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2","Type":"ContainerStarted","Data":"7427c947d4a3fb41b082e0faaa0a31fd02a039db032df629c89b4ffa83cc2276"}
Sep 18 16:49:34.799601 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:34.799545    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-7.ec2.internal" podStartSLOduration=22.799527197 podStartE2EDuration="22.799527197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:49:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:34.799085044 +0000 UTC m=+25.524366791" watchObservedRunningTime="2026-09-18 16:49:34.799527197 +0000 UTC m=+25.524808943"
Sep 18 16:49:35.072608 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:35.072578    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:35.458957 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:35.458930    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:35.459272 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:35.459248    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:35.630508 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:35.630473    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:35.789121 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:35.789084    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr" event={"ID":"ef967c67-dc31-4f9a-ad01-c10b00cbd6a2","Type":"ContainerStarted","Data":"0f8b061ba4b2a660720d6c6bdc584086fcea332b1549194913cefbe924cfc9c0"}
Sep 18 16:49:35.793712 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:35.793686    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 16:49:35.793920 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:35.793679    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" event={"ID":"97b45f77-6012-44e8-ad30-564e7d1f2a5d","Type":"ContainerStarted","Data":"e394aae41261dab22a13999fe1de578091be19a7c68bf81973a1844fb94235b9"}
Sep 18 16:49:35.807674 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:35.807619    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbppr" podStartSLOduration=3.031891605 podStartE2EDuration="24.807600126s" totalImagesPullingTime="21.775708521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:49:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:35.807486244 +0000 UTC m=+26.532767992" watchObservedRunningTime="2026-09-18 16:49:35.807600126 +0000 UTC m=+26.532881857"
Sep 18 16:49:36.107149 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:36.107039    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:36.207397 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:36.207359    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:36.357539 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:36.357466    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:36.457051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:36.457015    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:36.459024 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:36.459001    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:36.459168 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:36.459105    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:36.459168 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:36.459159    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:36.459290 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:36.459267    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:36.559015 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:36.558983    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:36.687518 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:36.687489    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:36.789664 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:36.789628    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:36.886508 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:36.886477    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:37.091259 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:37.091184    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:37.290463 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:37.289932    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hxlkv"
Sep 18 16:49:37.290463 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:37.290304    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 16:49:37.291172 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:37.290691    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hxlkv"
Sep 18 16:49:37.459265 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:37.459225    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:37.459407 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:37.459368    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:37.655425 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:37.655339    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:37.722806 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:37.722773    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:37.800852 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:37.800798    2583 generic.go:356] "Generic (PLEG): container finished" podID="80c9ac89-c6b7-463f-aea6-f7be8d982fe6" containerID="22918f9b60d8cf2940f55cb26a96e60796e8e99fe22bc7d7a5a6adf6a797fd98" exitCode=0
Sep 18 16:49:37.801505 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:37.800850    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-29gsb" event={"ID":"80c9ac89-c6b7-463f-aea6-f7be8d982fe6","Type":"ContainerDied","Data":"22918f9b60d8cf2940f55cb26a96e60796e8e99fe22bc7d7a5a6adf6a797fd98"}
Sep 18 16:49:37.805057 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:37.805035    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" event={"ID":"97b45f77-6012-44e8-ad30-564e7d1f2a5d","Type":"ContainerStarted","Data":"df8f9e94b4938c1cc6312daee0d2db74aacdba4edc397443ba071a30a286fc00"}
Sep 18 16:49:37.805266 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:37.805247    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:37.805327 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:37.805314    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:37.821337 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:37.821314    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:37.848981 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:37.848919    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" podStartSLOduration=7.520703644 podStartE2EDuration="26.848900859s" totalImagesPullingTime="19.328197215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:37.848381823 +0000 UTC m=+28.573663569" watchObservedRunningTime="2026-09-18 16:49:37.848900859 +0000 UTC m=+28.574182604"
Sep 18 16:49:38.057276 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:38.057196    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:38.454364 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:38.454340    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:38.458991 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:38.458963    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:38.459094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:38.458996    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:38.459142 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:38.459107    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:38.459223 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:38.459204    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:38.556668 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:38.556636    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:38.667203 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:38.667168    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:38.810078 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:38.809989    2583 generic.go:356] "Generic (PLEG): container finished" podID="80c9ac89-c6b7-463f-aea6-f7be8d982fe6" containerID="60c7554eaa39e2968df1095f19931d4b008266525c58a30ad1f3b82da85d4743" exitCode=0
Sep 18 16:49:38.810610 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:38.810068    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-29gsb" event={"ID":"80c9ac89-c6b7-463f-aea6-f7be8d982fe6","Type":"ContainerDied","Data":"60c7554eaa39e2968df1095f19931d4b008266525c58a30ad1f3b82da85d4743"}
Sep 18 16:49:38.810610 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:38.810569    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:38.828546 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:38.828521    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:49:38.831009 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:38.830983    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:38.961282 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:38.961254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:39.062454 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:39.062371    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:39.378557 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:39.378511    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:39.459167 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:39.459131    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:39.459346 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:39.459257    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:39.479707 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:39.479670    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:39.814394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:39.814364    2583 generic.go:356] "Generic (PLEG): container finished" podID="80c9ac89-c6b7-463f-aea6-f7be8d982fe6" containerID="52cca499a27144049c8ffb179cc9612d592a42bc7ac76c055ceaa7e0268a6328" exitCode=0
Sep 18 16:49:39.814790 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:39.814444    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-29gsb" event={"ID":"80c9ac89-c6b7-463f-aea6-f7be8d982fe6","Type":"ContainerDied","Data":"52cca499a27144049c8ffb179cc9612d592a42bc7ac76c055ceaa7e0268a6328"}
Sep 18 16:49:39.849931 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:39.849894    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:39.914398 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:39.914313    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:40.027381 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:40.027343    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:40.119268 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:40.119239    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:40.268136 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:40.268046    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:40.367641 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:40.367601    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:40.455500 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:40.455470    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:40.458477 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:40.458452    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:40.458477 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:40.458468    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:40.458659 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:40.458559    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:40.458730 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:40.458708    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:40.556525 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:40.556434    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:40.821457 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:40.821362    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:41.303274 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:41.303232    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:41.460242 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:41.460200    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:41.460412 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:41.460327    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:41.464391 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:41.464361    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:41.721428 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:41.721397    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:41.863223 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:41.863174    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:42.062176 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:42.062088    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:42.254070 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:42.254034    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:42.328104 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:42.328024    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:42.458943 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:42.458905    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:42.459120 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:42.458947    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:42.459120 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:42.459052    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:42.459246 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:42.459172    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:42.654827 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:42.654763    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:42.839611 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:42.839570    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:43.020389 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:43.020308    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:43.118157 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:43.118122    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:43.360294 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:43.360212    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:43.455726 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:43.455685    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:43.458763 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:43.458739    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:43.458908 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:43.458889    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:43.873542 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:43.873512    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:44.110615 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:44.110579    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:44.110615 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:44.110630    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs\") pod \"network-metrics-daemon-qmx4b\" (UID: \"83b73597-6182-4df7-bcf5-f6ca3ba721cd\") " pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:44.111190 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:44.110747    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:44.111190 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:44.110747    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:44.111190 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:44.110854    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs podName:83b73597-6182-4df7-bcf5-f6ca3ba721cd nodeName:}" failed. No retries permitted until 2026-09-18 16:50:16.110796627 +0000 UTC m=+66.836078365 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs") pod "network-metrics-daemon-qmx4b" (UID: "83b73597-6182-4df7-bcf5-f6ca3ba721cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:49:44.111190 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:44.110872    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret podName:46fb0981-ac5c-4e2b-8212-adae49d948c4 nodeName:}" failed. No retries permitted until 2026-09-18 16:50:16.110863742 +0000 UTC m=+66.836145466 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret") pod "global-pull-secret-syncer-v7vnw" (UID: "46fb0981-ac5c-4e2b-8212-adae49d948c4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:49:44.211628 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:44.211595    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fgtq\" (UniqueName: \"kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq\") pod \"network-check-target-lrm4v\" (UID: \"1cfbfb52-83e8-4208-aa4f-de27397133d4\") " pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:44.211780 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:44.211746    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:49:44.211780 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:44.211764    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:49:44.211780 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:44.211773    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6fgtq for pod openshift-network-diagnostics/network-check-target-lrm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:49:44.211919 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:44.211855    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq podName:1cfbfb52-83e8-4208-aa4f-de27397133d4 nodeName:}" failed. No retries permitted until 2026-09-18 16:50:16.211840431 +0000 UTC m=+66.937122154 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6fgtq" (UniqueName: "kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq") pod "network-check-target-lrm4v" (UID: "1cfbfb52-83e8-4208-aa4f-de27397133d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:49:44.261539 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:44.261505    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:44.459460 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:44.459374    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:44.459651 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:44.459374    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:44.459651 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:44.459498    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:44.459651 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:44.459576    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:44.671900 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:44.671870    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:44.828739 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:44.828658    2583 generic.go:356] "Generic (PLEG): container finished" podID="80c9ac89-c6b7-463f-aea6-f7be8d982fe6" containerID="7d62eb6b779858ca93a42013e401076177e3530c51d903f23d22cdf582356fc4" exitCode=0
Sep 18 16:49:44.828739 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:44.828714    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-29gsb" event={"ID":"80c9ac89-c6b7-463f-aea6-f7be8d982fe6","Type":"ContainerDied","Data":"7d62eb6b779858ca93a42013e401076177e3530c51d903f23d22cdf582356fc4"}
Sep 18 16:49:44.866522 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:44.866478    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:45.056553 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:45.056519    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:45.264522 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:45.264485    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:45.459455 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:45.459425    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:45.459646 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:45.459538    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:45.834155 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:45.834120    2583 generic.go:356] "Generic (PLEG): container finished" podID="80c9ac89-c6b7-463f-aea6-f7be8d982fe6" containerID="223d564dca28ff2528cd271d2f369ffc2837401ca548764d660a07d6060d971d" exitCode=0
Sep 18 16:49:45.834155 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:45.834161    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-29gsb" event={"ID":"80c9ac89-c6b7-463f-aea6-f7be8d982fe6","Type":"ContainerDied","Data":"223d564dca28ff2528cd271d2f369ffc2837401ca548764d660a07d6060d971d"}
Sep 18 16:49:46.057530 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:46.057315    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:46.200060 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:46.200029    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:46.314191 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:46.314156    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:46.382684 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:46.382648    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:46.458673 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:46.458580    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:46.458875 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:46.458712    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:46.458875 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:46.458761    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:46.458997 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:46.458873    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:46.461708 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:46.461683    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:46.563403 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:46.563371    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:46.678862 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:46.678829    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:46.779549 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:46.779474    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:46.840056 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:46.840015    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-29gsb" event={"ID":"80c9ac89-c6b7-463f-aea6-f7be8d982fe6","Type":"ContainerStarted","Data":"f0468b2ca7bae7335d5c392eb7309009e227ee20010afc0891aa806f7e15712d"}
Sep 18 16:49:46.868877 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:46.868844    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:47.082875 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:47.082791    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:47.174888 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:47.174857    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:47.308805 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:47.308772    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:47.459367 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:47.459333    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:47.459753 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:47.459439    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:47.799843 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:47.799743    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:47.900914 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:47.900885    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:48.097255 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:48.097174    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:48.194313 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:48.194278    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:48.316190 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:48.316159    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:48.458608 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:48.458577    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:48.458838 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:48.458579    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:48.458838 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:48.458689    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:48.458838 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:48.458746    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:48.719070 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:48.718987    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:49.458747 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:49.458710    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:49.458952 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:49.458848    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:50.458738 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:50.458699    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:50.458738 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:50.458742    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:50.459248 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:50.458844    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:50.459248 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:50.458969    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:51.459973 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:51.459942    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:51.460399 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:51.460060    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:52.104234 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:52.104197    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:52.458885 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:52.458835    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:52.459149 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:52.458834    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:52.459149 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:52.458955    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:52.459149 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:52.459029    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:52.573898 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:52.573865    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:53.045026 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:53.044993    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:53.459155 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:53.459120    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:53.459365 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:53.459230    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:53.483506 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:53.483468    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:53.960475 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:53.960443    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:54.387486 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:54.387454    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:54.459050 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:54.459017    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:54.459232 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:54.459025    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:54.459232 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:54.459129    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:54.459232 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:54.459207    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:54.807208 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:54.807124    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:54.937128 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:54.937096    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:55.038894 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:55.038858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:55.204402 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:55.204373    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:55.344432 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:55.344398    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:55.446047 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:55.446009    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:55.462344 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:55.462274    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:55.462476 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:55.462368    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:55.683122 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:55.683082    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:56.162085 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:56.162051    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:56.459000 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:56.458916    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:56.459000 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:56.458946    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:56.459186 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:56.459020    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:56.459186 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:56.459136    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:57.142983 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:57.142949    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:57.225094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:57.225058    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:57.461882 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:57.461794    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:57.462040 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:57.461911    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:49:58.458969 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:58.458931    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:49:58.459426 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:58.458936    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:49:58.459426 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:58.459060    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:49:58.459426 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:58.459121    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:49:58.771375 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:58.771290    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:58.919471 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:58.919432    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:59.019075 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:59.019034    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:59.249459 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:59.249424    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:49:59.459506 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:49:59.459473    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:49:59.459910 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:49:59.459585    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:00.459296 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:00.459260    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:00.459537 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:00.459360    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:00.459537 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:00.459417    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:00.459537 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:00.459517    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:01.461760 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:01.461732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:01.462192 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:01.461845    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:02.140123 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:02.140092    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:02.458915 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:02.458793    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:02.459093 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:02.458793    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:02.459093 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:02.458943    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:02.459093 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:02.459012    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:02.689227 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:02.689192    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:03.023130 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:03.023093    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:03.103026 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:03.102987    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:03.210551 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:03.210510    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:03.315435 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:03.315355    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:03.415970 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:03.415940    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:03.459446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:03.459410    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:03.459574 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:03.459553    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:03.676506 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:03.676473    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:04.230113 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:04.230082    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:04.331739 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:04.331706    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:04.392151 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:04.392125    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:04.458653 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:04.458619    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:04.458870 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:04.458619    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:04.458870 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:04.458729    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:04.458870 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:04.458833    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:04.735944 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:04.735911    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:05.201878 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:05.201841    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:05.459192 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:05.459102    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:05.459567 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:05.459214    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:05.929535 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:05.929497    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:06.451776 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:06.451750    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:06.458606 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:06.458589    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:06.458706 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:06.458690    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:06.458746 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:06.458736    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:06.458854 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:06.458838    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:06.931235 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:06.931194    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:07.388597 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:07.388570    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:07.459461 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:07.459419    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:07.459669 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:07.459536    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:07.459669 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:07.459566    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:07.459669 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:07.459618    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:07.899957 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:07.899919    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:08.401702 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:08.401666    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:08.458773 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:08.458737    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:08.458966 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:08.458904    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:09.458609 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:09.458564    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:09.459055 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:09.458564    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:09.459055 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:09.458677    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:09.459055 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:09.458779    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:10.459018 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:10.458979    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:10.459464 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:10.459119    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:10.670472 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:10.670436    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:10.828622 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:10.828521    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" podUID="97b45f77-6012-44e8-ad30-564e7d1f2a5d" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 18 16:50:11.189789 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:11.189747    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:11.459702 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:11.459615    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:11.460140 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:11.459722    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:11.460140 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:11.459772    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:11.460140 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:11.459881    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:11.743982 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:11.743886    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:12.316449 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:12.316411    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:12.459269 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:12.459233    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:12.459453 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:12.459361    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:12.827519 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:12.827487    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:12.968177 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:12.968144    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:13.069808 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:13.069772    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:13.335859 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:13.335801    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:13.458491 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:13.458456    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:13.458656 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:13.458594    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:13.458656 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:13.458643    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:13.458746 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:13.458729    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:13.901757 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:13.901716    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:14.458554 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:14.458520    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:14.458736 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:14.458644    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:15.028503 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:15.028463    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:15.459149 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:15.459115    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:15.459149 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:15.459157    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:15.459580 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:15.459241    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:15.459580 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:15.459358    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:16.132676 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:16.132636    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:16.132676 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:16.132688    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs\") pod \"network-metrics-daemon-qmx4b\" (UID: \"83b73597-6182-4df7-bcf5-f6ca3ba721cd\") " pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:16.133289 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:16.132791    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:50:16.133289 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:16.132793    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:50:16.133289 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:16.132861    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs podName:83b73597-6182-4df7-bcf5-f6ca3ba721cd nodeName:}" failed. No retries permitted until 2026-09-18 16:51:20.132846735 +0000 UTC m=+130.858128463 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs") pod "network-metrics-daemon-qmx4b" (UID: "83b73597-6182-4df7-bcf5-f6ca3ba721cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:50:16.133289 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:16.132890    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret podName:46fb0981-ac5c-4e2b-8212-adae49d948c4 nodeName:}" failed. No retries permitted until 2026-09-18 16:51:20.13287475 +0000 UTC m=+130.858156474 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret") pod "global-pull-secret-syncer-v7vnw" (UID: "46fb0981-ac5c-4e2b-8212-adae49d948c4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:50:16.233759 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:16.233717    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fgtq\" (UniqueName: \"kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq\") pod \"network-check-target-lrm4v\" (UID: \"1cfbfb52-83e8-4208-aa4f-de27397133d4\") " pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:16.233956 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:16.233858    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:50:16.233956 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:16.233873    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:50:16.233956 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:16.233883    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6fgtq for pod openshift-network-diagnostics/network-check-target-lrm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:50:16.233956 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:16.233930    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq podName:1cfbfb52-83e8-4208-aa4f-de27397133d4 nodeName:}" failed. No retries permitted until 2026-09-18 16:51:20.233917091 +0000 UTC m=+130.959198814 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6fgtq" (UniqueName: "kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq") pod "network-check-target-lrm4v" (UID: "1cfbfb52-83e8-4208-aa4f-de27397133d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:50:16.256633 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:16.256603    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:16.458849 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:16.458724    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:16.459034 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:16.458894    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:16.815097 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:16.815004    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:17.458549 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:17.458507    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:17.458977 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:17.458512    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:17.458977 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:17.458622    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:17.458977 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:17.458699    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:17.914486 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:17.914458    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/0.log"
Sep 18 16:50:17.914657 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:17.914497    2583 generic.go:356] "Generic (PLEG): container finished" podID="3eb943e2-ff5c-4e19-bb28-bbf46c305ed6" containerID="a863a874a5e530713bd2241459f860a5f559f6219306802840f9596e692ed399" exitCode=1
Sep 18 16:50:17.914657 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:17.914549    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lkvfz" event={"ID":"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6","Type":"ContainerDied","Data":"a863a874a5e530713bd2241459f860a5f559f6219306802840f9596e692ed399"}
Sep 18 16:50:17.914920 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:17.914904    2583 scope.go:117] "RemoveContainer" containerID="a863a874a5e530713bd2241459f860a5f559f6219306802840f9596e692ed399"
Sep 18 16:50:17.932717 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:17.932659    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-29gsb" podStartSLOduration=37.870682996 podStartE2EDuration="1m6.932639046s" totalImagesPullingTime="29.06195605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:49:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:46.863210271 +0000 UTC m=+37.588492017" watchObservedRunningTime="2026-09-18 16:50:17.932639046 +0000 UTC m=+68.657920793"
Sep 18 16:50:18.459504 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:18.459399    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:18.459927 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:18.459532    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:18.918977 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:18.918952    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/0.log"
Sep 18 16:50:18.919154 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:18.919025    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lkvfz" event={"ID":"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6","Type":"ContainerStarted","Data":"d12f50fa3022e6865831f14641d0c93f74d1d0e706e8dd829f7fc39c363e7740"}
Sep 18 16:50:19.101976 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:19.101945    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:19.460213 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:19.460175    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:19.460709 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:19.460308    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:19.460709 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:19.460175    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:19.460709 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:19.460504    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:19.585935 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:19.585883    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:20.092838 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:20.092792    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:20.458644 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:20.458591    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:20.458857 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:20.458722    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:20.628753 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:20.628627    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:21.120899 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:21.120869    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:21.459749 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:21.459655    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:21.459930 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:21.459753    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:21.459930 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:21.459843    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:21.460021 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:21.459934    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:21.646731 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:21.646694    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:22.176956 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:22.176917    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:22.458637 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:22.458542    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:22.458860 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:22.458687    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:23.187602 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:23.187566    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:23.459058 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:23.458780    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:23.459211 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:23.458846    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:23.459211 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:23.459098    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:23.459211 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:23.459146    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:23.649274 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:23.649243    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:24.095967 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:24.095932    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:24.459237 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:24.459204    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:24.459627 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:24.459319    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:24.540871 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:24.540843    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:25.146538 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:25.146504    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:25.459502 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:25.459401    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:25.459910 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:25.459537    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:25.459910 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:25.459569    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:25.459910 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:25.459643    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:25.635893 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:25.635854    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:26.145601 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:26.145560    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:26.459406 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:26.459317    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:26.459568 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:26.459445    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:27.458678 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:27.458646    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:27.458907 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:27.458643    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:27.458907 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:27.458762    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:27.458907 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:27.458846    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:28.459271 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:28.459235    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:28.459675 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:28.459344    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:29.458573 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:29.458536    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:29.458787 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:29.458642    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:29.458787 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:29.458692    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:29.458787 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:29.458773    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:30.458573 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:30.458538    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:30.458988 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:30.458658    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:31.459712 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:31.459683    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:31.460148 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:31.459762    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:31.460148 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:31.459801    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:31.460148 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:31.459867    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:32.459196 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:32.459154    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:32.459400 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:32.459294    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:33.458796 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:33.458755    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:33.459196 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:33.458888    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:33.459196 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:33.458948    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:33.459196 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:33.459050    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:34.459369 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:34.459333    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:34.459759 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:34.459452    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:35.459147 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:35.459110    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:35.459365 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:35.459215    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:35.459365 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:35.459117    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:35.459767 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:35.459444    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:36.459263 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:36.459213    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:36.459469 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:36.459434    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:37.458505 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:37.458465    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:37.458704 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:37.458484    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:37.458704 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:37.458611    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:37.458704 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:37.458653    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:38.222149 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:38.222107    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:38.459278 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:38.459242    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:38.459479 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:38.459459    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:39.459485 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:39.459444    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:39.459928 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:39.459564    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:39.459928 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:39.459572    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:39.459928 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:39.459668    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:39.911185 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:39.911140    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:40.459204 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:40.459166    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:40.459381 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:40.459278    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:40.793018 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:40.792929    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:40.827701 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:40.827668    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" podUID="97b45f77-6012-44e8-ad30-564e7d1f2a5d" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 18 16:50:41.279199 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:41.279165    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:41.460131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:41.460093    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:41.460328 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:41.460199    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:41.460328 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:41.460284    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:41.460465 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:41.460389    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:41.711117 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:41.711073    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:42.458834 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:42.458774    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:42.459215 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:42.458910    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:43.200119 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:43.200091    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dnzc5_408e7f72-5486-4ec3-9bd8-1a371f4e8160/dns-node-resolver/0.log"
Sep 18 16:50:43.458504 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:43.458432    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:43.458640 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:43.458435    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:43.458640 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:43.458526    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:43.458640 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:43.458594    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:44.199889 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:44.199860    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cfqfc_c8f58056-1c0d-498e-9518-a3b9654d6cf3/node-ca/0.log"
Sep 18 16:50:44.459433 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:44.459340    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:44.459638 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:44.459614    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:45.459285 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:45.459248    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:45.459680 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:45.459364    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:45.459680 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:45.459386    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:45.459680 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:45.459490    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:45.815856 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:45.815752    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:46.292484 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:46.292446    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:46.458963 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:46.458918    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:46.459132 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:46.459033    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:47.459419 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:47.459376    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:47.460051 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:47.459484    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:47.460051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:47.459538    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:47.460051 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:47.459626    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:48.458955 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:48.458912    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:48.459220 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:48.459198    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:49.458931 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:49.458893    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:49.459336 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:49.459035    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:49.459336 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:49.459080    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:49.459336 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:49.459171    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:49.920145 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:49.920109    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:50.458658 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:50.458626    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:50.458884 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:50.458737    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:50.488430 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:50.488381    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:51.459612 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:51.459570    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:51.459856 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:51.459658    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:51.459856 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:51.459723    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:51.460325 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:51.460292    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:51.470450 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:51.470412    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" podUID="97b45f77-6012-44e8-ad30-564e7d1f2a5d" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 18 16:50:52.459468 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:52.459424    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:52.459892 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:52.459539    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:53.459482 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:53.459444    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:53.459928 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:53.459459    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:53.459928 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:53.459556    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:53.459928 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:53.459655    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:53.619694 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:53.619662    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:50:54.458528 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:54.458474    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:54.458730 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:54.458601    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:55.459302 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:55.459267    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:55.459693 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:55.459375    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:55.459693 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:55.459422    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:55.459693 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:55.459515    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:56.458923 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:56.458883    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:56.459106 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:56.459005    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:57.458508 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:57.458475    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:57.458937 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:57.458587    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:57.458937 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:57.458660    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:57.458937 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:57.458742    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:58.458961 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:58.458921    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:50:58.459376 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:58.459257    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:50:59.459002 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:59.458965    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:50:59.459414 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:59.458965    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:50:59.459414 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:59.459081    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:50:59.459414 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:50:59.459136    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:50:59.921897 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:50:59.921858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:00.459468 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:00.459426    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:00.459887 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:00.459534    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:01.460373 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:01.460332    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:01.460768 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:01.460460    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:01.460768 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:01.460502    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:01.460768 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:01.460599    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:02.459071 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:02.459018    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:02.459269 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:02.459150    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:03.459108 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:03.459016    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:03.459108 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:03.459064    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:03.459527 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:03.459153    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:03.459527 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:03.459247    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:04.021571 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:04.021538    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/1.log"
Sep 18 16:51:04.021983 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:04.021961    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/0.log"
Sep 18 16:51:04.022083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:04.021995    2583 generic.go:356] "Generic (PLEG): container finished" podID="3eb943e2-ff5c-4e19-bb28-bbf46c305ed6" containerID="d12f50fa3022e6865831f14641d0c93f74d1d0e706e8dd829f7fc39c363e7740" exitCode=1
Sep 18 16:51:04.022083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:04.022053    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lkvfz" event={"ID":"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6","Type":"ContainerDied","Data":"d12f50fa3022e6865831f14641d0c93f74d1d0e706e8dd829f7fc39c363e7740"}
Sep 18 16:51:04.022160 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:04.022135    2583 scope.go:117] "RemoveContainer" containerID="a863a874a5e530713bd2241459f860a5f559f6219306802840f9596e692ed399"
Sep 18 16:51:04.022524 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:04.022503    2583 scope.go:117] "RemoveContainer" containerID="d12f50fa3022e6865831f14641d0c93f74d1d0e706e8dd829f7fc39c363e7740"
Sep 18 16:51:04.022679 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:04.022654    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-multus pod=multus-lkvfz_openshift-multus(3eb943e2-ff5c-4e19-bb28-bbf46c305ed6)\"" pod="openshift-multus/multus-lkvfz" podUID="3eb943e2-ff5c-4e19-bb28-bbf46c305ed6"
Sep 18 16:51:04.459343 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:04.459306    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:04.459744 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:04.459419    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:04.923143 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:04.923114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:05.025678 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:05.025655    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/1.log"
Sep 18 16:51:05.458465 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:05.458426    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:05.458465 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:05.458446    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:05.458727 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:05.458541    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:05.458727 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:05.458672    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:06.372586 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:06.372555    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:06.459295 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:06.459266    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:06.459463 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:06.459371    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:06.772131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:06.772035    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:07.351658 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:07.351623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:07.459068 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:07.459030    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:07.459444 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:07.459033    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:07.459444 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:07.459144    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:07.459444 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:07.459221    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:07.820999 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:07.820966    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:08.262118 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:08.262087    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:08.365717 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:08.365686    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:08.459270 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:08.459247    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:08.459622 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:08.459353    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:08.461694 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:08.461673    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:08.535858 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:08.535757    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:09.249138 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:09.249104    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:09.459203 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:09.459162    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:09.459203 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:09.459200    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:09.459644 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:09.459300    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:09.459644 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:09.459413    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:09.786840 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:09.786783    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:10.459216 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:10.459177    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:10.459396 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:10.459291    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:10.579025 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:10.578989    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:11.398609 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:11.398560    2583 kubelet_node_status.go:448] "Node not becoming ready in time after startup"
Sep 18 16:51:11.433517 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:11.433481    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:51:11.460158 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:11.460124    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:11.460654 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:11.460206    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:11.460654 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:11.460261    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:11.460654 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:11.460263    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:11.690744 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:11.690660    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:12.397026 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:12.396994    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:12.459190 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:12.459152    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:12.459345 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:12.459278    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:12.897130 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:12.897093    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:13.447868 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:13.447832    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:13.458870 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:13.458846    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:13.458983 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:13.458846    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:13.459062 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:13.458975    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:13.459062 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:13.459021    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:13.890835 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:13.890782    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:14.458684 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:14.458657    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:14.459083 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:14.458768    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:14.459154 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:14.459139    2583 scope.go:117] "RemoveContainer" containerID="d12f50fa3022e6865831f14641d0c93f74d1d0e706e8dd829f7fc39c363e7740"
Sep 18 16:51:15.047569 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:15.047495    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/1.log"
Sep 18 16:51:15.047569 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:15.047547    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lkvfz" event={"ID":"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6","Type":"ContainerStarted","Data":"be251019b73f81469266c560f775974e65cf3481bf90ea273786ef7eda27bb78"}
Sep 18 16:51:15.373827 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:15.373786    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:15.459166 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:15.459137    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:15.459166 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:15.459156    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:15.459737 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:15.459256    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:15.459737 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:15.459380    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:16.434584 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:16.434548    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:51:16.458982 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:16.458943    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:16.459148 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:16.459059    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:16.487489 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:16.487452    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:17.458467 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:17.458431    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:17.458638 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:17.458431    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:17.458638 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:17.458543    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:17.458740 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:17.458631    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:18.318678 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:18.318647    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:18.459245 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:18.459212    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:18.459343 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:18.459327    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:18.972316 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:18.972283    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:19.458899 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:19.458871    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:19.459277 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:19.458871    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:19.459277 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:19.458980    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:19.459277 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:19.459059    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:19.570048 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:19.570008    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:20.071750 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:20.071708    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:20.154395 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:20.154358    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:20.161399 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:20.161379    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs\") pod \"network-metrics-daemon-qmx4b\" (UID: \"83b73597-6182-4df7-bcf5-f6ca3ba721cd\") " pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:20.161467 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:20.161427    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:20.161534 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:20.161522    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:51:20.161582 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:20.161523    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:51:20.161582 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:20.161575    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret podName:46fb0981-ac5c-4e2b-8212-adae49d948c4 nodeName:}" failed. No retries permitted until 2026-09-18 16:53:22.161562177 +0000 UTC m=+252.886843901 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret") pod "global-pull-secret-syncer-v7vnw" (UID: "46fb0981-ac5c-4e2b-8212-adae49d948c4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:51:20.161683 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:20.161589    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs podName:83b73597-6182-4df7-bcf5-f6ca3ba721cd nodeName:}" failed. No retries permitted until 2026-09-18 16:53:22.161582157 +0000 UTC m=+252.886863880 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs") pod "network-metrics-daemon-qmx4b" (UID: "83b73597-6182-4df7-bcf5-f6ca3ba721cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:51:20.261749 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:20.261696    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fgtq\" (UniqueName: \"kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq\") pod \"network-check-target-lrm4v\" (UID: \"1cfbfb52-83e8-4208-aa4f-de27397133d4\") " pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:20.261955 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:20.261923    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:51:20.261955 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:20.261949    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:51:20.262066 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:20.261961    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6fgtq for pod openshift-network-diagnostics/network-check-target-lrm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:51:20.262066 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:20.262032    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq podName:1cfbfb52-83e8-4208-aa4f-de27397133d4 nodeName:}" failed. No retries permitted until 2026-09-18 16:53:22.262012686 +0000 UTC m=+252.987294428 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6fgtq" (UniqueName: "kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq") pod "network-check-target-lrm4v" (UID: "1cfbfb52-83e8-4208-aa4f-de27397133d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:51:20.458446 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:20.458410    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:20.458632 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:20.458547    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:20.711414 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:20.711325    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:21.206232 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:21.206199    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:21.435101 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:21.435057    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:51:21.459836 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:21.459731    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:21.460004 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:21.459834    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:21.460004 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:21.459943    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:21.460004 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:21.459833    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:21.469962 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:21.469921    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" podUID="97b45f77-6012-44e8-ad30-564e7d1f2a5d" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 18 16:51:22.458727 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:22.458689    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:22.459148 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:22.458834    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:23.459070 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:23.459026    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:23.459451 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:23.459145    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:23.459451 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:23.459200    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:23.459451 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:23.459291    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:24.458609 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:24.458572    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:24.458887 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:24.458693    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:25.141526 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:25.141470    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:25.459019 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:25.458914    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:25.459019 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:25.458930    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:25.459260 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:25.459058    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:25.459260 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:25.459184    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:25.708653 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:25.708621    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:26.179118 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:26.179081    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:26.436184 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:26.436101    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:51:26.458462 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:26.458437    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:26.458561 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:26.458545    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:27.094106 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:27.094070    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:27.459454 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:27.459416    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:27.459941 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:27.459531    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:27.459941 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:27.459593    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:27.459941 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:27.459703    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:27.839579 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:27.839500    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:28.458591 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:28.458551    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:28.458761 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:28.458688    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:28.835996 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:28.835911    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:29.341021 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:29.340986    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:29.459303 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:29.459268    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:29.459442 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:29.459391    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:29.459491 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:29.459438    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:29.459555 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:29.459537    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:30.459433 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:30.459383    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:30.459883 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:30.459516    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:31.436532 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:31.436498    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:51:31.459510 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:31.459485    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:31.459965 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:31.459564    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:31.459965 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:31.459651    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:31.459965 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:31.459760    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:32.459356 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:32.459313    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:32.459541 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:32.459436    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:33.321584 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:33.321547    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:33.459085 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:33.459053    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:33.459216 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:33.459194    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:33.459267 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:33.459239    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:33.459351 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:33.459332    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:33.868330 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:33.868292    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:34.433804 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:34.433759    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:34.458620 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:34.458580    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:34.458795 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:34.458705    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:35.459187 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:35.459149    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:35.459600 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:35.459270    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:35.459600 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:35.459326    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:35.459718 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:35.459592    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:36.152167 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:36.152140    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:36.438016 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:36.437928    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:51:36.458807 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:36.458780    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:36.458939 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:36.458923    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:36.958402 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:36.958373    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:37.224045 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:37.223969    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:37.459088 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:37.459053    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:37.459088 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:37.459086    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:37.459272 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:37.459208    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:37.459321 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:37.459289    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:37.783079 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:37.783040    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:38.101857 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:38.101762    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/0.log"
Sep 18 16:51:38.103876 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:38.103846    2583 generic.go:356] "Generic (PLEG): container finished" podID="97b45f77-6012-44e8-ad30-564e7d1f2a5d" containerID="df8f9e94b4938c1cc6312daee0d2db74aacdba4edc397443ba071a30a286fc00" exitCode=1
Sep 18 16:51:38.104006 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:38.103903    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" event={"ID":"97b45f77-6012-44e8-ad30-564e7d1f2a5d","Type":"ContainerDied","Data":"df8f9e94b4938c1cc6312daee0d2db74aacdba4edc397443ba071a30a286fc00"}
Sep 18 16:51:38.104665 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:38.104649    2583 scope.go:117] "RemoveContainer" containerID="df8f9e94b4938c1cc6312daee0d2db74aacdba4edc397443ba071a30a286fc00"
Sep 18 16:51:38.358610 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:38.358319    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:38.459303 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:38.459258    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:38.459482 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:38.459394    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:38.828990 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:38.828949    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:39.109155 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:39.109066    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/0.log"
Sep 18 16:51:39.111379 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:39.111347    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" event={"ID":"97b45f77-6012-44e8-ad30-564e7d1f2a5d","Type":"ContainerStarted","Data":"42416f80a5c4a2b0246d5325e1dccd0cbad5a97ef5978095a6b42492f6620cba"}
Sep 18 16:51:39.111861 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:39.111845    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:51:39.332126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:39.332094    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:39.461974 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:39.461942    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:39.462123 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:39.462063    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:39.462123 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:39.462115    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:39.462289 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:39.462271    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:39.846188 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:39.846099    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:40.418866 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:40.418806    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:40.459092 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:40.459060    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:40.459204 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:40.459182    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:41.438538 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:41.438497    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:51:41.459609 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:41.459570    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:41.459767 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:41.459672    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:41.459808 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:41.459758    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:41.459921 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:41.459899    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:42.459252 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:42.459208    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:42.459626 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:42.459330    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:43.458678 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:43.458640    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:43.458925 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:43.458640    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:43.458925 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:43.458788    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:43.458925 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:43.458906    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:44.458655 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:44.458612    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:44.459058 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:44.458736    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:45.462265 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:45.462229    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:45.462703 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:45.462331    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:45.462703 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:45.462339    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:45.462703 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:45.462418    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:46.204068 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:46.204025    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:46.267165 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:46.267132    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:46.439133 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:46.439102    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:51:46.459478 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:46.459393    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:46.459652 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:46.459511    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:47.458770 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:47.458729    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:47.459255 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:47.458905    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:47.459255 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:47.458957    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:47.459255 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:47.459101    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:48.458830 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:48.458777    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:48.459251 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:48.458925    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:49.459036 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:49.458994    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:49.459036 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:49.459006    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:49.459504 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:49.459163    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:49.459504 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:49.459397    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:50.459207 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:50.459167    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:50.459673 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:50.459287    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:50.864043 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:50.863891    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:51.391155 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:51.391120    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:51.439930 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:51.439892    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:51:51.459582 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:51.459545    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:51.460083 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:51.459661    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:51.460083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:51.459704    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:51.460083 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:51.459827    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:51.999212 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:51.999171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:52.459028 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:52.458992    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:52.459231 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:52.459127    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:52.548972 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:52.548935    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:53.066057 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:53.066012    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:53.459375 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:53.459333    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:53.459565 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:53.459478    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:53.459565 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:53.459521    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:53.459651 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:53.459611    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:53.590314 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:53.590278    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:54.458798 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:54.458748    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:54.459041 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:54.458900    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:55.458577 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:55.458537    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:55.459097 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:55.458655    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:55.459097 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:55.458704    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:55.459097 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:55.458789    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:55.858541 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:55.858455    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:56.372736 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:56.372703    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:56.440832 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:56.440779    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:51:56.459218 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:56.459184    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:56.459554 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:56.459415    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:56.890392 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:56.890359    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:57.459456 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:57.459426    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:57.459929 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:57.459438    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:57.459929 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:57.459541    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:57.459929 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:57.459651    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:57.560901 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:57.560863    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:58.222246 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:58.222210    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:58.459136 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:58.459083    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:51:58.459322 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:58.459213    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:51:59.142021 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:59.141985    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:51:59.459129 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:59.459046    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:51:59.459279 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:59.459158    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:51:59.459279 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:59.459212    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:51:59.459350 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:51:59.459332    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:51:59.681750 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:51:59.681715    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:00.163262 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:00.163236    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/2.log"
Sep 18 16:52:00.163640 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:00.163629    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/1.log"
Sep 18 16:52:00.163682 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:00.163660    2583 generic.go:356] "Generic (PLEG): container finished" podID="3eb943e2-ff5c-4e19-bb28-bbf46c305ed6" containerID="be251019b73f81469266c560f775974e65cf3481bf90ea273786ef7eda27bb78" exitCode=1
Sep 18 16:52:00.163716 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:00.163690    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lkvfz" event={"ID":"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6","Type":"ContainerDied","Data":"be251019b73f81469266c560f775974e65cf3481bf90ea273786ef7eda27bb78"}
Sep 18 16:52:00.163749 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:00.163734    2583 scope.go:117] "RemoveContainer" containerID="d12f50fa3022e6865831f14641d0c93f74d1d0e706e8dd829f7fc39c363e7740"
Sep 18 16:52:00.164160 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:00.164141    2583 scope.go:117] "RemoveContainer" containerID="be251019b73f81469266c560f775974e65cf3481bf90ea273786ef7eda27bb78"
Sep 18 16:52:00.164309 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:00.164287    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-multus pod=multus-lkvfz_openshift-multus(3eb943e2-ff5c-4e19-bb28-bbf46c305ed6)\"" pod="openshift-multus/multus-lkvfz" podUID="3eb943e2-ff5c-4e19-bb28-bbf46c305ed6"
Sep 18 16:52:00.207438 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:00.207405    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:00.458647 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:00.458565    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:00.458801 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:00.458671    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:01.168987 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:01.168962    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/2.log"
Sep 18 16:52:01.441452 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:01.441369    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:52:01.460006 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:01.459959    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:01.460208 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:01.460017    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:01.460208 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:01.460087    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:01.460208 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:01.460121    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:01.667025 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:01.666993    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:02.459091 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:02.459042    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:02.459489 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:02.459174    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:02.676217 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:02.676182    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:03.458982 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:03.458945    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:03.459159 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:03.458953    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:03.459159 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:03.459057    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:03.459159 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:03.459132    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:03.801062 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:03.800969    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:04.295600 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:04.295568    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:04.459425 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:04.459371    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:04.459858 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:04.459667    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:05.205806 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:05.205770    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:05.419925 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:05.419896    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:05.459063 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:05.458988    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:05.459063 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:05.459004    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:05.459232 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:05.459118    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:05.459292 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:05.459264    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:05.928268 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:05.928232    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:06.435172 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:06.435139    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:06.442460 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:06.442430    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:52:06.458782 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:06.458762    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:06.459111 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:06.459094    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:07.098384 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:07.098351    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:07.458868 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:07.458839    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:07.459044 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:07.458952    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:07.459044 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:07.459006    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:07.459044 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:07.459023    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:07.693860 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:07.693827    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:08.458632 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:08.458591    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:08.459117 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:08.458735    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:09.459010 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:09.458969    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:09.459394 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:09.459089    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:09.459394 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:09.459149    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:09.459394 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:09.459265    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:10.125366 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:10.125325    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" podUID="97b45f77-6012-44e8-ad30-564e7d1f2a5d" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 18 16:52:10.459664 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:10.459576    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:10.460064 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:10.459690    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:10.661126 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:10.661088    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:11.223773 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:11.223739    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:11.442900 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:11.442862    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:52:11.460222 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:11.460180    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:11.460631 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:11.460316    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:11.460631 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:11.460351    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:11.460631 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:11.460446    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:11.778489 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:11.778456    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:12.313055 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:12.313014    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:12.458489 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:12.458433    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:12.458676 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:12.458575    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:13.459153 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:13.459108    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:13.459153 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:13.459154    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:13.459565 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:13.459248    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:13.459565 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:13.459356    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:14.458691 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:14.458638    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:14.458939 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:14.458781    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:14.459169 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:14.459150    2583 scope.go:117] "RemoveContainer" containerID="be251019b73f81469266c560f775974e65cf3481bf90ea273786ef7eda27bb78"
Sep 18 16:52:14.459331 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:14.459311    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-multus pod=multus-lkvfz_openshift-multus(3eb943e2-ff5c-4e19-bb28-bbf46c305ed6)\"" pod="openshift-multus/multus-lkvfz" podUID="3eb943e2-ff5c-4e19-bb28-bbf46c305ed6"
Sep 18 16:52:15.458970 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:15.458934    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:15.459158 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:15.459048    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:15.459158 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:15.459095    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:15.459260 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:15.459236    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:16.444111 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:16.444067    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:52:16.459372 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:16.459336    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:16.459484 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:16.459465    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:16.490378 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:16.490349    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:16.966452 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:16.966422    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:17.459039 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:17.459010    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:17.459422 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:17.459010    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:17.459422 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:17.459122    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:17.459422 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:17.459197    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:18.459070 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:18.459028    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:18.459461 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:18.459147    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:19.173018 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:19.172988    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:19.459251 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:19.459166    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:19.459688 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:19.459178    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:19.459688 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:19.459273    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:19.459688 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:19.459409    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:20.078238 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:20.078202    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:20.459277 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:20.459245    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:20.459665 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:20.459382    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:21.444485 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:21.444443    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:52:21.460133 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:21.460095    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:21.460604 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:21.460216    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:21.460604 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:21.460275    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:21.460604 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:21.460387    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:21.692356 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:21.692329    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:22.100463 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:22.100427    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:22.459157 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:22.459120    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:22.459326 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:22.459233    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:22.602951 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:22.602919    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:23.459077 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:23.459038    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:23.459257 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:23.459184    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:23.459257 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:23.459226    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:23.459334 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:23.459323    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:24.459407 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:24.459360    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:24.459896 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:24.459484    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:25.458643 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:25.458598    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:25.458881 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:25.458605    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:25.458881 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:25.458708    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:25.458881 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:25.458778    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:26.445434 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:26.445387    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:52:26.458739 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:26.458702    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:26.458970 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:26.458919    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:27.459467 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:27.459425    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:27.459898 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:27.459643    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:27.459898 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:27.459731    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:27.459898 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:27.459639    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:27.459898 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:27.459766    2583 scope.go:117] "RemoveContainer" containerID="be251019b73f81469266c560f775974e65cf3481bf90ea273786ef7eda27bb78"
Sep 18 16:52:28.235306 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:28.235277    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/2.log"
Sep 18 16:52:28.235504 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:28.235345    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lkvfz" event={"ID":"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6","Type":"ContainerStarted","Data":"a50e7a0d0cdc551a5574c151714252a2009e2af39aaa3e33ff8d4f5d7868c0b7"}
Sep 18 16:52:28.459120 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:28.459070    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:28.459310 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:28.459208    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:29.458495 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:29.458456    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:29.458915 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:29.458456    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:29.458915 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:29.458576    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:29.458915 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:29.458635    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:30.458682 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:30.458626    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:30.459105 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:30.458762    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:31.070155 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:31.070118    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:31.142117 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:31.142079    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:31.445908 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:31.445877    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:52:31.460328 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:31.460289    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:31.460837 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:31.460391    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:31.460837 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:31.460434    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:31.460837 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:31.460525    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:32.458886 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:32.458849    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:32.459114 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:32.458966    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:33.077867 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:33.077780    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:33.458693 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:33.458658    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:33.458879 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:33.458765    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:33.458953 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:33.458872    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:33.458990 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:33.458964    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:33.519240 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:33.519205    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:33.997543 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:33.997514    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:34.441467 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:34.441441    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:34.458755 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:34.458710    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:34.458975 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:34.458889    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:34.954953 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:34.954920    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:35.340969 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:35.340862    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:35.459151 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:35.459119    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:35.459547 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:35.459225    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:35.459547 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:35.459297    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:35.459547 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:35.459385    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:35.889124 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:35.889089    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:36.447261 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:36.447219    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:52:36.459064 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:36.459023    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:36.459226 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:36.459151    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:36.480035 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:36.480003    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:37.005219 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:37.005187    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:37.458649 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:37.458615    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:37.458872 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:37.458717    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:37.458872 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:37.458746    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:37.458950 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:37.458888    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:37.540700 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:37.540665    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:38.377023 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:38.376992    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:38.458965 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:38.458921    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:38.459160 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:38.459048    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:38.859115 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:38.859029    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:39.458835 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:39.458794    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:39.459031 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:39.458839    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:39.459031 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:39.458930    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:39.459106 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:39.459035    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:39.572757 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:39.572720    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:40.125477 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:40.125440    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" podUID="97b45f77-6012-44e8-ad30-564e7d1f2a5d" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 18 16:52:40.140634 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:40.140601    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:40.459471 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:40.459386    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:40.459639 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:40.459500    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:40.582570 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:40.582536    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:41.017285 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:41.017254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:41.447688 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:41.447653    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:52:41.460212 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:41.460172    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:41.460387 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:41.460263    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:41.460387 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:41.460349    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:41.460533 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:41.460473    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:41.468003 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:41.467973    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:41.527677 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:41.527646    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:42.459069 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:42.459028    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:42.459449 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:42.459148    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:43.458643 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:43.458609    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:43.458840 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:43.458717    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:43.458840 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:43.458772    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:43.458927 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:43.458881    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:44.458941 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:44.458901    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:44.459334 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:44.459025    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:45.458942 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:45.458895    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:45.459327 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:45.459037    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:45.459327 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:45.459080    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:45.459327 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:45.459180    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:45.545605 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:45.545571    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:46.016852 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:46.016802    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:46.449050 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:46.449013    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:52:46.459307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:46.459263    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:46.459630 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:46.459420    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:46.495583 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:46.495546    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:46.905352 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:46.905320    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:47.453068 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:47.453037    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:47.458954 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:47.458926    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:47.459096 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:47.459062    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:47.459159 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:47.459098    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:47.459213 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:47.459185    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:48.110134 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:48.110089    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:48.459382 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:48.459331    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:48.459606 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:48.459489    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:48.618190 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:48.618157    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:49.233538 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:49.233503    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:49.458993 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:49.458952    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:49.459213 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:49.459072    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:49.459213 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:49.459125    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:49.459340 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:49.459214    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:49.753832 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:49.753773    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:50.459450 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:50.459386    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:50.459895 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:50.459525    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:51.449725 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:51.449685    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:52:51.460229 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:51.460192    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:51.460626 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:51.460264    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:51.460626 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:51.460285    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:51.460626 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:51.460350    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:52.458803 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:52.458753    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:52.459049 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:52.458953    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:53.458745 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:53.458701    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:53.459223 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:53.458707    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:53.459223 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:53.458867    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:53.459223 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:53.458907    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:54.458573 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:54.458512    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:54.458803 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:54.458658    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:54.469416 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:54.469376    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" podUID="97b45f77-6012-44e8-ad30-564e7d1f2a5d" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 18 16:52:55.459221 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:55.459179    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:55.459611 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:55.459299    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:55.459611 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:55.459349    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:55.459611 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:55.459438    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:56.089518 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:56.089488    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:56.450715 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:56.450680    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:52:56.458982 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:56.458947    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:56.459116 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:56.459091    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:56.576160 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:56.576121    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:57.020383 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:57.020340    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:52:57.458884 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:57.458852    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:57.458884 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:57.458881    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:57.459159 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:57.458966    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:52:57.459159 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:57.459078    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:58.459140 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:58.459094    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:52:58.459570 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:58.459400    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:52:59.459257 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:59.459218    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:52:59.459658 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:59.459337    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:52:59.459658 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:52:59.459389    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:52:59.459658 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:52:59.459486    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:00.458693 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:00.458636    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:00.458913 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:00.458775    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:01.451173 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:01.451132    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:53:01.460015 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:01.459986    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:01.460184 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:01.460075    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:01.460184 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:01.460153    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:01.460255 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:01.460235    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:02.459066 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:02.459028    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:02.459465 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:02.459150    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:03.458624 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:03.458579    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:03.458862 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:03.458579    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:03.458862 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:03.458732    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:03.458862 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:03.458780    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:04.459083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:04.459030    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:04.459496 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:04.459163    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:05.458837 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:05.458792    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:05.459050 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:05.458951    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:05.459050 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:05.458993    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:05.459611 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:05.459089    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:05.788408 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:05.788315    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:06.245290 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:06.245256    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:06.452232 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:06.452192    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:53:06.458595 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:06.458575    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:06.458699 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:06.458681    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:06.698571 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:06.698542    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:07.162927 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:07.162901    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:07.459337 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:07.459242    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:07.459510 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:07.459242    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:07.459510 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:07.459355    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:07.459510 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:07.459419    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:08.458752 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:08.458709    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:08.459205 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:08.459008    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:09.459102 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:09.459063    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:09.459102 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:09.459072    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:09.459528 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:09.459320    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:09.459528 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:09.459416    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:10.458998 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:10.458964    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:10.459237 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:10.459213    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:11.453119 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:11.453080    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:53:11.459412 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:11.459379    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:11.459872 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:11.459484    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:11.459872 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:11.459514    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:11.459872 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:11.459655    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:12.458786 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:12.458730    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:12.459145 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:12.459117    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:13.345696 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:13.345658    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 16:53:13.346137 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:13.346090    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/2.log"
Sep 18 16:53:13.346182 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:13.346132    2583 generic.go:356] "Generic (PLEG): container finished" podID="3eb943e2-ff5c-4e19-bb28-bbf46c305ed6" containerID="a50e7a0d0cdc551a5574c151714252a2009e2af39aaa3e33ff8d4f5d7868c0b7" exitCode=1
Sep 18 16:53:13.346182 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:13.346172    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lkvfz" event={"ID":"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6","Type":"ContainerDied","Data":"a50e7a0d0cdc551a5574c151714252a2009e2af39aaa3e33ff8d4f5d7868c0b7"}
Sep 18 16:53:13.346256 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:13.346245    2583 scope.go:117] "RemoveContainer" containerID="be251019b73f81469266c560f775974e65cf3481bf90ea273786ef7eda27bb78"
Sep 18 16:53:13.346585 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:13.346568    2583 scope.go:117] "RemoveContainer" containerID="a50e7a0d0cdc551a5574c151714252a2009e2af39aaa3e33ff8d4f5d7868c0b7"
Sep 18 16:53:13.346782 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:13.346744    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-multus pod=multus-lkvfz_openshift-multus(3eb943e2-ff5c-4e19-bb28-bbf46c305ed6)\"" pod="openshift-multus/multus-lkvfz" podUID="3eb943e2-ff5c-4e19-bb28-bbf46c305ed6"
Sep 18 16:53:13.458834 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:13.458789    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:13.459048 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:13.458800    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:13.459048 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:13.458947    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:13.459048 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:13.459009    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:14.349802 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:14.349773    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 16:53:14.459340 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:14.459306    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:14.459500 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:14.459434    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:15.458799 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:15.458592    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:15.459276 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:15.458594    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:15.459276 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:15.458941    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:15.459276 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:15.458951    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:16.454577 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:16.454544    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:53:16.458919 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:16.458895    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:16.459223 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:16.459155    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:16.765620 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:16.765515    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:16.863259 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:16.863227    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:16.965870 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:16.965829    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:17.208937 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:17.208908    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:17.458510 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:17.458474    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:17.458716 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:17.458610    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:17.458716 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:17.458688    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:17.458858 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:17.458798    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:17.728778 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:17.728749    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:18.272257 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:18.272212    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:18.458667 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:18.458626    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:18.458865 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:18.458744    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:18.752182 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:18.752145    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:19.459398 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:19.459358    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:19.459611 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:19.459358    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:19.459611 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:19.459468    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:19.459611 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:19.459544    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:20.459224 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:20.459171    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:20.459690 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:20.459331    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:21.254491 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:21.254455    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:21.455104 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:21.455066    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:53:21.459403 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:21.459378    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:21.459851 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:21.459459    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:21.459851 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:21.459480    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:21.459851 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:21.459595    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:22.047778 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:22.047718    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:22.260771 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:22.260729    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:22.260969 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:22.260782    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs\") pod \"network-metrics-daemon-qmx4b\" (UID: \"83b73597-6182-4df7-bcf5-f6ca3ba721cd\") " pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:22.260969 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:22.260899    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:53:22.260969 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:22.260901    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:53:22.260969 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:22.260969    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs podName:83b73597-6182-4df7-bcf5-f6ca3ba721cd nodeName:}" failed. No retries permitted until 2026-09-18 16:55:24.260954337 +0000 UTC m=+374.986236061 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs") pod "network-metrics-daemon-qmx4b" (UID: "83b73597-6182-4df7-bcf5-f6ca3ba721cd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:53:22.261111 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:22.260985    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret podName:46fb0981-ac5c-4e2b-8212-adae49d948c4 nodeName:}" failed. No retries permitted until 2026-09-18 16:55:24.26097766 +0000 UTC m=+374.986259384 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret") pod "global-pull-secret-syncer-v7vnw" (UID: "46fb0981-ac5c-4e2b-8212-adae49d948c4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:53:22.361362 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:22.361276    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fgtq\" (UniqueName: \"kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq\") pod \"network-check-target-lrm4v\" (UID: \"1cfbfb52-83e8-4208-aa4f-de27397133d4\") " pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:22.361495 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:22.361416    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:53:22.361495 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:22.361432    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:53:22.361495 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:22.361442    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6fgtq for pod openshift-network-diagnostics/network-check-target-lrm4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:53:22.361495 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:22.361493    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq podName:1cfbfb52-83e8-4208-aa4f-de27397133d4 nodeName:}" failed. No retries permitted until 2026-09-18 16:55:24.361478598 +0000 UTC m=+375.086760335 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6fgtq" (UniqueName: "kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq") pod "network-check-target-lrm4v" (UID: "1cfbfb52-83e8-4208-aa4f-de27397133d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:53:22.458665 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:22.458608    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:22.458920 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:22.458899    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:22.579889 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:22.579855    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:23.059010 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:23.058959    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:23.458633 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:23.458592    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:23.458869 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:23.458592    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:23.458869 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:23.458708    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:23.458869 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:23.458762    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:23.459066 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:23.459052    2583 scope.go:117] "RemoveContainer" containerID="a50e7a0d0cdc551a5574c151714252a2009e2af39aaa3e33ff8d4f5d7868c0b7"
Sep 18 16:53:23.459196 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:23.459181    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-multus pod=multus-lkvfz_openshift-multus(3eb943e2-ff5c-4e19-bb28-bbf46c305ed6)\"" pod="openshift-multus/multus-lkvfz" podUID="3eb943e2-ff5c-4e19-bb28-bbf46c305ed6"
Sep 18 16:53:24.458982 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:24.458941    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:24.459403 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:24.459075    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:24.469067 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:24.469025    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" podUID="97b45f77-6012-44e8-ad30-564e7d1f2a5d" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 18 16:53:25.123270 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:25.123236    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:25.461873 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:25.461777    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:25.461873 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:25.461780    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:25.462263 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:25.461899    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:25.462263 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:25.462015    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:25.676348 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:25.676314    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:26.220259 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:26.220236    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:26.456391 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:26.456350    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:53:26.458632 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:26.458609    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:26.458744 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:26.458726    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:26.705527 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:26.705499    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:27.179020 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:27.178987    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:27.458877 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:27.458766    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:27.458877 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:27.458842    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:27.459081 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:27.458940    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:27.459081 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:27.459048    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:27.653931 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:27.653898    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:28.066338 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:28.066309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:28.458574 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:28.458533    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:28.458771 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:28.458652    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:28.587976 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:28.587919    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:29.126147 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:29.126102    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:29.461936 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:29.461850    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:29.462092 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:29.461856    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:29.462092 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:29.461956    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:29.462092 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:29.462017    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:29.687357 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:29.687303    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:30.288352 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:30.288324    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:30.459458 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:30.459403    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:30.459669 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:30.459568    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:30.870101 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:30.870069    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:31.430897 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:31.430858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:31.456970 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:31.456931    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:53:31.459467 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:31.459439    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:31.459632 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:31.459547    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:31.459632 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:31.459596    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:31.459748 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:31.459719    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:31.994488 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:31.994454    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:32.458661 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:32.458610    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:32.459076 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:32.458755    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:32.570005 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:32.569974    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:33.458684 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:33.458644    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:33.459107 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:33.458654    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:33.459107 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:33.458763    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:33.459107 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:33.458882    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:34.458536 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:34.458490    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:34.458734 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:34.458613    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:34.459031 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:34.458980    2583 scope.go:117] "RemoveContainer" containerID="a50e7a0d0cdc551a5574c151714252a2009e2af39aaa3e33ff8d4f5d7868c0b7"
Sep 18 16:53:34.459130 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:34.459111    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-multus pod=multus-lkvfz_openshift-multus(3eb943e2-ff5c-4e19-bb28-bbf46c305ed6)\"" pod="openshift-multus/multus-lkvfz" podUID="3eb943e2-ff5c-4e19-bb28-bbf46c305ed6"
Sep 18 16:53:35.459144 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:35.459101    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:35.459538 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:35.459101    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:35.459538 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:35.459242    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:35.459538 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:35.459275    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:36.458382 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:36.458346    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:36.458382 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:36.458361    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:53:36.458612 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:36.458465    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:37.020270 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:37.020238    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:37.458831 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:37.458778    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:37.459035 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:37.458942    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:37.459035 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:37.458988    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:37.459154 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:37.459082    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:38.459110 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:38.459072    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:38.459495 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:38.459197    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:39.407875 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:39.407845    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 16:53:39.408373 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:39.408356    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/0.log"
Sep 18 16:53:39.410237 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:39.410212    2583 generic.go:356] "Generic (PLEG): container finished" podID="97b45f77-6012-44e8-ad30-564e7d1f2a5d" containerID="42416f80a5c4a2b0246d5325e1dccd0cbad5a97ef5978095a6b42492f6620cba" exitCode=1
Sep 18 16:53:39.410355 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:39.410265    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" event={"ID":"97b45f77-6012-44e8-ad30-564e7d1f2a5d","Type":"ContainerDied","Data":"42416f80a5c4a2b0246d5325e1dccd0cbad5a97ef5978095a6b42492f6620cba"}
Sep 18 16:53:39.410355 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:39.410337    2583 scope.go:117] "RemoveContainer" containerID="df8f9e94b4938c1cc6312daee0d2db74aacdba4edc397443ba071a30a286fc00"
Sep 18 16:53:39.411143 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:39.411124    2583 scope.go:117] "RemoveContainer" containerID="42416f80a5c4a2b0246d5325e1dccd0cbad5a97ef5978095a6b42492f6620cba"
Sep 18 16:53:39.411353 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:39.411316    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ovnkube-controller\" with CrashLoopBackOff: \"back-off 10s restarting failed container=ovnkube-controller pod=ovnkube-node-s746c_openshift-ovn-kubernetes(97b45f77-6012-44e8-ad30-564e7d1f2a5d)\"" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" podUID="97b45f77-6012-44e8-ad30-564e7d1f2a5d"
Sep 18 16:53:39.458569 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:39.458535    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:39.458569 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:39.458535    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:39.458796 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:39.458701    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:39.458796 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:39.458742    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:40.414135 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:40.414105    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 16:53:40.458469 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:40.458420    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:40.458589 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:40.458568    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:41.459327 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:41.459093    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:53:41.463055 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:41.463011    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:41.463237 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:41.463102    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:41.463237 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:41.463128    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:41.463237 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:41.463186    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:41.598375 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:41.598339    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:42.253614 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:42.253572    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:42.458733 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:42.458700    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:42.458928 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:42.458847    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:42.912943 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:42.912908    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:43.144760 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:43.144728    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:43.298778 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:43.298699    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:43.395683 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:43.395645    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:43.459282 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:43.459242    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:43.459282 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:43.459283    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:43.459479 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:43.459375    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:43.459525 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:43.459488    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:43.582232 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:43.582146    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:43.698889 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:43.698858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:43.808097 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:43.808061    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:43.912103 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:43.912064    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:44.084403 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:44.084367    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:44.459124 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:44.459082    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:44.459327 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:44.459220    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:44.877666 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:44.877626    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:45.459084 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:45.459043    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:45.459557 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:45.459041    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:45.459557 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:45.459202    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:45.459557 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:45.459221    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:45.998275 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:45.998225    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:46.090038 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:46.090002    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:46.217767 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:46.217734    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:46.458932 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:46.458896    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:46.459120 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:46.459025    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:46.459661 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:46.459632    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:53:46.511702 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:46.511671    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:46.893117 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:46.893089    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:47.458619 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:47.458580    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:47.459033 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:47.458996    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:47.459220 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:47.459026    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:47.459737 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:47.459712    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:48.458805 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:48.458748    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:48.459049 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:48.458905    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:49.042147 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:49.042114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:49.140689 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:49.140656    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:49.228083 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:49.228051    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:49.322703 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:49.322619    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:49.399899 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:49.399870    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:49.459091 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:49.459056    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:49.459091 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:49.459056    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:49.459397 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:49.459369    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:49.459482 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:49.459466    2583 scope.go:117] "RemoveContainer" containerID="a50e7a0d0cdc551a5574c151714252a2009e2af39aaa3e33ff8d4f5d7868c0b7"
Sep 18 16:53:49.459482 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:49.459469    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:49.459655 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:49.459635    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-multus pod=multus-lkvfz_openshift-multus(3eb943e2-ff5c-4e19-bb28-bbf46c305ed6)\"" pod="openshift-multus/multus-lkvfz" podUID="3eb943e2-ff5c-4e19-bb28-bbf46c305ed6"
Sep 18 16:53:49.501499 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:49.501442    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:49.579051 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:49.578966    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:50.375977 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:50.375944    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:50.458932 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:50.458886    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:50.459112 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:50.459019    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:51.271418 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:51.271374    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:51.460133 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:51.460084    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:53:51.462174 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:51.462149    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:51.462359 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:51.462258    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:51.462359 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:51.462294    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:51.462478 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:51.462409    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:51.463047 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:51.463024    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:51.463241 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:51.463225    2583 scope.go:117] "RemoveContainer" containerID="42416f80a5c4a2b0246d5325e1dccd0cbad5a97ef5978095a6b42492f6620cba"
Sep 18 16:53:51.582943 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:51.582883    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:51.697792 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:51.697747    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:51.786970 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:51.786934    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:51.887060 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:51.887030    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:51.994909 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:51.994879    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:52.062369 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:52.062340    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:52.163193 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:52.163114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:52.269571 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:52.269542    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:52.444492 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:52.444423    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 16:53:52.446416 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:52.446391    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s746c" event={"ID":"97b45f77-6012-44e8-ad30-564e7d1f2a5d","Type":"ContainerStarted","Data":"fd26f460a882ad5d3b1f65dcb0502cf5bbae4d8120ed458f262b664d8d8301f8"}
Sep 18 16:53:52.446863 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:52.446850    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:53:52.458756 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:52.458733    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:52.458901 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:52.458878    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:53.458952 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.458926    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:53.459731 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.458927    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:53.459731 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:53.459060    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:53.459731 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:53.459108    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:53.472563 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.472527    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:53.581304 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.581273    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:53.617154 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.617110    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lrm4v"]
Sep 18 16:53:53.617861 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.617829    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qmx4b"]
Sep 18 16:53:53.618008 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.617962    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:53.618123 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:53.618096    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:53.618611 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.618545    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v7vnw"]
Sep 18 16:53:53.702562 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.702461    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:53.871902 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.871866    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:53.937505 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.937291    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-znrf5"]
Sep 18 16:53:53.939415 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.939399    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:53.942056 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.942034    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 16:53:53.942056 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.942050    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 16:53:53.942284 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.942036    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 16:53:53.942284 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.942036    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 16:53:53.942727 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.942694    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 16:53:53.942727 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.942720    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 16:53:53.942876 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:53.942839    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kslbc\""
Sep 18 16:53:54.006253 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.006149    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:54.080074 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.080028    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-accelerators-collector-config\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.080074 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.080077    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e1e068c-c33f-477c-a957-071c06e42767-sys\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.080301 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.080178    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-textfile\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.080301 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.080208    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-tls\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.080301 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.080251    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.080452 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.080313    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-wtmp\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.080452 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.080350    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e1e068c-c33f-477c-a957-071c06e42767-root\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.080452 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.080382    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8qsp\" (UniqueName: \"kubernetes.io/projected/2e1e068c-c33f-477c-a957-071c06e42767-kube-api-access-r8qsp\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.080452 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.080421    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e1e068c-c33f-477c-a957-071c06e42767-metrics-client-ca\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.099017 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.098985    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:54.181080 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.181041    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.181296 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.181099    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-wtmp\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.181296 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.181117    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e1e068c-c33f-477c-a957-071c06e42767-root\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.181296 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.181136    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8qsp\" (UniqueName: \"kubernetes.io/projected/2e1e068c-c33f-477c-a957-071c06e42767-kube-api-access-r8qsp\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.181296 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.181163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e1e068c-c33f-477c-a957-071c06e42767-metrics-client-ca\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.181296 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.181187    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-accelerators-collector-config\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.181296 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.181210    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e1e068c-c33f-477c-a957-071c06e42767-sys\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.181296 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.181244    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e1e068c-c33f-477c-a957-071c06e42767-root\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.181296 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.181246    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-wtmp\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.181296 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.181289    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e1e068c-c33f-477c-a957-071c06e42767-sys\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.181801 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.181251    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-textfile\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.181801 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.181345    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-tls\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.181801 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:54.181463    2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 18 16:53:54.181801 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:54.181519    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-tls podName:2e1e068c-c33f-477c-a957-071c06e42767 nodeName:}" failed. No retries permitted until 2026-09-18 16:53:54.681500976 +0000 UTC m=+285.406782706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-tls") pod "node-exporter-znrf5" (UID: "2e1e068c-c33f-477c-a957-071c06e42767") : secret "node-exporter-tls" not found
Sep 18 16:53:54.181801 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.181588    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-textfile\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.182077 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.181941    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e1e068c-c33f-477c-a957-071c06e42767-metrics-client-ca\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.182729 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.182703    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-accelerators-collector-config\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.185695 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.185671    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.201390 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.201354    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8qsp\" (UniqueName: \"kubernetes.io/projected/2e1e068c-c33f-477c-a957-071c06e42767-kube-api-access-r8qsp\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.381415 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.381379    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:54.452301 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.452271    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:54.452301 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.452307    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:54.452492 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:54.452384    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:54.452541 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:54.452517    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:54.484345 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.484307    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:54.576587 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.576503    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:54.681771 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.681726    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:54.685788 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.685765    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-tls\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.688542 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.688519    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e1e068c-c33f-477c-a957-071c06e42767-node-exporter-tls\") pod \"node-exporter-znrf5\" (UID: \"2e1e068c-c33f-477c-a957-071c06e42767\") " pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.780264 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.780231    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:54.849154 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.849067    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-znrf5"
Sep 18 16:53:54.859539 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:53:54.859510    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e1e068c_c33f_477c_a957_071c06e42767.slice/crio-3d51a93b61ea700116331a71fd7bdfae524b49a38154902a2ca540830a66f358 WatchSource:0}: Error finding container 3d51a93b61ea700116331a71fd7bdfae524b49a38154902a2ca540830a66f358: Status 404 returned error can't find the container with id 3d51a93b61ea700116331a71fd7bdfae524b49a38154902a2ca540830a66f358
Sep 18 16:53:54.885023 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:54.884988    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:55.455747 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:55.455710    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-znrf5" event={"ID":"2e1e068c-c33f-477c-a957-071c06e42767","Type":"ContainerStarted","Data":"3d51a93b61ea700116331a71fd7bdfae524b49a38154902a2ca540830a66f358"}
Sep 18 16:53:55.459059 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:55.459041    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:55.459164 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:55.459146    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:55.677364 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:55.677329    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:56.111708 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:56.111672    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:56.333390 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:56.333301    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:56.458430 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:56.458404    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:56.458604 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:56.458524    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:56.458604 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:56.458536    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:56.458692 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:56.458647    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:56.459951 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:56.459931    2583 generic.go:356] "Generic (PLEG): container finished" podID="2e1e068c-c33f-477c-a957-071c06e42767" containerID="a58fb7479808ec713603a57016a2aff1fdc1681aa34e4586ffbddaa808d64139" exitCode=0
Sep 18 16:53:56.460018 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:56.459963    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-znrf5" event={"ID":"2e1e068c-c33f-477c-a957-071c06e42767","Type":"ContainerDied","Data":"a58fb7479808ec713603a57016a2aff1fdc1681aa34e4586ffbddaa808d64139"}
Sep 18 16:53:56.460513 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:56.460487    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:53:56.957000 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:56.956804    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:57.156449 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:57.156383    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:57.216504 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:57.216383    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:57.458497 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:57.458473    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:57.458652 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:57.458590    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:57.463799 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:57.463760    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-znrf5" event={"ID":"2e1e068c-c33f-477c-a957-071c06e42767","Type":"ContainerStarted","Data":"235b4e5e962cc552d2973790381ce65b0dfdcd5c36898bac6776e5d1d73b0bcf"}
Sep 18 16:53:57.463976 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:57.463831    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-znrf5" event={"ID":"2e1e068c-c33f-477c-a957-071c06e42767","Type":"ContainerStarted","Data":"0226ced325c4f1ad16151aa49049d9aa0c86fdd7ff94edc0bbb0975e9a71c2f4"}
Sep 18 16:53:57.530593 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:57.530506    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:58.165228 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:58.165192    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:58.458960 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:58.458878    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:53:58.459111 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:58.458878    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:53:58.459111 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:58.459010    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:53:58.459111 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:58.459064    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:53:58.473942 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:58.473912    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:58.568189 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:58.568152    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:58.670150 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:58.670118    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:58.763261 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:58.763187    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:59.400422 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:59.400389    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:53:59.458759 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:59.458723    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:53:59.458919 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:53:59.458899    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:53:59.892932 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:53:59.892898    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:00.459326 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:00.459295    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:54:00.459703 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:00.459295    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:54:00.459703 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:54:00.459426    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:54:00.459703 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:54:00.459463    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:54:00.623499 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:00.623466    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:00.694004 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:00.693970    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:01.459804 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:01.459774    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:54:01.460182 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:54:01.459880    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:54:01.460976 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:54:01.460949    2583 kubelet.go:3032] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"
Sep 18 16:54:02.088259 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:02.088224    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:02.187606 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:02.187569    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:02.282094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:02.282064    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:02.384713 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:02.384687    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:02.459031 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:02.458995    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:54:02.459182 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:02.458997    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:54:02.459269 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:54:02.459243    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:54:02.459338 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:02.459325    2583 scope.go:117] "RemoveContainer" containerID="a50e7a0d0cdc551a5574c151714252a2009e2af39aaa3e33ff8d4f5d7868c0b7"
Sep 18 16:54:02.459374 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:54:02.459359    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:54:03.005627 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:03.005524    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:03.459081 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:03.459043    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:54:03.459244 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:54:03.459201    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:54:03.479639 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:03.479612    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 16:54:03.479830 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:03.479668    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lkvfz" event={"ID":"3eb943e2-ff5c-4e19-bb28-bbf46c305ed6","Type":"ContainerStarted","Data":"ffe664fc01fe13693e6c6cb184ea969a8fb64db1e723afc3a014a2093c088796"}
Sep 18 16:54:03.505094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:03.505036    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-znrf5" podStartSLOduration=9.316323532 podStartE2EDuration="10.505020074s" totalImagesPullingTime="1.115592557s" totalInitContainerRuntime="73.103985ms" isStatefulPod=true podCreationTimestamp="2026-09-18 16:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:53:57.482731198 +0000 UTC m=+288.208012956" watchObservedRunningTime="2026-09-18 16:54:03.505020074 +0000 UTC m=+294.230301821"
Sep 18 16:54:03.635123 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:03.635077    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:03.736539 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:03.736441    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:03.835221 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:03.835186    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:04.105964 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:04.105876    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:04.180502 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:04.180469    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:04.458614 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:04.458563    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:54:04.458614 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:04.458620    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:54:04.458867 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:54:04.458703    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:54:04.458867 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:54:04.458843    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:54:04.902896 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:04.902868    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:05.459255 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:05.459219    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:54:05.459651 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:54:05.459345    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmx4b" podUID="83b73597-6182-4df7-bcf5-f6ca3ba721cd"
Sep 18 16:54:06.458676 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.458618    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:54:06.458676 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.458673    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:54:06.458982 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:54:06.458751    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrm4v" podUID="1cfbfb52-83e8-4208-aa4f-de27397133d4"
Sep 18 16:54:06.458982 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:54:06.458893    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7vnw" podUID="46fb0981-ac5c-4e2b-8212-adae49d948c4"
Sep 18 16:54:06.698149 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.698108    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-7.ec2.internal" event="NodeReady"
Sep 18 16:54:06.740044 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.739958    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-866c5896b7-msjvg"]
Sep 18 16:54:06.742782 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.742765    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.745145 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.745120    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 18 16:54:06.745279 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.745169    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 18 16:54:06.745733 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.745717    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b5tkf\""
Sep 18 16:54:06.747829 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.747804    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 18 16:54:06.754064 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.754040    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 18 16:54:06.761598 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.761562    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-866c5896b7-msjvg"]
Sep 18 16:54:06.765099 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.765071    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wzxxz"]
Sep 18 16:54:06.768119 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.768098    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w48tp"]
Sep 18 16:54:06.768261 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.768213    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wzxxz"
Sep 18 16:54:06.771004 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.770986    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:06.772659 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.772640    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4lvzz\""
Sep 18 16:54:06.772808 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.772789    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 16:54:06.772896 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.772793    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 16:54:06.773065 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.773050    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 16:54:06.773141 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.773078    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8qvq5\""
Sep 18 16:54:06.773279 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.773264    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 16:54:06.773545 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.773530    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 16:54:06.775783 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.775764    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 16:54:06.780099 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.780067    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wzxxz"]
Sep 18 16:54:06.783353 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.783325    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w48tp"]
Sep 18 16:54:06.872251 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872205    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc7c0826-2a12-4bba-8079-b124a25edf1c-config-volume\") pod \"dns-default-wzxxz\" (UID: \"fc7c0826-2a12-4bba-8079-b124a25edf1c\") " pod="openshift-dns/dns-default-wzxxz"
Sep 18 16:54:06.872251 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872258    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/613161f4-7a21-4800-97d0-a1a473fcfba5-image-registry-private-configuration\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.872486 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872283    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7e2e1bb-c4ac-4719-91cb-78914b3aafbe-data-volume\") pod \"insights-runtime-extractor-w48tp\" (UID: \"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe\") " pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:06.872486 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872306    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7e2e1bb-c4ac-4719-91cb-78914b3aafbe-crio-socket\") pod \"insights-runtime-extractor-w48tp\" (UID: \"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe\") " pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:06.872486 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872358    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/613161f4-7a21-4800-97d0-a1a473fcfba5-ca-trust-extracted\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.872486 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872394    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc7c0826-2a12-4bba-8079-b124a25edf1c-metrics-tls\") pod \"dns-default-wzxxz\" (UID: \"fc7c0826-2a12-4bba-8079-b124a25edf1c\") " pod="openshift-dns/dns-default-wzxxz"
Sep 18 16:54:06.872486 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872412    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t29g6\" (UniqueName: \"kubernetes.io/projected/fc7c0826-2a12-4bba-8079-b124a25edf1c-kube-api-access-t29g6\") pod \"dns-default-wzxxz\" (UID: \"fc7c0826-2a12-4bba-8079-b124a25edf1c\") " pod="openshift-dns/dns-default-wzxxz"
Sep 18 16:54:06.872486 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872428    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/613161f4-7a21-4800-97d0-a1a473fcfba5-registry-tls\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.872486 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872450    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/613161f4-7a21-4800-97d0-a1a473fcfba5-installation-pull-secrets\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.872728 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872491    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc7c0826-2a12-4bba-8079-b124a25edf1c-tmp-dir\") pod \"dns-default-wzxxz\" (UID: \"fc7c0826-2a12-4bba-8079-b124a25edf1c\") " pod="openshift-dns/dns-default-wzxxz"
Sep 18 16:54:06.872728 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872514    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/613161f4-7a21-4800-97d0-a1a473fcfba5-trusted-ca\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.872728 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872541    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/613161f4-7a21-4800-97d0-a1a473fcfba5-bound-sa-token\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.872728 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872592    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e2e1bb-c4ac-4719-91cb-78914b3aafbe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w48tp\" (UID: \"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe\") " pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:06.872728 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872621    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6dgx\" (UniqueName: \"kubernetes.io/projected/f7e2e1bb-c4ac-4719-91cb-78914b3aafbe-kube-api-access-w6dgx\") pod \"insights-runtime-extractor-w48tp\" (UID: \"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe\") " pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:06.872728 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872642    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/613161f4-7a21-4800-97d0-a1a473fcfba5-registry-certificates\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.872728 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872655    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc9xp\" (UniqueName: \"kubernetes.io/projected/613161f4-7a21-4800-97d0-a1a473fcfba5-kube-api-access-jc9xp\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.872728 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.872670    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e2e1bb-c4ac-4719-91cb-78914b3aafbe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w48tp\" (UID: \"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe\") " pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:06.973495 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.973439    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc7c0826-2a12-4bba-8079-b124a25edf1c-config-volume\") pod \"dns-default-wzxxz\" (UID: \"fc7c0826-2a12-4bba-8079-b124a25edf1c\") " pod="openshift-dns/dns-default-wzxxz"
Sep 18 16:54:06.973495 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.973497    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/613161f4-7a21-4800-97d0-a1a473fcfba5-image-registry-private-configuration\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.973706 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.973626    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7e2e1bb-c4ac-4719-91cb-78914b3aafbe-data-volume\") pod \"insights-runtime-extractor-w48tp\" (UID: \"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe\") " pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:06.973706 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.973669    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7e2e1bb-c4ac-4719-91cb-78914b3aafbe-crio-socket\") pod \"insights-runtime-extractor-w48tp\" (UID: \"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe\") " pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:06.973773 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.973713    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/613161f4-7a21-4800-97d0-a1a473fcfba5-ca-trust-extracted\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.973773 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.973743    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc7c0826-2a12-4bba-8079-b124a25edf1c-metrics-tls\") pod \"dns-default-wzxxz\" (UID: \"fc7c0826-2a12-4bba-8079-b124a25edf1c\") " pod="openshift-dns/dns-default-wzxxz"
Sep 18 16:54:06.973773 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.973768    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t29g6\" (UniqueName: \"kubernetes.io/projected/fc7c0826-2a12-4bba-8079-b124a25edf1c-kube-api-access-t29g6\") pod \"dns-default-wzxxz\" (UID: \"fc7c0826-2a12-4bba-8079-b124a25edf1c\") " pod="openshift-dns/dns-default-wzxxz"
Sep 18 16:54:06.973951 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.973790    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/613161f4-7a21-4800-97d0-a1a473fcfba5-registry-tls\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.973951 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.973845    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/613161f4-7a21-4800-97d0-a1a473fcfba5-installation-pull-secrets\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.973951 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.973860    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7e2e1bb-c4ac-4719-91cb-78914b3aafbe-crio-socket\") pod \"insights-runtime-extractor-w48tp\" (UID: \"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe\") " pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:06.973951 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.973935    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc7c0826-2a12-4bba-8079-b124a25edf1c-tmp-dir\") pod \"dns-default-wzxxz\" (UID: \"fc7c0826-2a12-4bba-8079-b124a25edf1c\") " pod="openshift-dns/dns-default-wzxxz"
Sep 18 16:54:06.974153 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.973966    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/613161f4-7a21-4800-97d0-a1a473fcfba5-trusted-ca\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.974153 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.973992    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/613161f4-7a21-4800-97d0-a1a473fcfba5-bound-sa-token\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.974153 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.974025    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e2e1bb-c4ac-4719-91cb-78914b3aafbe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w48tp\" (UID: \"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe\") " pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:06.974153 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.974055    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6dgx\" (UniqueName: \"kubernetes.io/projected/f7e2e1bb-c4ac-4719-91cb-78914b3aafbe-kube-api-access-w6dgx\") pod \"insights-runtime-extractor-w48tp\" (UID: \"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe\") " pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:06.974153 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.974084    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/613161f4-7a21-4800-97d0-a1a473fcfba5-registry-certificates\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.974153 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.974109    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc9xp\" (UniqueName: \"kubernetes.io/projected/613161f4-7a21-4800-97d0-a1a473fcfba5-kube-api-access-jc9xp\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.974153 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.974133    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e2e1bb-c4ac-4719-91cb-78914b3aafbe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w48tp\" (UID: \"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe\") " pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:06.974493 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.974161    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc7c0826-2a12-4bba-8079-b124a25edf1c-config-volume\") pod \"dns-default-wzxxz\" (UID: \"fc7c0826-2a12-4bba-8079-b124a25edf1c\") " pod="openshift-dns/dns-default-wzxxz"
Sep 18 16:54:06.974493 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.974190    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/613161f4-7a21-4800-97d0-a1a473fcfba5-ca-trust-extracted\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.974493 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.974477    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc7c0826-2a12-4bba-8079-b124a25edf1c-tmp-dir\") pod \"dns-default-wzxxz\" (UID: \"fc7c0826-2a12-4bba-8079-b124a25edf1c\") " pod="openshift-dns/dns-default-wzxxz"
Sep 18 16:54:06.974701 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.974675    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7e2e1bb-c4ac-4719-91cb-78914b3aafbe-data-volume\") pod \"insights-runtime-extractor-w48tp\" (UID: \"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe\") " pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:06.975079 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.975038    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e2e1bb-c4ac-4719-91cb-78914b3aafbe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w48tp\" (UID: \"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe\") " pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:06.975391 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.975257    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/613161f4-7a21-4800-97d0-a1a473fcfba5-registry-certificates\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.976155 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.976118    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/613161f4-7a21-4800-97d0-a1a473fcfba5-trusted-ca\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.977993 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.977958    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/613161f4-7a21-4800-97d0-a1a473fcfba5-installation-pull-secrets\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.977993 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.977980    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc7c0826-2a12-4bba-8079-b124a25edf1c-metrics-tls\") pod \"dns-default-wzxxz\" (UID: \"fc7c0826-2a12-4bba-8079-b124a25edf1c\") " pod="openshift-dns/dns-default-wzxxz"
Sep 18 16:54:06.977993 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.977957    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e2e1bb-c4ac-4719-91cb-78914b3aafbe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w48tp\" (UID: \"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe\") " pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:06.978244 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.977999    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/613161f4-7a21-4800-97d0-a1a473fcfba5-image-registry-private-configuration\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.978244 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.978220    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/613161f4-7a21-4800-97d0-a1a473fcfba5-registry-tls\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.986424 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.986388    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/613161f4-7a21-4800-97d0-a1a473fcfba5-bound-sa-token\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.986726 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.986705    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc9xp\" (UniqueName: \"kubernetes.io/projected/613161f4-7a21-4800-97d0-a1a473fcfba5-kube-api-access-jc9xp\") pod \"image-registry-866c5896b7-msjvg\" (UID: \"613161f4-7a21-4800-97d0-a1a473fcfba5\") " pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:06.987006 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.986986    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t29g6\" (UniqueName: \"kubernetes.io/projected/fc7c0826-2a12-4bba-8079-b124a25edf1c-kube-api-access-t29g6\") pod \"dns-default-wzxxz\" (UID: \"fc7c0826-2a12-4bba-8079-b124a25edf1c\") " pod="openshift-dns/dns-default-wzxxz"
Sep 18 16:54:06.987189 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:06.987171    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6dgx\" (UniqueName: \"kubernetes.io/projected/f7e2e1bb-c4ac-4719-91cb-78914b3aafbe-kube-api-access-w6dgx\") pod \"insights-runtime-extractor-w48tp\" (UID: \"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe\") " pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:07.052366 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:07.052249    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:07.079130 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:07.079092    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wzxxz"
Sep 18 16:54:07.084732 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:07.084710    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w48tp"
Sep 18 16:54:07.342781 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:07.342709    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-866c5896b7-msjvg"]
Sep 18 16:54:07.346628 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:54:07.346601    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod613161f4_7a21_4800_97d0_a1a473fcfba5.slice/crio-07e4ef00ebce0d49a7f72428cda12ee878c7eb773236fa6c82221bfa95327a7a WatchSource:0}: Error finding container 07e4ef00ebce0d49a7f72428cda12ee878c7eb773236fa6c82221bfa95327a7a: Status 404 returned error can't find the container with id 07e4ef00ebce0d49a7f72428cda12ee878c7eb773236fa6c82221bfa95327a7a
Sep 18 16:54:07.363530 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:07.363450    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wzxxz"]
Sep 18 16:54:07.368366 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:54:07.368321    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc7c0826_2a12_4bba_8079_b124a25edf1c.slice/crio-eaaa41f5b70dd83aa3cb35d2ed9e778966cb8fb27f5844b1629314919c7ffcbc WatchSource:0}: Error finding container eaaa41f5b70dd83aa3cb35d2ed9e778966cb8fb27f5844b1629314919c7ffcbc: Status 404 returned error can't find the container with id eaaa41f5b70dd83aa3cb35d2ed9e778966cb8fb27f5844b1629314919c7ffcbc
Sep 18 16:54:07.385955 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:07.385930    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w48tp"]
Sep 18 16:54:07.391862 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:54:07.391830    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e2e1bb_c4ac_4719_91cb_78914b3aafbe.slice/crio-18dc435f8cbede1dabe7be0902315cd6fdda2784a18022badc6200bbb20ed8d6 WatchSource:0}: Error finding container 18dc435f8cbede1dabe7be0902315cd6fdda2784a18022badc6200bbb20ed8d6: Status 404 returned error can't find the container with id 18dc435f8cbede1dabe7be0902315cd6fdda2784a18022badc6200bbb20ed8d6
Sep 18 16:54:07.463304 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:07.463268    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:54:07.465271 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:07.465248    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 16:54:07.465405 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:07.465360    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rqwhk\""
Sep 18 16:54:07.491926 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:07.491889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wzxxz" event={"ID":"fc7c0826-2a12-4bba-8079-b124a25edf1c","Type":"ContainerStarted","Data":"eaaa41f5b70dd83aa3cb35d2ed9e778966cb8fb27f5844b1629314919c7ffcbc"}
Sep 18 16:54:07.493596 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:07.493556    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w48tp" event={"ID":"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe","Type":"ContainerStarted","Data":"4a228fcd08792a0862eb433dae2827eb652cf8d8e5090d1f13dea0aa38ffb3e7"}
Sep 18 16:54:07.493749 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:07.493628    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w48tp" event={"ID":"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe","Type":"ContainerStarted","Data":"18dc435f8cbede1dabe7be0902315cd6fdda2784a18022badc6200bbb20ed8d6"}
Sep 18 16:54:07.495272 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:07.495247    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-866c5896b7-msjvg" event={"ID":"613161f4-7a21-4800-97d0-a1a473fcfba5","Type":"ContainerStarted","Data":"2495e5271d35d69832f8eb65987857d9deee7c3508c3fddb467f9d027b8ced06"}
Sep 18 16:54:07.495400 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:07.495295    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-866c5896b7-msjvg" event={"ID":"613161f4-7a21-4800-97d0-a1a473fcfba5","Type":"ContainerStarted","Data":"07e4ef00ebce0d49a7f72428cda12ee878c7eb773236fa6c82221bfa95327a7a"}
Sep 18 16:54:07.495400 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:07.495371    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:07.518056 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:07.517994    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-866c5896b7-msjvg" podStartSLOduration=24.517974077 podStartE2EDuration="24.517974077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:53:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:54:07.517529841 +0000 UTC m=+298.242811601" watchObservedRunningTime="2026-09-18 16:54:07.517974077 +0000 UTC m=+298.243255873"
Sep 18 16:54:08.458634 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:08.458535    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:54:08.458634 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:08.458562    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:54:08.461238 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:08.461213    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 16:54:08.461238 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:08.461226    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 16:54:08.461525 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:08.461271    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7dj2b\""
Sep 18 16:54:08.461609 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:08.461547    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 16:54:08.501853 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:08.501801    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w48tp" event={"ID":"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe","Type":"ContainerStarted","Data":"bd9c02cefa370a8d3c26705a2be75c100dff23d8bec2dcc03302a8b026b8e6c2"}
Sep 18 16:54:09.853357 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:09.853322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:09.978510 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:09.978473    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:10.070883 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:10.070769    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:10.139328 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:10.139295    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:10.512382 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:10.512346    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w48tp" event={"ID":"f7e2e1bb-c4ac-4719-91cb-78914b3aafbe","Type":"ContainerStarted","Data":"fcaa110bf00ddc456464d54f384bac72bbda108131dd1b3afe29fbef6cf1744e"}
Sep 18 16:54:10.514064 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:10.514039    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wzxxz" event={"ID":"fc7c0826-2a12-4bba-8079-b124a25edf1c","Type":"ContainerStarted","Data":"fea87235372bcd1e019a8f02eb1cbaf97fc2babffc0cceb0611c7d0fd1b18c25"}
Sep 18 16:54:10.514224 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:10.514081    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wzxxz" event={"ID":"fc7c0826-2a12-4bba-8079-b124a25edf1c","Type":"ContainerStarted","Data":"3c0b514725b9d10370cfce37672dec0872bdc292a84663ea2b4f366abb483ee9"}
Sep 18 16:54:10.514224 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:10.514189    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wzxxz"
Sep 18 16:54:10.516710 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:10.516688    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:10.529413 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:10.529302    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w48tp" podStartSLOduration=2.255853179 podStartE2EDuration="4.52928443s" totalImagesPullingTime="2.273431251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:54:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:54:10.529237673 +0000 UTC m=+301.254519431" watchObservedRunningTime="2026-09-18 16:54:10.52928443 +0000 UTC m=+301.254566177"
Sep 18 16:54:10.543924 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:10.543867    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wzxxz" podStartSLOduration=2.109690716 podStartE2EDuration="4.543849146s" totalImagesPullingTime="2.43415843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:54:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:54:10.543658782 +0000 UTC m=+301.268940552" watchObservedRunningTime="2026-09-18 16:54:10.543849146 +0000 UTC m=+301.269130891"
Sep 18 16:54:10.619832 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:10.619778    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:11.089202 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:11.089169    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:11.360410 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:11.360328    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 16:54:11.361286 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:11.361261    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 16:54:11.363226 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:11.363206    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 16:54:11.363684 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:11.363669    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 16:54:11.365500 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:11.365479    2583 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 16:54:16.691937 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:16.691897    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:16.757402 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:16.757372    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:20.519617 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:20.519583    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wzxxz"
Sep 18 16:54:21.722482 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:21.722447    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:21.827167 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:21.827134    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:23.462577 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:23.462552    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s746c"
Sep 18 16:54:23.622706 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:23.622671    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:23.705747 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:23.705706    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:23.785601 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:23.785502    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:23.912674 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:23.912634    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:26.379878 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:26.379843    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:26.456217 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:26.456180    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:26.727308 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:26.727215    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:27.688928 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:27.688894    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:28.398128 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:28.398094    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:28.507006 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:28.506977    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-866c5896b7-msjvg"
Sep 18 16:54:28.666341 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:28.666248    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:28.767784 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:28.767746    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:28.826696 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:28.826652    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:29.017787 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:29.017698    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:29.085100 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:29.085070    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:29.670405 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:29.670376    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:31.063016 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:31.062983    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:32.366665 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:32.366629    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:32.555084 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:32.555043    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:32.658943 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:32.658850    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:36.478775 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:36.478746    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:37.426324 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:37.426291    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:38.750988 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:38.750953    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:39.633169 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:39.633136    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:39.944310 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:39.944229    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:40.034782 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:40.034746    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:40.533104 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:40.533074    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:41.228611 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:41.228578    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:45.389082 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:45.389047    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:46.810680 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:46.810645    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:48.119300 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:48.119268    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:49.419098 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:49.419048    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:50.900288 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:50.900163    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:52.917136 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:52.917103    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:56.683763 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:56.683727    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:57.171112 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:57.171074    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:57.249877 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:57.249844    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:58.249103 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:58.249060    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:54:59.634975 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:54:59.634927    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:05.045917 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:05.045876    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:05.147040 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:05.146996    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:05.259307 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:05.259269    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:06.566930 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:06.566893    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:08.112470 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:08.112435    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:09.992045 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:09.992009    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:10.520106 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:10.520068    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:10.619658 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:10.619627    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:10.724764 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:10.724731    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:11.548894 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:11.548863    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:24.358477 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.358431    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:55:24.358477 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.358487    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs\") pod \"network-metrics-daemon-qmx4b\" (UID: \"83b73597-6182-4df7-bcf5-f6ca3ba721cd\") " pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:55:24.361191 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.361173    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 16:55:24.361989 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.361977    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 16:55:24.371047 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.371022    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46fb0981-ac5c-4e2b-8212-adae49d948c4-original-pull-secret\") pod \"global-pull-secret-syncer-v7vnw\" (UID: \"46fb0981-ac5c-4e2b-8212-adae49d948c4\") " pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:55:24.371162 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.371086    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b73597-6182-4df7-bcf5-f6ca3ba721cd-metrics-certs\") pod \"network-metrics-daemon-qmx4b\" (UID: \"83b73597-6182-4df7-bcf5-f6ca3ba721cd\") " pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:55:24.459041 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.459001    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fgtq\" (UniqueName: \"kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq\") pod \"network-check-target-lrm4v\" (UID: \"1cfbfb52-83e8-4208-aa4f-de27397133d4\") " pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:55:24.461514 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.461495    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 16:55:24.471161 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.471142    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 16:55:24.481962 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.481942    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fgtq\" (UniqueName: \"kubernetes.io/projected/1cfbfb52-83e8-4208-aa4f-de27397133d4-kube-api-access-6fgtq\") pod \"network-check-target-lrm4v\" (UID: \"1cfbfb52-83e8-4208-aa4f-de27397133d4\") " pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:55:24.575752 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.575720    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rqwhk\""
Sep 18 16:55:24.584467 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.584448    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmx4b"
Sep 18 16:55:24.670665 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.670631    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7vnw"
Sep 18 16:55:24.679581 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.679563    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7dj2b\""
Sep 18 16:55:24.687508 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.687489    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:55:24.854547 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.854459    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qmx4b"]
Sep 18 16:55:24.857386 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:55:24.857347    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b73597_6182_4df7_bcf5_f6ca3ba721cd.slice/crio-76e65af5b4da3c04fc9bf49dc2286ea7190e0983ec38c124f4070f97c25d1d1e WatchSource:0}: Error finding container 76e65af5b4da3c04fc9bf49dc2286ea7190e0983ec38c124f4070f97c25d1d1e: Status 404 returned error can't find the container with id 76e65af5b4da3c04fc9bf49dc2286ea7190e0983ec38c124f4070f97c25d1d1e
Sep 18 16:55:24.859350 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.859334    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 16:55:24.944607 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.944543    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:24.947226 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.947202    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v7vnw"]
Sep 18 16:55:24.950297 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:55:24.950273    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46fb0981_ac5c_4e2b_8212_adae49d948c4.slice/crio-929c97f96b987706040a3ec488d12290fe107a5214bf8a5692f1234ae47bebb5 WatchSource:0}: Error finding container 929c97f96b987706040a3ec488d12290fe107a5214bf8a5692f1234ae47bebb5: Status 404 returned error can't find the container with id 929c97f96b987706040a3ec488d12290fe107a5214bf8a5692f1234ae47bebb5
Sep 18 16:55:24.966877 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:24.966856    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lrm4v"]
Sep 18 16:55:24.969576 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:55:24.969554    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cfbfb52_83e8_4208_aa4f_de27397133d4.slice/crio-8cf9fddcffa655bcd0281b9aa259d42e3a8b5b3e3cbc3660c8cae2d833f956e8 WatchSource:0}: Error finding container 8cf9fddcffa655bcd0281b9aa259d42e3a8b5b3e3cbc3660c8cae2d833f956e8: Status 404 returned error can't find the container with id 8cf9fddcffa655bcd0281b9aa259d42e3a8b5b3e3cbc3660c8cae2d833f956e8
Sep 18 16:55:25.040952 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:25.040918    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:25.102838 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:25.102791    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:25.750962 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:25.750925    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qmx4b" event={"ID":"83b73597-6182-4df7-bcf5-f6ca3ba721cd","Type":"ContainerStarted","Data":"76e65af5b4da3c04fc9bf49dc2286ea7190e0983ec38c124f4070f97c25d1d1e"}
Sep 18 16:55:25.753165 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:25.753085    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v7vnw" event={"ID":"46fb0981-ac5c-4e2b-8212-adae49d948c4","Type":"ContainerStarted","Data":"929c97f96b987706040a3ec488d12290fe107a5214bf8a5692f1234ae47bebb5"}
Sep 18 16:55:25.754681 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:25.754649    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lrm4v" event={"ID":"1cfbfb52-83e8-4208-aa4f-de27397133d4","Type":"ContainerStarted","Data":"8cf9fddcffa655bcd0281b9aa259d42e3a8b5b3e3cbc3660c8cae2d833f956e8"}
Sep 18 16:55:26.761164 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:26.761125    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qmx4b" event={"ID":"83b73597-6182-4df7-bcf5-f6ca3ba721cd","Type":"ContainerStarted","Data":"6f2daf1fa7ab792ca326db6a8081af0d64a3921cd4dc3cd1d4f90f03c6b80cd3"}
Sep 18 16:55:26.761631 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:26.761194    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qmx4b" event={"ID":"83b73597-6182-4df7-bcf5-f6ca3ba721cd","Type":"ContainerStarted","Data":"1b783b5f8c4d3c01ee6993139919ec9c0c708a006a802c11c76bd757348c051f"}
Sep 18 16:55:26.799587 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:26.799525    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qmx4b" podStartSLOduration=374.78942458 podStartE2EDuration="6m15.799502741s" totalImagesPullingTime="1.010078161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:55:26.798889986 +0000 UTC m=+377.524171741" watchObservedRunningTime="2026-09-18 16:55:26.799502741 +0000 UTC m=+377.524784493"
Sep 18 16:55:26.900896 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:26.900826    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:27.000267 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:27.000226    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:27.061226 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:27.061139    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:27.123508 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:27.123460    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:29.772624 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:29.772538    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v7vnw" event={"ID":"46fb0981-ac5c-4e2b-8212-adae49d948c4","Type":"ContainerStarted","Data":"f5a2f0d07d2fdf58b59cd65b2a6504b6aee9d615372607034829cf4eb4b63c0f"}
Sep 18 16:55:29.774240 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:29.774217    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lrm4v" event={"ID":"1cfbfb52-83e8-4208-aa4f-de27397133d4","Type":"ContainerStarted","Data":"ca54824cabe357bc57588c436ec39a6125503536ea341e709f4a74caa667e786"}
Sep 18 16:55:29.774378 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:29.774259    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:55:29.791169 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:29.791123    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v7vnw" podStartSLOduration=374.324192862 podStartE2EDuration="6m18.791110249s" totalImagesPullingTime="4.466917387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:55:29.790788083 +0000 UTC m=+380.516069833" watchObservedRunningTime="2026-09-18 16:55:29.791110249 +0000 UTC m=+380.516391995"
Sep 18 16:55:29.807968 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:29.807926    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lrm4v" podStartSLOduration=374.365132435 podStartE2EDuration="6m18.807913732s" totalImagesPullingTime="4.442781297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:55:29.807711297 +0000 UTC m=+380.532993042" watchObservedRunningTime="2026-09-18 16:55:29.807913732 +0000 UTC m=+380.533195477"
Sep 18 16:55:37.298806 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:37.298764    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:37.367736 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:37.367700    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:37.444431 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:37.444404    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:41.180240 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:41.180201    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:43.358207 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:43.358173    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:44.210801 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:44.210759    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:45.141778 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.141737    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:45.386479 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.386446    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:45.450976 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.450904    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ggqml"]
Sep 18 16:55:45.454032 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.454017    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ggqml"
Sep 18 16:55:45.471092 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.471071    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 16:55:45.471092 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.471089    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 16:55:45.471366 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.471353    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 16:55:45.472093 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.472077    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bjwms\""
Sep 18 16:55:45.478633 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.478613    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ggqml"]
Sep 18 16:55:45.501168 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.501141    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsgb7\" (UniqueName: \"kubernetes.io/projected/75856070-e664-44eb-94df-4b885ba029e4-kube-api-access-qsgb7\") pod \"ingress-canary-ggqml\" (UID: \"75856070-e664-44eb-94df-4b885ba029e4\") " pod="openshift-ingress-canary/ingress-canary-ggqml"
Sep 18 16:55:45.501282 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.501177    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75856070-e664-44eb-94df-4b885ba029e4-cert\") pod \"ingress-canary-ggqml\" (UID: \"75856070-e664-44eb-94df-4b885ba029e4\") " pod="openshift-ingress-canary/ingress-canary-ggqml"
Sep 18 16:55:45.517592 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.517566    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:45.601709 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.601684    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsgb7\" (UniqueName: \"kubernetes.io/projected/75856070-e664-44eb-94df-4b885ba029e4-kube-api-access-qsgb7\") pod \"ingress-canary-ggqml\" (UID: \"75856070-e664-44eb-94df-4b885ba029e4\") " pod="openshift-ingress-canary/ingress-canary-ggqml"
Sep 18 16:55:45.601840 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.601727    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75856070-e664-44eb-94df-4b885ba029e4-cert\") pod \"ingress-canary-ggqml\" (UID: \"75856070-e664-44eb-94df-4b885ba029e4\") " pod="openshift-ingress-canary/ingress-canary-ggqml"
Sep 18 16:55:45.601890 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:55:45.601849    2583 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Sep 18 16:55:45.601925 ip-10-0-142-7 kubenswrapper[2583]: E0918 16:55:45.601907    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75856070-e664-44eb-94df-4b885ba029e4-cert podName:75856070-e664-44eb-94df-4b885ba029e4 nodeName:}" failed. No retries permitted until 2026-09-18 16:55:46.101889421 +0000 UTC m=+396.827171160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/75856070-e664-44eb-94df-4b885ba029e4-cert") pod "ingress-canary-ggqml" (UID: "75856070-e664-44eb-94df-4b885ba029e4") : secret "canary-serving-cert" not found
Sep 18 16:55:45.621666 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.621641    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsgb7\" (UniqueName: \"kubernetes.io/projected/75856070-e664-44eb-94df-4b885ba029e4-kube-api-access-qsgb7\") pod \"ingress-canary-ggqml\" (UID: \"75856070-e664-44eb-94df-4b885ba029e4\") " pod="openshift-ingress-canary/ingress-canary-ggqml"
Sep 18 16:55:45.658872 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.658848    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:45.767610 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.767517    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:45.788692 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.788662    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5c58d979fb-ltwh9"]
Sep 18 16:55:45.791477 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.791459    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:45.793581 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.793559    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 18 16:55:45.793839 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.793804    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 18 16:55:45.793918 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.793890    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 18 16:55:45.794004 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.793982    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 18 16:55:45.794327 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.794310    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 18 16:55:45.794327 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.794323    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 18 16:55:45.794433 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.794389    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vgvds\""
Sep 18 16:55:45.807298 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.807274    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c58d979fb-ltwh9"]
Sep 18 16:55:45.892613 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.892578    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:45.904557 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.904530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecdbf1ad-4cf9-4de0-bf03-4028b8928c62-metrics-certs\") pod \"router-default-5c58d979fb-ltwh9\" (UID: \"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62\") " pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:45.904681 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.904559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecdbf1ad-4cf9-4de0-bf03-4028b8928c62-service-ca-bundle\") pod \"router-default-5c58d979fb-ltwh9\" (UID: \"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62\") " pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:45.904681 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.904602    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ecdbf1ad-4cf9-4de0-bf03-4028b8928c62-default-certificate\") pod \"router-default-5c58d979fb-ltwh9\" (UID: \"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62\") " pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:45.904681 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.904666    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8gkn\" (UniqueName: \"kubernetes.io/projected/ecdbf1ad-4cf9-4de0-bf03-4028b8928c62-kube-api-access-z8gkn\") pod \"router-default-5c58d979fb-ltwh9\" (UID: \"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62\") " pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:45.904792 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.904691    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ecdbf1ad-4cf9-4de0-bf03-4028b8928c62-stats-auth\") pod \"router-default-5c58d979fb-ltwh9\" (UID: \"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62\") " pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:45.991014 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:45.990987    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:46.005037 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.005012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ecdbf1ad-4cf9-4de0-bf03-4028b8928c62-stats-auth\") pod \"router-default-5c58d979fb-ltwh9\" (UID: \"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62\") " pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:46.005111 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.005070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecdbf1ad-4cf9-4de0-bf03-4028b8928c62-metrics-certs\") pod \"router-default-5c58d979fb-ltwh9\" (UID: \"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62\") " pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:46.005111 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.005090    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecdbf1ad-4cf9-4de0-bf03-4028b8928c62-service-ca-bundle\") pod \"router-default-5c58d979fb-ltwh9\" (UID: \"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62\") " pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:46.005221 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.005137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ecdbf1ad-4cf9-4de0-bf03-4028b8928c62-default-certificate\") pod \"router-default-5c58d979fb-ltwh9\" (UID: \"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62\") " pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:46.005221 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.005156    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8gkn\" (UniqueName: \"kubernetes.io/projected/ecdbf1ad-4cf9-4de0-bf03-4028b8928c62-kube-api-access-z8gkn\") pod \"router-default-5c58d979fb-ltwh9\" (UID: \"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62\") " pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:46.005789 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.005755    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecdbf1ad-4cf9-4de0-bf03-4028b8928c62-service-ca-bundle\") pod \"router-default-5c58d979fb-ltwh9\" (UID: \"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62\") " pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:46.007648 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.007628    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecdbf1ad-4cf9-4de0-bf03-4028b8928c62-metrics-certs\") pod \"router-default-5c58d979fb-ltwh9\" (UID: \"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62\") " pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:46.007648 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.007646    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ecdbf1ad-4cf9-4de0-bf03-4028b8928c62-stats-auth\") pod \"router-default-5c58d979fb-ltwh9\" (UID: \"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62\") " pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:46.007770 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.007661    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ecdbf1ad-4cf9-4de0-bf03-4028b8928c62-default-certificate\") pod \"router-default-5c58d979fb-ltwh9\" (UID: \"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62\") " pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:46.018698 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.018650    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8gkn\" (UniqueName: \"kubernetes.io/projected/ecdbf1ad-4cf9-4de0-bf03-4028b8928c62-kube-api-access-z8gkn\") pod \"router-default-5c58d979fb-ltwh9\" (UID: \"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62\") " pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:46.091039 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.091017    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:46.100938 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.100915    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:46.106001 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.105985    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75856070-e664-44eb-94df-4b885ba029e4-cert\") pod \"ingress-canary-ggqml\" (UID: \"75856070-e664-44eb-94df-4b885ba029e4\") " pod="openshift-ingress-canary/ingress-canary-ggqml"
Sep 18 16:55:46.108200 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.108182    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75856070-e664-44eb-94df-4b885ba029e4-cert\") pod \"ingress-canary-ggqml\" (UID: \"75856070-e664-44eb-94df-4b885ba029e4\") " pod="openshift-ingress-canary/ingress-canary-ggqml"
Sep 18 16:55:46.365560 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.365534    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ggqml"
Sep 18 16:55:46.382621 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.382593    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c58d979fb-ltwh9"]
Sep 18 16:55:46.385383 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:55:46.385360    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecdbf1ad_4cf9_4de0_bf03_4028b8928c62.slice/crio-a9f5c6c3979a757639d28aa53c1b811c9c698d2ed809826fc09bdbaf20954cce WatchSource:0}: Error finding container a9f5c6c3979a757639d28aa53c1b811c9c698d2ed809826fc09bdbaf20954cce: Status 404 returned error can't find the container with id a9f5c6c3979a757639d28aa53c1b811c9c698d2ed809826fc09bdbaf20954cce
Sep 18 16:55:46.499380 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.499324    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:46.591646 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.591605    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:46.649933 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.649866    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ggqml"]
Sep 18 16:55:46.652580 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:55:46.652543    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75856070_e664_44eb_94df_4b885ba029e4.slice/crio-06cd42149b532fb6c78ca6e01c62dab6bee3583248668ec8fb6ae3e4b8fe057c WatchSource:0}: Error finding container 06cd42149b532fb6c78ca6e01c62dab6bee3583248668ec8fb6ae3e4b8fe057c: Status 404 returned error can't find the container with id 06cd42149b532fb6c78ca6e01c62dab6bee3583248668ec8fb6ae3e4b8fe057c
Sep 18 16:55:46.713838 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.713791    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:46.826581 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.826545    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ggqml" event={"ID":"75856070-e664-44eb-94df-4b885ba029e4","Type":"ContainerStarted","Data":"06cd42149b532fb6c78ca6e01c62dab6bee3583248668ec8fb6ae3e4b8fe057c"}
Sep 18 16:55:46.828032 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.828005    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c58d979fb-ltwh9" event={"ID":"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62","Type":"ContainerStarted","Data":"d6067a3fef76ece2e9f71c7f5e7197f08b22de29a37dcfd014f7c1b9b5929ae2"}
Sep 18 16:55:46.828131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.828052    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c58d979fb-ltwh9" event={"ID":"ecdbf1ad-4cf9-4de0-bf03-4028b8928c62","Type":"ContainerStarted","Data":"a9f5c6c3979a757639d28aa53c1b811c9c698d2ed809826fc09bdbaf20954cce"}
Sep 18 16:55:46.834482 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.834448    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:46.867580 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.867541    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5c58d979fb-ltwh9" podStartSLOduration=1.867527613 podStartE2EDuration="1.867527613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:55:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:55:46.867131778 +0000 UTC m=+397.592413535" watchObservedRunningTime="2026-09-18 16:55:46.867527613 +0000 UTC m=+397.592809358"
Sep 18 16:55:46.917830 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:46.917759    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:47.101277 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:47.101236    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:47.104019 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:47.103996    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:47.832350 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:47.832311    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:47.833703 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:47.833682    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5c58d979fb-ltwh9"
Sep 18 16:55:48.837235 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:48.837197    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ggqml" event={"ID":"75856070-e664-44eb-94df-4b885ba029e4","Type":"ContainerStarted","Data":"00d0d0749623a9adb3eaeac6294975399c5cf4b90631400145e410e308eea8dd"}
Sep 18 16:55:48.856243 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:48.856187    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ggqml" podStartSLOduration=1.860384179 podStartE2EDuration="3.856171964s" totalImagesPullingTime="1.995787785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:55:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:55:48.855056374 +0000 UTC m=+399.580338121" watchObservedRunningTime="2026-09-18 16:55:48.856171964 +0000 UTC m=+399.581453710"
Sep 18 16:55:52.513792 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:52.513758    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:55.167077 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:55.167041    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:55.282008 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:55.281969    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:55:57.569232 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:55:57.569193    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:00.008649 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:00.008616    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:00.779338 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:00.779306    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lrm4v"
Sep 18 16:56:01.705277 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:01.705244    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:01.806080 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:01.806051    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:03.163171 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:03.163138    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:03.258885 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:03.258859    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:14.264398 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:14.264360    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:16.250843 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:16.250796    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:16.336023 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:16.335990    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:17.279829 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:17.279789    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:17.435936 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:17.435897    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:17.525521 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:17.525491    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:17.635179 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:17.635149    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:27.500063 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:27.499987    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:39.971386 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:39.971353    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:40.103582 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:40.103551    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:40.209902 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:40.209872    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:45.222292 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:45.222257    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:45.296674 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:45.296643    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:45.679932 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:45.679905    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:45.805723 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:45.805697    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:45.877319 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:45.877296    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:54.807145 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:54.807099    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:56:54.946849 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:56:54.946761    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:57:07.315798 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:57:07.315719    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:57:07.426295 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:57:07.426251    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:57:24.050322 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:57:24.050271    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:57:24.159085 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:57:24.159049    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:58:04.500595 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.500469    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:58:04.599032 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.598999    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:58:04.699732 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.699699    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:58:04.710513 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.710485    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv"]
Sep 18 16:58:04.713483 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.713466    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv"
Sep 18 16:58:04.717687 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.717655    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 18 16:58:04.717846 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.717729    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 18 16:58:04.717846 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.717796    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 18 16:58:04.718080 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.718062    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 18 16:58:04.723808 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.723783    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv"]
Sep 18 16:58:04.886757 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.886731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvz9b\" (UniqueName: \"kubernetes.io/projected/e7a85df2-5daa-4c21-9305-20d8c408f3e4-kube-api-access-xvz9b\") pod \"klusterlet-addon-workmgr-8658b5796d-s6pdv\" (UID: \"e7a85df2-5daa-4c21-9305-20d8c408f3e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv"
Sep 18 16:58:04.886874 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.886771    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7a85df2-5daa-4c21-9305-20d8c408f3e4-tmp\") pod \"klusterlet-addon-workmgr-8658b5796d-s6pdv\" (UID: \"e7a85df2-5daa-4c21-9305-20d8c408f3e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv"
Sep 18 16:58:04.886874 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.886790    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e7a85df2-5daa-4c21-9305-20d8c408f3e4-klusterlet-config\") pod \"klusterlet-addon-workmgr-8658b5796d-s6pdv\" (UID: \"e7a85df2-5daa-4c21-9305-20d8c408f3e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv"
Sep 18 16:58:04.987578 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.987548    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7a85df2-5daa-4c21-9305-20d8c408f3e4-tmp\") pod \"klusterlet-addon-workmgr-8658b5796d-s6pdv\" (UID: \"e7a85df2-5daa-4c21-9305-20d8c408f3e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv"
Sep 18 16:58:04.987673 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.987580    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e7a85df2-5daa-4c21-9305-20d8c408f3e4-klusterlet-config\") pod \"klusterlet-addon-workmgr-8658b5796d-s6pdv\" (UID: \"e7a85df2-5daa-4c21-9305-20d8c408f3e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv"
Sep 18 16:58:04.987673 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.987637    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvz9b\" (UniqueName: \"kubernetes.io/projected/e7a85df2-5daa-4c21-9305-20d8c408f3e4-kube-api-access-xvz9b\") pod \"klusterlet-addon-workmgr-8658b5796d-s6pdv\" (UID: \"e7a85df2-5daa-4c21-9305-20d8c408f3e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv"
Sep 18 16:58:04.988035 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.988013    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7a85df2-5daa-4c21-9305-20d8c408f3e4-tmp\") pod \"klusterlet-addon-workmgr-8658b5796d-s6pdv\" (UID: \"e7a85df2-5daa-4c21-9305-20d8c408f3e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv"
Sep 18 16:58:04.990526 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.990507    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e7a85df2-5daa-4c21-9305-20d8c408f3e4-klusterlet-config\") pod \"klusterlet-addon-workmgr-8658b5796d-s6pdv\" (UID: \"e7a85df2-5daa-4c21-9305-20d8c408f3e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv"
Sep 18 16:58:04.996790 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:04.996767    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvz9b\" (UniqueName: \"kubernetes.io/projected/e7a85df2-5daa-4c21-9305-20d8c408f3e4-kube-api-access-xvz9b\") pod \"klusterlet-addon-workmgr-8658b5796d-s6pdv\" (UID: \"e7a85df2-5daa-4c21-9305-20d8c408f3e4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv"
Sep 18 16:58:05.024131 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:05.024101    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv"
Sep 18 16:58:05.299690 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:05.299618    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv"]
Sep 18 16:58:05.303087 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:58:05.303057    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a85df2_5daa_4c21_9305_20d8c408f3e4.slice/crio-8845f3b384915fc7f938ca52e1109ed6ae4a7b7e4c16a08932b2563c37108eba WatchSource:0}: Error finding container 8845f3b384915fc7f938ca52e1109ed6ae4a7b7e4c16a08932b2563c37108eba: Status 404 returned error can't find the container with id 8845f3b384915fc7f938ca52e1109ed6ae4a7b7e4c16a08932b2563c37108eba
Sep 18 16:58:06.282922 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:06.282869    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv" event={"ID":"e7a85df2-5daa-4c21-9305-20d8c408f3e4","Type":"ContainerStarted","Data":"8845f3b384915fc7f938ca52e1109ed6ae4a7b7e4c16a08932b2563c37108eba"}
Sep 18 16:58:09.296662 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:09.296632    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv" event={"ID":"e7a85df2-5daa-4c21-9305-20d8c408f3e4","Type":"ContainerStarted","Data":"1085217bb146dc37dbb727fcd866057f9a52dd8119047a335515ff31dbda41e7"}
Sep 18 16:58:09.297105 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:09.296846    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv"
Sep 18 16:58:09.298483 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:09.298463    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv"
Sep 18 16:58:09.312647 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:09.312599    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8658b5796d-s6pdv" podStartSLOduration=1.774833091 podStartE2EDuration="5.312588209s" totalImagesPullingTime="3.537755118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:58:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:58:09.311384929 +0000 UTC m=+540.036666685" watchObservedRunningTime="2026-09-18 16:58:09.312588209 +0000 UTC m=+540.037869955"
Sep 18 16:58:57.954803 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:57.954773    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:58:58.054925 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:58.054895    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:58:58.167781 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:58.167756    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:58:59.021171 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.021135    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"]
Sep 18 16:58:59.023570 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.023549    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.026619 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.026594    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 18 16:58:59.026619 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.026581    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 18 16:58:59.026792 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.026670    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 18 16:58:59.026792 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.026752    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ckek2ggji8h50\""
Sep 18 16:58:59.027152 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.027136    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 18 16:58:59.027152 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.027145    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 18 16:58:59.027265 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.027246    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-88kx5\""
Sep 18 16:58:59.039463 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.039428    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"]
Sep 18 16:58:59.139134 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.139113    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ad9eafc-1395-4450-b738-a0ffee85fcce-metrics-client-ca\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.139259 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.139142    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.139259 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.139162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.139259 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.139179    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-grpc-tls\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.139441 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.139279    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzjwf\" (UniqueName: \"kubernetes.io/projected/6ad9eafc-1395-4450-b738-a0ffee85fcce-kube-api-access-gzjwf\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.139441 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.139317    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.139441 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.139386    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-thanos-querier-tls\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.139441 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.139413    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.240443 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.240407    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-thanos-querier-tls\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.240443 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.240447    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.240605 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.240470    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ad9eafc-1395-4450-b738-a0ffee85fcce-metrics-client-ca\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.240605 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.240490    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.240691 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.240622    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.240691 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.240662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-grpc-tls\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.240791 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.240713    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzjwf\" (UniqueName: \"kubernetes.io/projected/6ad9eafc-1395-4450-b738-a0ffee85fcce-kube-api-access-gzjwf\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.240791 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.240742    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.241358 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.241296    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ad9eafc-1395-4450-b738-a0ffee85fcce-metrics-client-ca\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.244055 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.244025    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.244503 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.244479    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.244625 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.244530    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-grpc-tls\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.244625 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.244613    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.244720 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.244624    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.244720 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.244703    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6ad9eafc-1395-4450-b738-a0ffee85fcce-secret-thanos-querier-tls\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.250134 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.250113    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzjwf\" (UniqueName: \"kubernetes.io/projected/6ad9eafc-1395-4450-b738-a0ffee85fcce-kube-api-access-gzjwf\") pod \"thanos-querier-cfb54cf57-rk4vk\" (UID: \"6ad9eafc-1395-4450-b738-a0ffee85fcce\") " pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.333097 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.333034    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:58:59.616690 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.616662    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"]
Sep 18 16:58:59.619598 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:58:59.619574    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad9eafc_1395_4450_b738_a0ffee85fcce.slice/crio-deb2a1927b8868266e7e84fd0a7939884eae5f9fd05d87a856837cea4deca6bf WatchSource:0}: Error finding container deb2a1927b8868266e7e84fd0a7939884eae5f9fd05d87a856837cea4deca6bf: Status 404 returned error can't find the container with id deb2a1927b8868266e7e84fd0a7939884eae5f9fd05d87a856837cea4deca6bf
Sep 18 16:58:59.878616 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.878552    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:58:59.953038 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:58:59.953009    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:59:00.309803 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:00.309694    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:59:00.473963 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:00.473923    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk" event={"ID":"6ad9eafc-1395-4450-b738-a0ffee85fcce","Type":"ContainerStarted","Data":"deb2a1927b8868266e7e84fd0a7939884eae5f9fd05d87a856837cea4deca6bf"}
Sep 18 16:59:00.839573 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:00.839538    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:59:01.480886 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:01.480804    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk" event={"ID":"6ad9eafc-1395-4450-b738-a0ffee85fcce","Type":"ContainerStarted","Data":"aaaa06ef11e5402614fcce68443fb6ca2a88c951e5c058bc3f90ddcee15bd37c"}
Sep 18 16:59:01.480886 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:01.480879    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk" event={"ID":"6ad9eafc-1395-4450-b738-a0ffee85fcce","Type":"ContainerStarted","Data":"7cef3d76b031041f2b832098809c9aa28c5f00f8bd6c9ec2a5b004e93a22c17e"}
Sep 18 16:59:01.481239 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:01.480904    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk" event={"ID":"6ad9eafc-1395-4450-b738-a0ffee85fcce","Type":"ContainerStarted","Data":"0aa78fbadc6fdcc2650134225c699278f24bc3d17b1c8c96516fd55e7ecb2ce2"}
Sep 18 16:59:02.488178 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:02.488144    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk" event={"ID":"6ad9eafc-1395-4450-b738-a0ffee85fcce","Type":"ContainerStarted","Data":"430e49ae8341021941a20927e581715d66deb25c6461599fe27aa20a93e05f5d"}
Sep 18 16:59:02.488514 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:02.488205    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk" event={"ID":"6ad9eafc-1395-4450-b738-a0ffee85fcce","Type":"ContainerStarted","Data":"6d416b5986d51dffeec9695c0d1e25c97744892dec31e2cfb923fc0f92ef7b94"}
Sep 18 16:59:02.488514 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:02.488234    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk" event={"ID":"6ad9eafc-1395-4450-b738-a0ffee85fcce","Type":"ContainerStarted","Data":"4f454255f8b87e74ff5677d71f8fc32074affa24231148e6fdbf90d0e53aa13e"}
Sep 18 16:59:02.488514 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:02.488327    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:59:02.513726 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:02.513511    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk" podStartSLOduration=1.327623805 podStartE2EDuration="3.513496847s" totalImagesPullingTime="2.185873042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:58:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:59:02.512729174 +0000 UTC m=+593.238010952" watchObservedRunningTime="2026-09-18 16:59:02.513496847 +0000 UTC m=+593.238778591"
Sep 18 16:59:03.167853 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.167800    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 16:59:03.171526 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.171507    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.174113 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.174060    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 18 16:59:03.174258 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.174230    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 18 16:59:03.174258 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.174249    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-969o157g08252\""
Sep 18 16:59:03.174568 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.174546    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 18 16:59:03.174657 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.174567    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 18 16:59:03.174657 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.174586    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 18 16:59:03.174764 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.174673    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:59:03.174897 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.174881    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 18 16:59:03.175199 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.175173    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 18 16:59:03.175308 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.175175    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qcxjq\""
Sep 18 16:59:03.175409 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.175359    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 18 16:59:03.175645 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.175629    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 18 16:59:03.176469 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.176446    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 18 16:59:03.176575 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.176474    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 18 16:59:03.176787 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.176751    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 18 16:59:03.177236 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.177219    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 18 16:59:03.178558 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.178535    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 18 16:59:03.182325 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.182308    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 18 16:59:03.196282 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.196259    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 16:59:03.271049 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271024    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271138 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271050    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-web-config\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271138 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271073    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bklgn\" (UniqueName: \"kubernetes.io/projected/83ffef2c-1127-4d5b-a8fb-66a5c2510221-kube-api-access-bklgn\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271138 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271091    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271138 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271107    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83ffef2c-1127-4d5b-a8fb-66a5c2510221-config-out\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271138 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271126    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271305 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271166    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83ffef2c-1127-4d5b-a8fb-66a5c2510221-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271305 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271209    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271305 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271246    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271305 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271278    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271470 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271305    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83ffef2c-1127-4d5b-a8fb-66a5c2510221-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271470 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271325    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271470 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271378    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271470 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271397    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271470 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-config\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271470 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271454    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271652 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271472    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271652 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271487    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271652 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271513    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.271652 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.271564    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.371915 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.371890    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-config\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.371915 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.371915    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372035 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.371934    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372035 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.371952    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372035 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.371968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372035 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.371986    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372035 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.372004    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372256 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.372212    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-web-config\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372304 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.372280    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bklgn\" (UniqueName: \"kubernetes.io/projected/83ffef2c-1127-4d5b-a8fb-66a5c2510221-kube-api-access-bklgn\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372354 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.372309    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372407 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.372363    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83ffef2c-1127-4d5b-a8fb-66a5c2510221-config-out\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372407 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.372390    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372483 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.372416    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83ffef2c-1127-4d5b-a8fb-66a5c2510221-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372483 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.372452    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372592 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.372491    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372592 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.372524    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372592 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.372560    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83ffef2c-1127-4d5b-a8fb-66a5c2510221-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372592 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.372587    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372791 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.372618    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372791 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.372643    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.372791 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.372735    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.373144 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.373017    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.373144 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.373124    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.373260 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.373222    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.373604 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.373574    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.374215 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.374190    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.374395 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.374351    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/83ffef2c-1127-4d5b-a8fb-66a5c2510221-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.376062 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.375997    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.376614 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.376586    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/83ffef2c-1127-4d5b-a8fb-66a5c2510221-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.376835 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.376778    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-config\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.377139 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.377112    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/83ffef2c-1127-4d5b-a8fb-66a5c2510221-config-out\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.377954 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.377757    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/83ffef2c-1127-4d5b-a8fb-66a5c2510221-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.378287 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.378262    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.378377 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.378263    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.378787 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.378762    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.378787 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.378781    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.379310 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.379272    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.379380 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.379329    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-web-config\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.379470 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.379454    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/83ffef2c-1127-4d5b-a8fb-66a5c2510221-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.382902 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.382876    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bklgn\" (UniqueName: \"kubernetes.io/projected/83ffef2c-1127-4d5b-a8fb-66a5c2510221-kube-api-access-bklgn\") pod \"prometheus-k8s-0\" (UID: \"83ffef2c-1127-4d5b-a8fb-66a5c2510221\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.482544 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.482498    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 16:59:03.794899 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:03.794660    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 16:59:03.797453 ip-10-0-142-7 kubenswrapper[2583]: W0918 16:59:03.797423    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ffef2c_1127_4d5b_a8fb_66a5c2510221.slice/crio-b061916ea520b948f036761bd9f4a93dbe3bc6408d18c8bb2c59db2f0027a792 WatchSource:0}: Error finding container b061916ea520b948f036761bd9f4a93dbe3bc6408d18c8bb2c59db2f0027a792: Status 404 returned error can't find the container with id b061916ea520b948f036761bd9f4a93dbe3bc6408d18c8bb2c59db2f0027a792
Sep 18 16:59:04.497610 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:04.497570    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83ffef2c-1127-4d5b-a8fb-66a5c2510221","Type":"ContainerStarted","Data":"b061916ea520b948f036761bd9f4a93dbe3bc6408d18c8bb2c59db2f0027a792"}
Sep 18 16:59:05.502790 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:05.502752    2583 generic.go:356] "Generic (PLEG): container finished" podID="83ffef2c-1127-4d5b-a8fb-66a5c2510221" containerID="2e1976111d0482750da781fc685a76124bbb913eff58f52e2c06c2d7ecf231b6" exitCode=0
Sep 18 16:59:05.503283 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:05.502853    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83ffef2c-1127-4d5b-a8fb-66a5c2510221","Type":"ContainerDied","Data":"2e1976111d0482750da781fc685a76124bbb913eff58f52e2c06c2d7ecf231b6"}
Sep 18 16:59:06.571691 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:06.571649    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 16:59:08.506484 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:08.506459    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-cfb54cf57-rk4vk"
Sep 18 16:59:08.516689 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:08.516667    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83ffef2c-1127-4d5b-a8fb-66a5c2510221","Type":"ContainerStarted","Data":"536c0d5f5b99444642318fab2800b3e086ee43254a222ca8e3fad79966fd4204"}
Sep 18 16:59:08.516926 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:08.516905    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83ffef2c-1127-4d5b-a8fb-66a5c2510221","Type":"ContainerStarted","Data":"ad624bd982299fd7300cd73d454ac59dc919876e6a5374e177e7fcffc0a0ba86"}
Sep 18 16:59:08.517027 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:08.516956    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83ffef2c-1127-4d5b-a8fb-66a5c2510221","Type":"ContainerStarted","Data":"5ec2259f27e7e6d0a4343ee5b68f4840fdb886bee4f97857326a3635d1d467dd"}
Sep 18 16:59:08.517027 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:08.516999    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83ffef2c-1127-4d5b-a8fb-66a5c2510221","Type":"ContainerStarted","Data":"fb3ceba307ac54cf7bf370ea1528a4c4fed2a36347370c747eac6b51b4fa1d3f"}
Sep 18 16:59:09.524512 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:09.524475    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83ffef2c-1127-4d5b-a8fb-66a5c2510221","Type":"ContainerStarted","Data":"8a9c69411d728485c6303d83d5a87329654f43133d4b214689082491f45aea9b"}
Sep 18 16:59:09.524891 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:09.524548    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"83ffef2c-1127-4d5b-a8fb-66a5c2510221","Type":"ContainerStarted","Data":"b87d9ddfb647c29967989cfdc45b085d60ff27b9cdfcaf60f7d73711551a30f3"}
Sep 18 16:59:09.559953 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:09.559786    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.931678082 podStartE2EDuration="6.55976711s" totalImagesPullingTime="3.607227583s" totalInitContainerRuntime="20.861445ms" isStatefulPod=false podCreationTimestamp="2026-09-18 16:59:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:59:09.557274419 +0000 UTC m=+600.282556184" watchObservedRunningTime="2026-09-18 16:59:09.55976711 +0000 UTC m=+600.285048856"
Sep 18 16:59:11.391046 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:11.391021    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 16:59:11.392118 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:11.392099    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 16:59:11.393640 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:11.393622    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 16:59:11.394656 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:11.394639    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 16:59:13.483094 ip-10-0-142-7 kubenswrapper[2583]: I0918 16:59:13.483054    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 17:00:03.482964 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:03.482882    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 17:00:03.500473 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:03.500449    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 17:00:03.729447 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:03.729421    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 17:00:13.064118 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:13.064082    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:00:13.124222 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:13.124180    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:00:13.415390 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:13.415364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:00:13.487626 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:13.487602    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:00:24.239759 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:24.239716    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:00:24.347857 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:24.347831    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:00:24.406713 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:24.406677    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:00:25.098928 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:25.098896    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:00:25.196546 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:25.196520    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:00:39.946141 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:39.946111    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:00:40.043763 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:40.043733    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:00:40.112333 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:40.112312    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:00:54.941743 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:54.941668    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:00:56.408601 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:00:56.408568    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:01:05.430573 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:01:05.430535    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:01:05.527582 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:01:05.527549    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:01:05.624853 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:01:05.624807    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:01:27.232477 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:01:27.232443    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:01:27.336984 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:01:27.336954    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:01:27.433744 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:01:27.433716    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:01:43.516309 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:01:43.516277    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:01:43.576999 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:01:43.576970    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:01:59.951104 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:01:59.951066    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:02:00.050780 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:02:00.050751    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:02:06.188352 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:02:06.188303    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:02:06.495761 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:02:06.495681    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:02:06.691094 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:02:06.691063    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:02:06.798965 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:02:06.798892    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:02:07.185392 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:02:07.185359    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:02:07.460227 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:02:07.460155    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:02:07.568211 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:02:07.568176    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:02:07.691752 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:02:07.691723    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:02:07.956171 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:02:07.956143    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:02:08.280799 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:02:08.280727    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:02:08.379993 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:02:08.379965    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:02:08.502785 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:02:08.502746    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:02:58.364186 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:02:58.364100    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:02:58.434866 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:02:58.434836    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:03:23.224525 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:03:23.224491    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:03:23.310104 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:03:23.310073    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:03:27.974079 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:03:27.974044    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:03:28.071972 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:03:28.071937    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:03:28.204525 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:03:28.204495    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:03:28.277003 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:03:28.276915    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:03:28.377188 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:03:28.377148    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:03:28.738715 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:03:28.738684    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:03:28.836614 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:03:28.836584    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:03:28.907011 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:03:28.906988    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:03:50.281908 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:03:50.281805    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:03:51.599294 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:03:51.599256    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:04:11.413715 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:11.413679    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:04:11.415674 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:11.415653    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:04:11.416387 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:11.416371    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:04:11.418110 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:11.418091    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:04:32.833603 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:32.833563    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:04:32.934248 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:32.934216    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:04:45.511596 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.511560    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:04:45.557470 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.557441    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-7b966d7984-2tqhb"]
Sep 18 17:04:45.559568 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.559552    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7b966d7984-2tqhb"
Sep 18 17:04:45.562536 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.562513    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 18 17:04:45.562639 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.562587    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-f2ts7\""
Sep 18 17:04:45.563106 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.563084    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-metrics-tls\""
Sep 18 17:04:45.563206 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.563113    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Sep 18 17:04:45.563206 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.563131    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 18 17:04:45.583064 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.583036    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7b966d7984-2tqhb"]
Sep 18 17:04:45.612989 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.612961    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:04:45.631097 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.631074    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d291e285-b41a-485f-8ca4-7a9e2bd354ce-metrics-certs\") pod \"odh-model-controller-7b966d7984-2tqhb\" (UID: \"d291e285-b41a-485f-8ca4-7a9e2bd354ce\") " pod="kserve/odh-model-controller-7b966d7984-2tqhb"
Sep 18 17:04:45.631184 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.631099    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6vm8\" (UniqueName: \"kubernetes.io/projected/d291e285-b41a-485f-8ca4-7a9e2bd354ce-kube-api-access-w6vm8\") pod \"odh-model-controller-7b966d7984-2tqhb\" (UID: \"d291e285-b41a-485f-8ca4-7a9e2bd354ce\") " pod="kserve/odh-model-controller-7b966d7984-2tqhb"
Sep 18 17:04:45.631184 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.631126    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d291e285-b41a-485f-8ca4-7a9e2bd354ce-cert\") pod \"odh-model-controller-7b966d7984-2tqhb\" (UID: \"d291e285-b41a-485f-8ca4-7a9e2bd354ce\") " pod="kserve/odh-model-controller-7b966d7984-2tqhb"
Sep 18 17:04:45.707915 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.707887    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:04:45.732234 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.732205    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d291e285-b41a-485f-8ca4-7a9e2bd354ce-metrics-certs\") pod \"odh-model-controller-7b966d7984-2tqhb\" (UID: \"d291e285-b41a-485f-8ca4-7a9e2bd354ce\") " pod="kserve/odh-model-controller-7b966d7984-2tqhb"
Sep 18 17:04:45.732343 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.732239    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6vm8\" (UniqueName: \"kubernetes.io/projected/d291e285-b41a-485f-8ca4-7a9e2bd354ce-kube-api-access-w6vm8\") pod \"odh-model-controller-7b966d7984-2tqhb\" (UID: \"d291e285-b41a-485f-8ca4-7a9e2bd354ce\") " pod="kserve/odh-model-controller-7b966d7984-2tqhb"
Sep 18 17:04:45.732343 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.732277    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d291e285-b41a-485f-8ca4-7a9e2bd354ce-cert\") pod \"odh-model-controller-7b966d7984-2tqhb\" (UID: \"d291e285-b41a-485f-8ca4-7a9e2bd354ce\") " pod="kserve/odh-model-controller-7b966d7984-2tqhb"
Sep 18 17:04:45.732343 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:04:45.732334    2583 secret.go:189] Couldn't get secret kserve/odh-model-controller-metrics-tls: secret "odh-model-controller-metrics-tls" not found
Sep 18 17:04:45.732503 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:04:45.732389    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d291e285-b41a-485f-8ca4-7a9e2bd354ce-metrics-certs podName:d291e285-b41a-485f-8ca4-7a9e2bd354ce nodeName:}" failed. No retries permitted until 2026-09-18 17:04:46.232374776 +0000 UTC m=+936.957656500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d291e285-b41a-485f-8ca4-7a9e2bd354ce-metrics-certs") pod "odh-model-controller-7b966d7984-2tqhb" (UID: "d291e285-b41a-485f-8ca4-7a9e2bd354ce") : secret "odh-model-controller-metrics-tls" not found
Sep 18 17:04:45.734793 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.734773    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d291e285-b41a-485f-8ca4-7a9e2bd354ce-cert\") pod \"odh-model-controller-7b966d7984-2tqhb\" (UID: \"d291e285-b41a-485f-8ca4-7a9e2bd354ce\") " pod="kserve/odh-model-controller-7b966d7984-2tqhb"
Sep 18 17:04:45.744252 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.744233    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6vm8\" (UniqueName: \"kubernetes.io/projected/d291e285-b41a-485f-8ca4-7a9e2bd354ce-kube-api-access-w6vm8\") pod \"odh-model-controller-7b966d7984-2tqhb\" (UID: \"d291e285-b41a-485f-8ca4-7a9e2bd354ce\") " pod="kserve/odh-model-controller-7b966d7984-2tqhb"
Sep 18 17:04:45.807141 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:45.807083    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:04:46.042916 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:46.042887    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:04:46.236764 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:46.236731    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d291e285-b41a-485f-8ca4-7a9e2bd354ce-metrics-certs\") pod \"odh-model-controller-7b966d7984-2tqhb\" (UID: \"d291e285-b41a-485f-8ca4-7a9e2bd354ce\") " pod="kserve/odh-model-controller-7b966d7984-2tqhb"
Sep 18 17:04:46.239344 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:46.239313    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d291e285-b41a-485f-8ca4-7a9e2bd354ce-metrics-certs\") pod \"odh-model-controller-7b966d7984-2tqhb\" (UID: \"d291e285-b41a-485f-8ca4-7a9e2bd354ce\") " pod="kserve/odh-model-controller-7b966d7984-2tqhb"
Sep 18 17:04:46.469219 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:46.469191    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7b966d7984-2tqhb"
Sep 18 17:04:46.742360 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:46.742329    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7b966d7984-2tqhb"]
Sep 18 17:04:46.744980 ip-10-0-142-7 kubenswrapper[2583]: W0918 17:04:46.744938    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd291e285_b41a_485f_8ca4_7a9e2bd354ce.slice/crio-6935c9f2b5e9bb4fce8e7881d6e682ec5fd30eec87a3125253d124a79d064ddd WatchSource:0}: Error finding container 6935c9f2b5e9bb4fce8e7881d6e682ec5fd30eec87a3125253d124a79d064ddd: Status 404 returned error can't find the container with id 6935c9f2b5e9bb4fce8e7881d6e682ec5fd30eec87a3125253d124a79d064ddd
Sep 18 17:04:46.746325 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:46.746304    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 17:04:46.777481 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:46.777417    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7b966d7984-2tqhb" event={"ID":"d291e285-b41a-485f-8ca4-7a9e2bd354ce","Type":"ContainerStarted","Data":"6935c9f2b5e9bb4fce8e7881d6e682ec5fd30eec87a3125253d124a79d064ddd"}
Sep 18 17:04:46.801639 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:46.801619    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:04:46.902144 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:46.902123    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:04:49.789931 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:49.789897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7b966d7984-2tqhb" event={"ID":"d291e285-b41a-485f-8ca4-7a9e2bd354ce","Type":"ContainerStarted","Data":"c736524c90c288a40e281521dc53597228de678fbe8f44c72144242d7481384c"}
Sep 18 17:04:49.790327 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:49.790032    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-7b966d7984-2tqhb"
Sep 18 17:04:49.825697 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:04:49.825651    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-7b966d7984-2tqhb" podStartSLOduration=2.577669998 podStartE2EDuration="4.825639821s" totalImagesPullingTime="2.247969823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:04:49.823039328 +0000 UTC m=+940.548321074" watchObservedRunningTime="2026-09-18 17:04:49.825639821 +0000 UTC m=+940.550921566"
Sep 18 17:05:00.796449 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:00.796419    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-7b966d7984-2tqhb"
Sep 18 17:05:01.602601 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:01.602565    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-m465s"]
Sep 18 17:05:01.605833 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:01.605790    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-m465s"
Sep 18 17:05:01.608128 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:01.608101    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\""
Sep 18 17:05:01.608306 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:01.608135    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-fkg7n\""
Sep 18 17:05:01.608306 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:01.608170    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Sep 18 17:05:01.613091 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:01.613063    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-m465s"]
Sep 18 17:05:01.744163 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:01.744132    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsmsj\" (UniqueName: \"kubernetes.io/projected/328f4fbd-63c9-412b-aa32-a65caa13fb1e-kube-api-access-fsmsj\") pod \"s3-init-m465s\" (UID: \"328f4fbd-63c9-412b-aa32-a65caa13fb1e\") " pod="kserve/s3-init-m465s"
Sep 18 17:05:01.744330 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:01.744174    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/328f4fbd-63c9-412b-aa32-a65caa13fb1e-model-cache\") pod \"s3-init-m465s\" (UID: \"328f4fbd-63c9-412b-aa32-a65caa13fb1e\") " pod="kserve/s3-init-m465s"
Sep 18 17:05:01.845422 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:01.845396    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsmsj\" (UniqueName: \"kubernetes.io/projected/328f4fbd-63c9-412b-aa32-a65caa13fb1e-kube-api-access-fsmsj\") pod \"s3-init-m465s\" (UID: \"328f4fbd-63c9-412b-aa32-a65caa13fb1e\") " pod="kserve/s3-init-m465s"
Sep 18 17:05:01.845734 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:01.845432    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/328f4fbd-63c9-412b-aa32-a65caa13fb1e-model-cache\") pod \"s3-init-m465s\" (UID: \"328f4fbd-63c9-412b-aa32-a65caa13fb1e\") " pod="kserve/s3-init-m465s"
Sep 18 17:05:01.845778 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:01.845744    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/328f4fbd-63c9-412b-aa32-a65caa13fb1e-model-cache\") pod \"s3-init-m465s\" (UID: \"328f4fbd-63c9-412b-aa32-a65caa13fb1e\") " pod="kserve/s3-init-m465s"
Sep 18 17:05:01.854768 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:01.854718    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsmsj\" (UniqueName: \"kubernetes.io/projected/328f4fbd-63c9-412b-aa32-a65caa13fb1e-kube-api-access-fsmsj\") pod \"s3-init-m465s\" (UID: \"328f4fbd-63c9-412b-aa32-a65caa13fb1e\") " pod="kserve/s3-init-m465s"
Sep 18 17:05:01.923618 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:01.923596    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-m465s"
Sep 18 17:05:02.193686 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:02.193662    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-m465s"]
Sep 18 17:05:02.197360 ip-10-0-142-7 kubenswrapper[2583]: W0918 17:05:02.197333    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod328f4fbd_63c9_412b_aa32_a65caa13fb1e.slice/crio-6750ca00ff7d2cdb48d0c5eada64b8f2b612303d3ce5f3fcb87cf9f7adae5859 WatchSource:0}: Error finding container 6750ca00ff7d2cdb48d0c5eada64b8f2b612303d3ce5f3fcb87cf9f7adae5859: Status 404 returned error can't find the container with id 6750ca00ff7d2cdb48d0c5eada64b8f2b612303d3ce5f3fcb87cf9f7adae5859
Sep 18 17:05:02.841493 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:02.841447    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-m465s" event={"ID":"328f4fbd-63c9-412b-aa32-a65caa13fb1e","Type":"ContainerStarted","Data":"6750ca00ff7d2cdb48d0c5eada64b8f2b612303d3ce5f3fcb87cf9f7adae5859"}
Sep 18 17:05:05.853202 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:05.853171    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-m465s" event={"ID":"328f4fbd-63c9-412b-aa32-a65caa13fb1e","Type":"ContainerStarted","Data":"257123f9a2d73f00df445a90c57a42f378f72f16488a852c3386517a6f2eec97"}
Sep 18 17:05:07.862992 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:07.862921    2583 generic.go:356] "Generic (PLEG): container finished" podID="328f4fbd-63c9-412b-aa32-a65caa13fb1e" containerID="257123f9a2d73f00df445a90c57a42f378f72f16488a852c3386517a6f2eec97" exitCode=0
Sep 18 17:05:07.863339 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:07.862997    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-m465s" event={"ID":"328f4fbd-63c9-412b-aa32-a65caa13fb1e","Type":"ContainerDied","Data":"257123f9a2d73f00df445a90c57a42f378f72f16488a852c3386517a6f2eec97"}
Sep 18 17:05:07.945525 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:07.945486    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:05:12.299069 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:12.299049    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Sep 18 17:05:12.888025 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:12.887989    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-m465s" event={"ID":"328f4fbd-63c9-412b-aa32-a65caa13fb1e","Type":"ContainerStarted","Data":"663f83e8af6ec734af49247f89069182c666153b34ac4bcdbba6d0b829902caa"}
Sep 18 17:05:12.921279 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:12.921234    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-m465s" podStartSLOduration=2.291847221 podStartE2EDuration="11.9212187s" totalImagesPullingTime="7.845222596s" totalInitContainerRuntime="1.784148883s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:05:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:05:12.920802306 +0000 UTC m=+963.646084053" watchObservedRunningTime="2026-09-18 17:05:12.9212187 +0000 UTC m=+963.646500445"
Sep 18 17:05:21.576311 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:05:21.576232    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:06:18.141955 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:18.141912    2583 generic.go:356] "Generic (PLEG): container finished" podID="328f4fbd-63c9-412b-aa32-a65caa13fb1e" containerID="663f83e8af6ec734af49247f89069182c666153b34ac4bcdbba6d0b829902caa" exitCode=0
Sep 18 17:06:18.142415 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:18.141990    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-m465s" event={"ID":"328f4fbd-63c9-412b-aa32-a65caa13fb1e","Type":"ContainerDied","Data":"663f83e8af6ec734af49247f89069182c666153b34ac4bcdbba6d0b829902caa"}
Sep 18 17:06:19.278952 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:19.278930    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-m465s"
Sep 18 17:06:19.413177 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:19.413115    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsmsj\" (UniqueName: \"kubernetes.io/projected/328f4fbd-63c9-412b-aa32-a65caa13fb1e-kube-api-access-fsmsj\") pod \"328f4fbd-63c9-412b-aa32-a65caa13fb1e\" (UID: \"328f4fbd-63c9-412b-aa32-a65caa13fb1e\") "
Sep 18 17:06:19.413177 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:19.413176    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/328f4fbd-63c9-412b-aa32-a65caa13fb1e-model-cache\") pod \"328f4fbd-63c9-412b-aa32-a65caa13fb1e\" (UID: \"328f4fbd-63c9-412b-aa32-a65caa13fb1e\") "
Sep 18 17:06:19.415493 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:19.415468    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/328f4fbd-63c9-412b-aa32-a65caa13fb1e-kube-api-access-fsmsj" (OuterVolumeSpecName: "kube-api-access-fsmsj") pod "328f4fbd-63c9-412b-aa32-a65caa13fb1e" (UID: "328f4fbd-63c9-412b-aa32-a65caa13fb1e"). InnerVolumeSpecName "kube-api-access-fsmsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:06:19.432479 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:19.432447    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/328f4fbd-63c9-412b-aa32-a65caa13fb1e-model-cache" (OuterVolumeSpecName: "model-cache") pod "328f4fbd-63c9-412b-aa32-a65caa13fb1e" (UID: "328f4fbd-63c9-412b-aa32-a65caa13fb1e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:06:19.514388 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:19.514366    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/328f4fbd-63c9-412b-aa32-a65caa13fb1e-model-cache\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:06:19.514388 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:19.514387    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsmsj\" (UniqueName: \"kubernetes.io/projected/328f4fbd-63c9-412b-aa32-a65caa13fb1e-kube-api-access-fsmsj\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:06:20.151866 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:20.151842    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-m465s"
Sep 18 17:06:20.152017 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:20.151838    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-m465s" event={"ID":"328f4fbd-63c9-412b-aa32-a65caa13fb1e","Type":"ContainerDied","Data":"6750ca00ff7d2cdb48d0c5eada64b8f2b612303d3ce5f3fcb87cf9f7adae5859"}
Sep 18 17:06:20.152017 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:20.151956    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6750ca00ff7d2cdb48d0c5eada64b8f2b612303d3ce5f3fcb87cf9f7adae5859"
Sep 18 17:06:20.528615 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:20.528537    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:06:21.834236 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:21.834204    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:06:32.586006 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:32.585944    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:06:32.693899 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:32.693868    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:06:32.794005 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:32.793972    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:06:33.008542 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.008517    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:06:33.048389 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.048364    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"]
Sep 18 17:06:33.048657 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.048646    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="328f4fbd-63c9-412b-aa32-a65caa13fb1e" containerName="s3-init"
Sep 18 17:06:33.048708 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.048662    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="328f4fbd-63c9-412b-aa32-a65caa13fb1e" containerName="s3-init"
Sep 18 17:06:33.048708 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.048680    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="328f4fbd-63c9-412b-aa32-a65caa13fb1e" containerName="download-hf-model"
Sep 18 17:06:33.048708 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.048686    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="328f4fbd-63c9-412b-aa32-a65caa13fb1e" containerName="download-hf-model"
Sep 18 17:06:33.048805 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.048737    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="328f4fbd-63c9-412b-aa32-a65caa13fb1e" containerName="s3-init"
Sep 18 17:06:33.051470 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.051456    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.054932 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.054907    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\""
Sep 18 17:06:33.054932 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.054908    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\""
Sep 18 17:06:33.055154 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.055123    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 18 17:06:33.055273 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.055202    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-97cfm\""
Sep 18 17:06:33.055273 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.055259    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 18 17:06:33.055580 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.055562    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 18 17:06:33.055715 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.055700    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 18 17:06:33.066675 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.066657    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"]
Sep 18 17:06:33.111496 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.111475    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a194a4cd-c62b-4407-b1df-5e197e33ff49-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-kf9x5\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.111606 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.111511    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znw6w\" (UniqueName: \"kubernetes.io/projected/a194a4cd-c62b-4407-b1df-5e197e33ff49-kube-api-access-znw6w\") pod \"isvc-xgboost-graph-predictor-555fc69d56-kf9x5\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.111606 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.111533    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a194a4cd-c62b-4407-b1df-5e197e33ff49-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-kf9x5\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.111606 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.111590    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a194a4cd-c62b-4407-b1df-5e197e33ff49-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-kf9x5\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.111718 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.111642    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a194a4cd-c62b-4407-b1df-5e197e33ff49-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-kf9x5\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.176540 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.176518    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:06:33.212911 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.212882    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a194a4cd-c62b-4407-b1df-5e197e33ff49-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-kf9x5\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.213014 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.212924    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a194a4cd-c62b-4407-b1df-5e197e33ff49-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-kf9x5\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.213014 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.212963    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a194a4cd-c62b-4407-b1df-5e197e33ff49-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-kf9x5\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.213014 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.213008    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znw6w\" (UniqueName: \"kubernetes.io/projected/a194a4cd-c62b-4407-b1df-5e197e33ff49-kube-api-access-znw6w\") pod \"isvc-xgboost-graph-predictor-555fc69d56-kf9x5\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.213178 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.213038    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a194a4cd-c62b-4407-b1df-5e197e33ff49-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-kf9x5\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.213178 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:06:33.213039    2583 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-graph-predictor-serving-cert: secret "isvc-xgboost-graph-predictor-serving-cert" not found
Sep 18 17:06:33.213178 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:06:33.213117    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a194a4cd-c62b-4407-b1df-5e197e33ff49-proxy-tls podName:a194a4cd-c62b-4407-b1df-5e197e33ff49 nodeName:}" failed. No retries permitted until 2026-09-18 17:06:33.713097827 +0000 UTC m=+1044.438379551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a194a4cd-c62b-4407-b1df-5e197e33ff49-proxy-tls") pod "isvc-xgboost-graph-predictor-555fc69d56-kf9x5" (UID: "a194a4cd-c62b-4407-b1df-5e197e33ff49") : secret "isvc-xgboost-graph-predictor-serving-cert" not found
Sep 18 17:06:33.213411 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.213391    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a194a4cd-c62b-4407-b1df-5e197e33ff49-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-kf9x5\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.213558 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.213541    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a194a4cd-c62b-4407-b1df-5e197e33ff49-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-kf9x5\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.213606 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.213592    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a194a4cd-c62b-4407-b1df-5e197e33ff49-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-kf9x5\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.226223 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.226196    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znw6w\" (UniqueName: \"kubernetes.io/projected/a194a4cd-c62b-4407-b1df-5e197e33ff49-kube-api-access-znw6w\") pod \"isvc-xgboost-graph-predictor-555fc69d56-kf9x5\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.298926 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.298869    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:06:33.389119 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.389089    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:06:33.389833 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.389788    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"]
Sep 18 17:06:33.393260 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.393245    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.395372 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.395355    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\""
Sep 18 17:06:33.395584 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.395571    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\""
Sep 18 17:06:33.406746 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.406726    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"]
Sep 18 17:06:33.514489 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.514460    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.514596 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.514492    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.514596 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.514513    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.514596 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.514534    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.514596 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.514561    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j246\" (UniqueName: \"kubernetes.io/projected/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kube-api-access-2j246\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.615207 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.615181    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.615574 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.615214    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.615574 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.615233    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.615574 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.615249    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.615574 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.615264    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j246\" (UniqueName: \"kubernetes.io/projected/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kube-api-access-2j246\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.615737 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.615641    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.615933 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.615916    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.615984 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.615934    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.617850 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.617800    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.619915 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.619891    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:06:33.624695 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.624676    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j246\" (UniqueName: \"kubernetes.io/projected/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kube-api-access-2j246\") pod \"isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.703710 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.703692    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:06:33.716200 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.716178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a194a4cd-c62b-4407-b1df-5e197e33ff49-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-kf9x5\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.718478 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.718449    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a194a4cd-c62b-4407-b1df-5e197e33ff49-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-kf9x5\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.829999 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.829969    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:06:33.961897 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.961837    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:06:33.979264 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:33.979237    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"]
Sep 18 17:06:33.981182 ip-10-0-142-7 kubenswrapper[2583]: W0918 17:06:33.981160    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d20160_2ce6_4e04_bc0a_16e4fb4e0fea.slice/crio-cf17206c0bbbcd62f4473bba7bf06d40d12a669665e5ae95d28ee1cfe84a3145 WatchSource:0}: Error finding container cf17206c0bbbcd62f4473bba7bf06d40d12a669665e5ae95d28ee1cfe84a3145: Status 404 returned error can't find the container with id cf17206c0bbbcd62f4473bba7bf06d40d12a669665e5ae95d28ee1cfe84a3145
Sep 18 17:06:34.101229 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:34.101202    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:06:34.204629 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:34.204603    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" event={"ID":"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea","Type":"ContainerStarted","Data":"761ecc00e1d1435010a13b27eff889fb9abaef23adaa60747406dddc03585fe6"}
Sep 18 17:06:34.204730 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:34.204653    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" event={"ID":"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea","Type":"ContainerStarted","Data":"cf17206c0bbbcd62f4473bba7bf06d40d12a669665e5ae95d28ee1cfe84a3145"}
Sep 18 17:06:34.238577 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:34.238556    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"]
Sep 18 17:06:34.240833 ip-10-0-142-7 kubenswrapper[2583]: W0918 17:06:34.240790    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda194a4cd_c62b_4407_b1df_5e197e33ff49.slice/crio-a5d320e003cb95bc96596901788639b0a09502601a76b9209dbe9408e07c7094 WatchSource:0}: Error finding container a5d320e003cb95bc96596901788639b0a09502601a76b9209dbe9408e07c7094: Status 404 returned error can't find the container with id a5d320e003cb95bc96596901788639b0a09502601a76b9209dbe9408e07c7094
Sep 18 17:06:35.210527 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:35.210488    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" event={"ID":"a194a4cd-c62b-4407-b1df-5e197e33ff49","Type":"ContainerStarted","Data":"7240ceac762e56ad7143d1bbb95d43e4345f6fec42f77faf2541ac29d218171c"}
Sep 18 17:06:35.211022 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:35.210587    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" event={"ID":"a194a4cd-c62b-4407-b1df-5e197e33ff49","Type":"ContainerStarted","Data":"a5d320e003cb95bc96596901788639b0a09502601a76b9209dbe9408e07c7094"}
Sep 18 17:06:38.222292 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:38.222262    2583 generic.go:356] "Generic (PLEG): container finished" podID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerID="7240ceac762e56ad7143d1bbb95d43e4345f6fec42f77faf2541ac29d218171c" exitCode=0
Sep 18 17:06:38.222626 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:38.222336    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" event={"ID":"a194a4cd-c62b-4407-b1df-5e197e33ff49","Type":"ContainerDied","Data":"7240ceac762e56ad7143d1bbb95d43e4345f6fec42f77faf2541ac29d218171c"}
Sep 18 17:06:38.223908 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:38.223884    2583 generic.go:356] "Generic (PLEG): container finished" podID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerID="761ecc00e1d1435010a13b27eff889fb9abaef23adaa60747406dddc03585fe6" exitCode=0
Sep 18 17:06:38.223989 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:06:38.223932    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" event={"ID":"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea","Type":"ContainerDied","Data":"761ecc00e1d1435010a13b27eff889fb9abaef23adaa60747406dddc03585fe6"}
Sep 18 17:07:04.365322 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:04.365295    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" event={"ID":"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea","Type":"ContainerStarted","Data":"c0042075e8d49169c95856b2cc52929dcbef60989ddc785799d285993fdfc96c"}
Sep 18 17:07:05.378084 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:05.377993    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" event={"ID":"a194a4cd-c62b-4407-b1df-5e197e33ff49","Type":"ContainerStarted","Data":"b948ec8ef5e2dfa64d97065cc6b92ff788d20a9bd69808d7f5f15a9a952cdad6"}
Sep 18 17:07:07.388482 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:07.388445    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" event={"ID":"a194a4cd-c62b-4407-b1df-5e197e33ff49","Type":"ContainerStarted","Data":"443db98204a60cc3895a01b7f5985d686ea25500ede9b8c13c66a6cdd49bbe7b"}
Sep 18 17:07:07.388949 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:07.388560    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:07:07.390570 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:07.390550    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" event={"ID":"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea","Type":"ContainerStarted","Data":"8e0b459ca5a6f0b6bfff69a217e23c37a0e3efa8c6e24763d0feb0c9ceb036d2"}
Sep 18 17:07:07.390761 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:07.390748    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:07:07.411072 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:07.411009    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" podStartSLOduration=2.125642778 podStartE2EDuration="34.410997396s" totalImagesPullingTime="28.611959544s" totalInitContainerRuntime="3.673395074s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:06:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:07:07.409878865 +0000 UTC m=+1078.135160611" watchObservedRunningTime="2026-09-18 17:07:07.410997396 +0000 UTC m=+1078.136279141"
Sep 18 17:07:07.431944 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:07.431902    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" podStartSLOduration=2.070692047 podStartE2EDuration="34.431891559s" totalImagesPullingTime="28.590298098s" totalInitContainerRuntime="3.770901414s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:06:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:07:07.430463497 +0000 UTC m=+1078.155745243" watchObservedRunningTime="2026-09-18 17:07:07.431891559 +0000 UTC m=+1078.157173304"
Sep 18 17:07:08.394873 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:08.394839    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:07:08.395334 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:08.394899    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:07:08.395963 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:08.395934    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.16:8080: connect: connection refused"
Sep 18 17:07:08.396055 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:08.395960    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 18 17:07:09.403485 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:09.403430    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.16:8080: connect: connection refused"
Sep 18 17:07:09.403961 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:09.403431    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 18 17:07:14.407644 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:14.407612    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:07:14.408746 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:14.408720    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:07:14.408746 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:14.408724    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 18 17:07:14.409517 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:14.409477    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.16:8080: connect: connection refused"
Sep 18 17:07:24.408863 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:24.408800    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 18 17:07:24.409237 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:24.409097    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.16:8080: connect: connection refused"
Sep 18 17:07:34.408907 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:34.408849    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 18 17:07:34.409582 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:34.409555    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.16:8080: connect: connection refused"
Sep 18 17:07:44.409296 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:44.409254    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 18 17:07:44.409296 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:44.409268    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.16:8080: connect: connection refused"
Sep 18 17:07:47.006769 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:47.006735    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:07:47.083184 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:47.083153    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:07:54.408523 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:54.408486    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 18 17:07:54.409692 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:07:54.409666    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.16:8080: connect: connection refused"
Sep 18 17:08:04.409000 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:04.408958    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 18 17:08:04.409717 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:04.409102    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.16:8080: connect: connection refused"
Sep 18 17:08:12.639239 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:12.639195    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:12.828741 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:12.828687    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:14.409211 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:14.409165    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 18 17:08:14.409682 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:14.409667    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:08:23.639247 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:23.639163    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:23.905599 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:23.905528    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:24.014191 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:24.014145    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:24.132526 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:24.132487    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:24.262785 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:24.262715    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:24.363143 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:24.363113    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:24.409593 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:24.409573    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:08:42.592785 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:42.592751    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:43.150990 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:43.150956    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:54.119247 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.119214    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:54.281668 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.281634    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"]
Sep 18 17:08:54.281997 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.281940    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kserve-container" containerID="cri-o://c0042075e8d49169c95856b2cc52929dcbef60989ddc785799d285993fdfc96c" gracePeriod=30
Sep 18 17:08:54.281997 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.281973    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kube-rbac-proxy" containerID="cri-o://8e0b459ca5a6f0b6bfff69a217e23c37a0e3efa8c6e24763d0feb0c9ceb036d2" gracePeriod=30
Sep 18 17:08:54.310783 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.310753    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:54.404100 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.404062    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.17:8643/healthz\": dial tcp 10.133.0.17:8643: connect: connection refused"
Sep 18 17:08:54.409310 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.409282    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 18 17:08:54.421507 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.421451    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:54.422882 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.422860    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"]
Sep 18 17:08:54.423110 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.423091    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="kserve-container" containerID="cri-o://b948ec8ef5e2dfa64d97065cc6b92ff788d20a9bd69808d7f5f15a9a952cdad6" gracePeriod=30
Sep 18 17:08:54.423175 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.423097    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="kube-rbac-proxy" containerID="cri-o://443db98204a60cc3895a01b7f5985d686ea25500ede9b8c13c66a6cdd49bbe7b" gracePeriod=30
Sep 18 17:08:54.524432 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.524402    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:54.648346 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.648309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:54.735681 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.735609    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:54.813993 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.813964    2583 generic.go:356] "Generic (PLEG): container finished" podID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerID="443db98204a60cc3895a01b7f5985d686ea25500ede9b8c13c66a6cdd49bbe7b" exitCode=2
Sep 18 17:08:54.814107 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.814038    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" event={"ID":"a194a4cd-c62b-4407-b1df-5e197e33ff49","Type":"ContainerDied","Data":"443db98204a60cc3895a01b7f5985d686ea25500ede9b8c13c66a6cdd49bbe7b"}
Sep 18 17:08:54.816184 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.816163    2583 generic.go:356] "Generic (PLEG): container finished" podID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerID="8e0b459ca5a6f0b6bfff69a217e23c37a0e3efa8c6e24763d0feb0c9ceb036d2" exitCode=2
Sep 18 17:08:54.816301 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:54.816195    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" event={"ID":"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea","Type":"ContainerDied","Data":"8e0b459ca5a6f0b6bfff69a217e23c37a0e3efa8c6e24763d0feb0c9ceb036d2"}
Sep 18 17:08:55.181246 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:55.181219    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:08:58.158533 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.158506    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:08:58.208114 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.208060    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znw6w\" (UniqueName: \"kubernetes.io/projected/a194a4cd-c62b-4407-b1df-5e197e33ff49-kube-api-access-znw6w\") pod \"a194a4cd-c62b-4407-b1df-5e197e33ff49\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") "
Sep 18 17:08:58.208114 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.208094    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a194a4cd-c62b-4407-b1df-5e197e33ff49-kube-rbac-proxy-sar-config\") pod \"a194a4cd-c62b-4407-b1df-5e197e33ff49\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") "
Sep 18 17:08:58.208302 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.208152    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a194a4cd-c62b-4407-b1df-5e197e33ff49-cabundle-cert\") pod \"a194a4cd-c62b-4407-b1df-5e197e33ff49\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") "
Sep 18 17:08:58.208302 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.208191    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a194a4cd-c62b-4407-b1df-5e197e33ff49-proxy-tls\") pod \"a194a4cd-c62b-4407-b1df-5e197e33ff49\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") "
Sep 18 17:08:58.208302 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.208208    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a194a4cd-c62b-4407-b1df-5e197e33ff49-kserve-provision-location\") pod \"a194a4cd-c62b-4407-b1df-5e197e33ff49\" (UID: \"a194a4cd-c62b-4407-b1df-5e197e33ff49\") "
Sep 18 17:08:58.208595 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.208501    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a194a4cd-c62b-4407-b1df-5e197e33ff49-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "a194a4cd-c62b-4407-b1df-5e197e33ff49" (UID: "a194a4cd-c62b-4407-b1df-5e197e33ff49"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:08:58.208702 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.208599    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a194a4cd-c62b-4407-b1df-5e197e33ff49-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "a194a4cd-c62b-4407-b1df-5e197e33ff49" (UID: "a194a4cd-c62b-4407-b1df-5e197e33ff49"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:08:58.208702 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.208628    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a194a4cd-c62b-4407-b1df-5e197e33ff49-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "a194a4cd-c62b-4407-b1df-5e197e33ff49" (UID: "a194a4cd-c62b-4407-b1df-5e197e33ff49"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:08:58.210479 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.210457    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a194a4cd-c62b-4407-b1df-5e197e33ff49-kube-api-access-znw6w" (OuterVolumeSpecName: "kube-api-access-znw6w") pod "a194a4cd-c62b-4407-b1df-5e197e33ff49" (UID: "a194a4cd-c62b-4407-b1df-5e197e33ff49"). InnerVolumeSpecName "kube-api-access-znw6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:08:58.210479 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.210472    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a194a4cd-c62b-4407-b1df-5e197e33ff49-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a194a4cd-c62b-4407-b1df-5e197e33ff49" (UID: "a194a4cd-c62b-4407-b1df-5e197e33ff49"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:08:58.308929 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.308905    2583 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a194a4cd-c62b-4407-b1df-5e197e33ff49-cabundle-cert\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:08:58.308929 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.308925    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a194a4cd-c62b-4407-b1df-5e197e33ff49-proxy-tls\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:08:58.309058 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.308935    2583 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a194a4cd-c62b-4407-b1df-5e197e33ff49-kserve-provision-location\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:08:58.309058 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.308944    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znw6w\" (UniqueName: \"kubernetes.io/projected/a194a4cd-c62b-4407-b1df-5e197e33ff49-kube-api-access-znw6w\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:08:58.309058 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.308953    2583 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a194a4cd-c62b-4407-b1df-5e197e33ff49-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:08:58.721932 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.721858    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:08:58.814042 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.813984    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kserve-provision-location\") pod \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") "
Sep 18 17:08:58.814042 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.814018    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-proxy-tls\") pod \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") "
Sep 18 17:08:58.814215 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.814080    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kube-rbac-proxy-sar-config\") pod \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") "
Sep 18 17:08:58.814215 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.814115    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j246\" (UniqueName: \"kubernetes.io/projected/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kube-api-access-2j246\") pod \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") "
Sep 18 17:08:58.814215 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.814175    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-cabundle-cert\") pod \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\" (UID: \"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea\") "
Sep 18 17:08:58.814381 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.814278    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" (UID: "32d20160-2ce6-4e04-bc0a-16e4fb4e0fea"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:08:58.814438 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.814391    2583 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kserve-provision-location\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:08:58.814520 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.814493    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" (UID: "32d20160-2ce6-4e04-bc0a-16e4fb4e0fea"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:08:58.814609 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.814552    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" (UID: "32d20160-2ce6-4e04-bc0a-16e4fb4e0fea"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:08:58.816251 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.816228    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" (UID: "32d20160-2ce6-4e04-bc0a-16e4fb4e0fea"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:08:58.816320 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.816284    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kube-api-access-2j246" (OuterVolumeSpecName: "kube-api-access-2j246") pod "32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" (UID: "32d20160-2ce6-4e04-bc0a-16e4fb4e0fea"). InnerVolumeSpecName "kube-api-access-2j246". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:08:58.833906 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.833889    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"
Sep 18 17:08:58.833906 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.833885    2583 generic.go:356] "Generic (PLEG): container finished" podID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerID="c0042075e8d49169c95856b2cc52929dcbef60989ddc785799d285993fdfc96c" exitCode=0
Sep 18 17:08:58.834096 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.833986    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" event={"ID":"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea","Type":"ContainerDied","Data":"c0042075e8d49169c95856b2cc52929dcbef60989ddc785799d285993fdfc96c"}
Sep 18 17:08:58.834096 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.834036    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl" event={"ID":"32d20160-2ce6-4e04-bc0a-16e4fb4e0fea","Type":"ContainerDied","Data":"cf17206c0bbbcd62f4473bba7bf06d40d12a669665e5ae95d28ee1cfe84a3145"}
Sep 18 17:08:58.834096 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.834067    2583 scope.go:117] "RemoveContainer" containerID="8e0b459ca5a6f0b6bfff69a217e23c37a0e3efa8c6e24763d0feb0c9ceb036d2"
Sep 18 17:08:58.836026 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.835996    2583 generic.go:356] "Generic (PLEG): container finished" podID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerID="b948ec8ef5e2dfa64d97065cc6b92ff788d20a9bd69808d7f5f15a9a952cdad6" exitCode=0
Sep 18 17:08:58.836130 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.836032    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" event={"ID":"a194a4cd-c62b-4407-b1df-5e197e33ff49","Type":"ContainerDied","Data":"b948ec8ef5e2dfa64d97065cc6b92ff788d20a9bd69808d7f5f15a9a952cdad6"}
Sep 18 17:08:58.836130 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.836091    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5" event={"ID":"a194a4cd-c62b-4407-b1df-5e197e33ff49","Type":"ContainerDied","Data":"a5d320e003cb95bc96596901788639b0a09502601a76b9209dbe9408e07c7094"}
Sep 18 17:08:58.836130 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.836098    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"
Sep 18 17:08:58.843076 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.843057    2583 scope.go:117] "RemoveContainer" containerID="c0042075e8d49169c95856b2cc52929dcbef60989ddc785799d285993fdfc96c"
Sep 18 17:08:58.850408 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.850392    2583 scope.go:117] "RemoveContainer" containerID="761ecc00e1d1435010a13b27eff889fb9abaef23adaa60747406dddc03585fe6"
Sep 18 17:08:58.857148 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.857134    2583 scope.go:117] "RemoveContainer" containerID="8e0b459ca5a6f0b6bfff69a217e23c37a0e3efa8c6e24763d0feb0c9ceb036d2"
Sep 18 17:08:58.857397 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:08:58.857377    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e0b459ca5a6f0b6bfff69a217e23c37a0e3efa8c6e24763d0feb0c9ceb036d2\": container with ID starting with 8e0b459ca5a6f0b6bfff69a217e23c37a0e3efa8c6e24763d0feb0c9ceb036d2 not found: ID does not exist" containerID="8e0b459ca5a6f0b6bfff69a217e23c37a0e3efa8c6e24763d0feb0c9ceb036d2"
Sep 18 17:08:58.857443 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.857406    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e0b459ca5a6f0b6bfff69a217e23c37a0e3efa8c6e24763d0feb0c9ceb036d2"} err="failed to get container status \"8e0b459ca5a6f0b6bfff69a217e23c37a0e3efa8c6e24763d0feb0c9ceb036d2\": rpc error: code = NotFound desc = could not find container \"8e0b459ca5a6f0b6bfff69a217e23c37a0e3efa8c6e24763d0feb0c9ceb036d2\": container with ID starting with 8e0b459ca5a6f0b6bfff69a217e23c37a0e3efa8c6e24763d0feb0c9ceb036d2 not found: ID does not exist"
Sep 18 17:08:58.857443 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.857434    2583 scope.go:117] "RemoveContainer" containerID="c0042075e8d49169c95856b2cc52929dcbef60989ddc785799d285993fdfc96c"
Sep 18 17:08:58.857706 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:08:58.857685    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0042075e8d49169c95856b2cc52929dcbef60989ddc785799d285993fdfc96c\": container with ID starting with c0042075e8d49169c95856b2cc52929dcbef60989ddc785799d285993fdfc96c not found: ID does not exist" containerID="c0042075e8d49169c95856b2cc52929dcbef60989ddc785799d285993fdfc96c"
Sep 18 17:08:58.857794 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.857714    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0042075e8d49169c95856b2cc52929dcbef60989ddc785799d285993fdfc96c"} err="failed to get container status \"c0042075e8d49169c95856b2cc52929dcbef60989ddc785799d285993fdfc96c\": rpc error: code = NotFound desc = could not find container \"c0042075e8d49169c95856b2cc52929dcbef60989ddc785799d285993fdfc96c\": container with ID starting with c0042075e8d49169c95856b2cc52929dcbef60989ddc785799d285993fdfc96c not found: ID does not exist"
Sep 18 17:08:58.857794 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.857734    2583 scope.go:117] "RemoveContainer" containerID="761ecc00e1d1435010a13b27eff889fb9abaef23adaa60747406dddc03585fe6"
Sep 18 17:08:58.857988 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:08:58.857974    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"761ecc00e1d1435010a13b27eff889fb9abaef23adaa60747406dddc03585fe6\": container with ID starting with 761ecc00e1d1435010a13b27eff889fb9abaef23adaa60747406dddc03585fe6 not found: ID does not exist" containerID="761ecc00e1d1435010a13b27eff889fb9abaef23adaa60747406dddc03585fe6"
Sep 18 17:08:58.858025 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.857992    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"761ecc00e1d1435010a13b27eff889fb9abaef23adaa60747406dddc03585fe6"} err="failed to get container status \"761ecc00e1d1435010a13b27eff889fb9abaef23adaa60747406dddc03585fe6\": rpc error: code = NotFound desc = could not find container \"761ecc00e1d1435010a13b27eff889fb9abaef23adaa60747406dddc03585fe6\": container with ID starting with 761ecc00e1d1435010a13b27eff889fb9abaef23adaa60747406dddc03585fe6 not found: ID does not exist"
Sep 18 17:08:58.858025 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.858005    2583 scope.go:117] "RemoveContainer" containerID="443db98204a60cc3895a01b7f5985d686ea25500ede9b8c13c66a6cdd49bbe7b"
Sep 18 17:08:58.860964 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.860944    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"]
Sep 18 17:08:58.865383 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.865364    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-gfnfl"]
Sep 18 17:08:58.865677 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.865664    2583 scope.go:117] "RemoveContainer" containerID="b948ec8ef5e2dfa64d97065cc6b92ff788d20a9bd69808d7f5f15a9a952cdad6"
Sep 18 17:08:58.872302 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.872288    2583 scope.go:117] "RemoveContainer" containerID="7240ceac762e56ad7143d1bbb95d43e4345f6fec42f77faf2541ac29d218171c"
Sep 18 17:08:58.879226 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.879209    2583 scope.go:117] "RemoveContainer" containerID="443db98204a60cc3895a01b7f5985d686ea25500ede9b8c13c66a6cdd49bbe7b"
Sep 18 17:08:58.879543 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:08:58.879526    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"443db98204a60cc3895a01b7f5985d686ea25500ede9b8c13c66a6cdd49bbe7b\": container with ID starting with 443db98204a60cc3895a01b7f5985d686ea25500ede9b8c13c66a6cdd49bbe7b not found: ID does not exist" containerID="443db98204a60cc3895a01b7f5985d686ea25500ede9b8c13c66a6cdd49bbe7b"
Sep 18 17:08:58.879614 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.879548    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"443db98204a60cc3895a01b7f5985d686ea25500ede9b8c13c66a6cdd49bbe7b"} err="failed to get container status \"443db98204a60cc3895a01b7f5985d686ea25500ede9b8c13c66a6cdd49bbe7b\": rpc error: code = NotFound desc = could not find container \"443db98204a60cc3895a01b7f5985d686ea25500ede9b8c13c66a6cdd49bbe7b\": container with ID starting with 443db98204a60cc3895a01b7f5985d686ea25500ede9b8c13c66a6cdd49bbe7b not found: ID does not exist"
Sep 18 17:08:58.879614 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.879561    2583 scope.go:117] "RemoveContainer" containerID="b948ec8ef5e2dfa64d97065cc6b92ff788d20a9bd69808d7f5f15a9a952cdad6"
Sep 18 17:08:58.879794 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:08:58.879777    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b948ec8ef5e2dfa64d97065cc6b92ff788d20a9bd69808d7f5f15a9a952cdad6\": container with ID starting with b948ec8ef5e2dfa64d97065cc6b92ff788d20a9bd69808d7f5f15a9a952cdad6 not found: ID does not exist" containerID="b948ec8ef5e2dfa64d97065cc6b92ff788d20a9bd69808d7f5f15a9a952cdad6"
Sep 18 17:08:58.879876 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.879796    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b948ec8ef5e2dfa64d97065cc6b92ff788d20a9bd69808d7f5f15a9a952cdad6"} err="failed to get container status \"b948ec8ef5e2dfa64d97065cc6b92ff788d20a9bd69808d7f5f15a9a952cdad6\": rpc error: code = NotFound desc = could not find container \"b948ec8ef5e2dfa64d97065cc6b92ff788d20a9bd69808d7f5f15a9a952cdad6\": container with ID starting with b948ec8ef5e2dfa64d97065cc6b92ff788d20a9bd69808d7f5f15a9a952cdad6 not found: ID does not exist"
Sep 18 17:08:58.879876 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.879829    2583 scope.go:117] "RemoveContainer" containerID="7240ceac762e56ad7143d1bbb95d43e4345f6fec42f77faf2541ac29d218171c"
Sep 18 17:08:58.880066 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:08:58.880049    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7240ceac762e56ad7143d1bbb95d43e4345f6fec42f77faf2541ac29d218171c\": container with ID starting with 7240ceac762e56ad7143d1bbb95d43e4345f6fec42f77faf2541ac29d218171c not found: ID does not exist" containerID="7240ceac762e56ad7143d1bbb95d43e4345f6fec42f77faf2541ac29d218171c"
Sep 18 17:08:58.880116 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.880075    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7240ceac762e56ad7143d1bbb95d43e4345f6fec42f77faf2541ac29d218171c"} err="failed to get container status \"7240ceac762e56ad7143d1bbb95d43e4345f6fec42f77faf2541ac29d218171c\": rpc error: code = NotFound desc = could not find container \"7240ceac762e56ad7143d1bbb95d43e4345f6fec42f77faf2541ac29d218171c\": container with ID starting with 7240ceac762e56ad7143d1bbb95d43e4345f6fec42f77faf2541ac29d218171c not found: ID does not exist"
Sep 18 17:08:58.880529 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.880513    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"]
Sep 18 17:08:58.885339 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.885319    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-kf9x5"]
Sep 18 17:08:58.915270 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.915251    2583 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:08:58.915270 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.915271    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j246\" (UniqueName: \"kubernetes.io/projected/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-kube-api-access-2j246\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:08:58.915385 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.915281    2583 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-cabundle-cert\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:08:58.915385 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:58.915290    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea-proxy-tls\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:08:59.463236 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:59.463209    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" path="/var/lib/kubelet/pods/32d20160-2ce6-4e04-bc0a-16e4fb4e0fea/volumes"
Sep 18 17:08:59.463702 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:08:59.463686    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" path="/var/lib/kubelet/pods/a194a4cd-c62b-4407-b1df-5e197e33ff49/volumes"
Sep 18 17:09:11.443929 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:09:11.443895    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:09:11.446255 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:09:11.446238    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:09:11.446847 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:09:11.446826    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:09:11.449077 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:09:11.449060    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:09:33.946320 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:09:33.946282    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:09:34.359532 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:09:34.359444    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:09:40.988775 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:09:40.988730    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:10:03.033643 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:03.033545    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:10:03.108097 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:03.108067    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:10:04.380091 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.380057    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:10:04.404941 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.404910    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"]
Sep 18 17:10:04.405236 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.405220    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="storage-initializer"
Sep 18 17:10:04.405317 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.405240    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="storage-initializer"
Sep 18 17:10:04.405317 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.405251    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="kube-rbac-proxy"
Sep 18 17:10:04.405317 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.405261    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="kube-rbac-proxy"
Sep 18 17:10:04.405317 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.405271    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kserve-container"
Sep 18 17:10:04.405317 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.405280    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kserve-container"
Sep 18 17:10:04.405317 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.405290    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kube-rbac-proxy"
Sep 18 17:10:04.405317 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.405299    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kube-rbac-proxy"
Sep 18 17:10:04.405317 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.405316    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="storage-initializer"
Sep 18 17:10:04.405706 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.405325    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="storage-initializer"
Sep 18 17:10:04.405706 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.405338    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="kserve-container"
Sep 18 17:10:04.405706 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.405346    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="kserve-container"
Sep 18 17:10:04.405706 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.405408    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="kserve-container"
Sep 18 17:10:04.405706 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.405418    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a194a4cd-c62b-4407-b1df-5e197e33ff49" containerName="kube-rbac-proxy"
Sep 18 17:10:04.405706 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.405428    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kserve-container"
Sep 18 17:10:04.405706 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.405439    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="32d20160-2ce6-4e04-bc0a-16e4fb4e0fea" containerName="kube-rbac-proxy"
Sep 18 17:10:04.407301 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.407283    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"
Sep 18 17:10:04.411442 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.411415    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-9846a-serving-cert\""
Sep 18 17:10:04.411905 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.411889    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 18 17:10:04.411963 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.411891    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-97cfm\""
Sep 18 17:10:04.413906 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.413885    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-9846a-kube-rbac-proxy-sar-config\""
Sep 18 17:10:04.422278 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.422257    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"]
Sep 18 17:10:04.490659 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.490616    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:10:04.551844 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.551798    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd4cc05e-830f-46cf-8738-2610dbf8a1f1-openshift-service-ca-bundle\") pod \"sequence-graph-9846a-6484c88c6c-6kbst\" (UID: \"fd4cc05e-830f-46cf-8738-2610dbf8a1f1\") " pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"
Sep 18 17:10:04.551964 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.551940    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fd4cc05e-830f-46cf-8738-2610dbf8a1f1-proxy-tls\") pod \"sequence-graph-9846a-6484c88c6c-6kbst\" (UID: \"fd4cc05e-830f-46cf-8738-2610dbf8a1f1\") " pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"
Sep 18 17:10:04.653088 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.653023    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd4cc05e-830f-46cf-8738-2610dbf8a1f1-openshift-service-ca-bundle\") pod \"sequence-graph-9846a-6484c88c6c-6kbst\" (UID: \"fd4cc05e-830f-46cf-8738-2610dbf8a1f1\") " pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"
Sep 18 17:10:04.653088 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.653083    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fd4cc05e-830f-46cf-8738-2610dbf8a1f1-proxy-tls\") pod \"sequence-graph-9846a-6484c88c6c-6kbst\" (UID: \"fd4cc05e-830f-46cf-8738-2610dbf8a1f1\") " pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"
Sep 18 17:10:04.653610 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.653590    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd4cc05e-830f-46cf-8738-2610dbf8a1f1-openshift-service-ca-bundle\") pod \"sequence-graph-9846a-6484c88c6c-6kbst\" (UID: \"fd4cc05e-830f-46cf-8738-2610dbf8a1f1\") " pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"
Sep 18 17:10:04.655535 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.655510    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fd4cc05e-830f-46cf-8738-2610dbf8a1f1-proxy-tls\") pod \"sequence-graph-9846a-6484c88c6c-6kbst\" (UID: \"fd4cc05e-830f-46cf-8738-2610dbf8a1f1\") " pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"
Sep 18 17:10:04.717264 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.717232    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"
Sep 18 17:10:05.000049 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:04.999981    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"]
Sep 18 17:10:05.002854 ip-10-0-142-7 kubenswrapper[2583]: W0918 17:10:05.002803    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd4cc05e_830f_46cf_8738_2610dbf8a1f1.slice/crio-c67a9343daad6a9558e36fd2840a91d6e7deb02b0fac9c80d90c0bd2514e6f3c WatchSource:0}: Error finding container c67a9343daad6a9558e36fd2840a91d6e7deb02b0fac9c80d90c0bd2514e6f3c: Status 404 returned error can't find the container with id c67a9343daad6a9558e36fd2840a91d6e7deb02b0fac9c80d90c0bd2514e6f3c
Sep 18 17:10:05.004882 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:05.004868    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 17:10:05.089380 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:05.089357    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst" event={"ID":"fd4cc05e-830f-46cf-8738-2610dbf8a1f1","Type":"ContainerStarted","Data":"c67a9343daad6a9558e36fd2840a91d6e7deb02b0fac9c80d90c0bd2514e6f3c"}
Sep 18 17:10:08.104226 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:08.104154    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst" event={"ID":"fd4cc05e-830f-46cf-8738-2610dbf8a1f1","Type":"ContainerStarted","Data":"fdd9c9f2ea51fde3a4fddf9eba5478273ee34a9e73f587c4a0ac71407c5bc4b9"}
Sep 18 17:10:08.104705 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:08.104309    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"
Sep 18 17:10:08.130057 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:08.130002    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst" podStartSLOduration=2.036222902 podStartE2EDuration="4.129987742s" totalImagesPullingTime="2.09376484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:10:08.129552331 +0000 UTC m=+1258.854834073" watchObservedRunningTime="2026-09-18 17:10:08.129987742 +0000 UTC m=+1258.855269488"
Sep 18 17:10:14.116239 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:14.116199    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"
Sep 18 17:10:38.874650 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:10:38.874612    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:13:09.007832 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:13:09.007734    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:13:20.309382 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:13:20.309340    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:14:11.470239 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:14:11.470208    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:14:11.472874 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:14:11.472849    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:14:11.473093 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:14:11.473071    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:14:11.475464 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:14:11.475443    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:17:49.198521 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:17:49.198431    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:17:49.283092 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:17:49.283018    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:17:49.383158 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:17:49.383125    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:17:49.475138 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:17:49.475052    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:17:49.550175 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:17:49.550138    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:17:49.712282 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:17:49.712245    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:18:19.940759 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:19.940716    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"]
Sep 18 17:18:19.941202 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:19.941036    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst" podUID="fd4cc05e-830f-46cf-8738-2610dbf8a1f1" containerName="sequence-graph-9846a" containerID="cri-o://fdd9c9f2ea51fde3a4fddf9eba5478273ee34a9e73f587c4a0ac71407c5bc4b9" gracePeriod=30
Sep 18 17:18:19.962452 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:19.962415    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:18:21.161784 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:21.161749    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:18:24.114601 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:24.114552    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst" podUID="fd4cc05e-830f-46cf-8738-2610dbf8a1f1" containerName="sequence-graph-9846a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:18:29.113963 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:29.113915    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst" podUID="fd4cc05e-830f-46cf-8738-2610dbf8a1f1" containerName="sequence-graph-9846a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:18:34.114353 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:34.114301    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst" podUID="fd4cc05e-830f-46cf-8738-2610dbf8a1f1" containerName="sequence-graph-9846a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:18:34.114793 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:34.114441    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"
Sep 18 17:18:39.114253 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:39.114205    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst" podUID="fd4cc05e-830f-46cf-8738-2610dbf8a1f1" containerName="sequence-graph-9846a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:18:44.113644 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:44.113600    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst" podUID="fd4cc05e-830f-46cf-8738-2610dbf8a1f1" containerName="sequence-graph-9846a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:18:49.114533 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:49.114483    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst" podUID="fd4cc05e-830f-46cf-8738-2610dbf8a1f1" containerName="sequence-graph-9846a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:18:50.125103 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:50.125065    2583 generic.go:356] "Generic (PLEG): container finished" podID="fd4cc05e-830f-46cf-8738-2610dbf8a1f1" containerID="fdd9c9f2ea51fde3a4fddf9eba5478273ee34a9e73f587c4a0ac71407c5bc4b9" exitCode=0
Sep 18 17:18:50.125489 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:50.125133    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst" event={"ID":"fd4cc05e-830f-46cf-8738-2610dbf8a1f1","Type":"ContainerDied","Data":"fdd9c9f2ea51fde3a4fddf9eba5478273ee34a9e73f587c4a0ac71407c5bc4b9"}
Sep 18 17:18:50.590607 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:50.590576    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"
Sep 18 17:18:50.689141 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:50.689044    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fd4cc05e-830f-46cf-8738-2610dbf8a1f1-proxy-tls\") pod \"fd4cc05e-830f-46cf-8738-2610dbf8a1f1\" (UID: \"fd4cc05e-830f-46cf-8738-2610dbf8a1f1\") "
Sep 18 17:18:50.689141 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:50.689116    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd4cc05e-830f-46cf-8738-2610dbf8a1f1-openshift-service-ca-bundle\") pod \"fd4cc05e-830f-46cf-8738-2610dbf8a1f1\" (UID: \"fd4cc05e-830f-46cf-8738-2610dbf8a1f1\") "
Sep 18 17:18:50.689503 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:50.689475    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd4cc05e-830f-46cf-8738-2610dbf8a1f1-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "fd4cc05e-830f-46cf-8738-2610dbf8a1f1" (UID: "fd4cc05e-830f-46cf-8738-2610dbf8a1f1"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:18:50.691573 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:50.691548    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd4cc05e-830f-46cf-8738-2610dbf8a1f1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fd4cc05e-830f-46cf-8738-2610dbf8a1f1" (UID: "fd4cc05e-830f-46cf-8738-2610dbf8a1f1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:18:50.790069 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:50.789976    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fd4cc05e-830f-46cf-8738-2610dbf8a1f1-proxy-tls\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:18:50.790069 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:50.790007    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd4cc05e-830f-46cf-8738-2610dbf8a1f1-openshift-service-ca-bundle\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:18:51.130347 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:51.130311    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst" event={"ID":"fd4cc05e-830f-46cf-8738-2610dbf8a1f1","Type":"ContainerDied","Data":"c67a9343daad6a9558e36fd2840a91d6e7deb02b0fac9c80d90c0bd2514e6f3c"}
Sep 18 17:18:51.130796 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:51.130377    2583 scope.go:117] "RemoveContainer" containerID="fdd9c9f2ea51fde3a4fddf9eba5478273ee34a9e73f587c4a0ac71407c5bc4b9"
Sep 18 17:18:51.130796 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:51.130322    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"
Sep 18 17:18:51.151069 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:51.151026    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"]
Sep 18 17:18:51.155188 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:51.155158    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9846a-6484c88c6c-6kbst"]
Sep 18 17:18:51.463491 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:51.463407    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd4cc05e-830f-46cf-8738-2610dbf8a1f1" path="/var/lib/kubelet/pods/fd4cc05e-830f-46cf-8738-2610dbf8a1f1/volumes"
Sep 18 17:18:54.206167 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:54.206126    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:18:59.473053 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.473016    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:18:59.506341 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.506303    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"]
Sep 18 17:18:59.506585 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.506571    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd4cc05e-830f-46cf-8738-2610dbf8a1f1" containerName="sequence-graph-9846a"
Sep 18 17:18:59.506630 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.506587    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd4cc05e-830f-46cf-8738-2610dbf8a1f1" containerName="sequence-graph-9846a"
Sep 18 17:18:59.506665 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.506639    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd4cc05e-830f-46cf-8738-2610dbf8a1f1" containerName="sequence-graph-9846a"
Sep 18 17:18:59.510895 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.510875    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"
Sep 18 17:18:59.514604 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.514578    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 18 17:18:59.514959 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.514943    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-21436-serving-cert\""
Sep 18 17:18:59.515043 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.514971    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-97cfm\""
Sep 18 17:18:59.515233 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.515216    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-21436-kube-rbac-proxy-sar-config\""
Sep 18 17:18:59.529865 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.529805    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"]
Sep 18 17:18:59.663624 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.663578    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db10332e-0ec3-4a3f-aab6-72be0c8234ae-proxy-tls\") pod \"ensemble-graph-21436-665c75b9b7-kp5mh\" (UID: \"db10332e-0ec3-4a3f-aab6-72be0c8234ae\") " pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"
Sep 18 17:18:59.663804 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.663649    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db10332e-0ec3-4a3f-aab6-72be0c8234ae-openshift-service-ca-bundle\") pod \"ensemble-graph-21436-665c75b9b7-kp5mh\" (UID: \"db10332e-0ec3-4a3f-aab6-72be0c8234ae\") " pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"
Sep 18 17:18:59.764640 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.764534    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db10332e-0ec3-4a3f-aab6-72be0c8234ae-openshift-service-ca-bundle\") pod \"ensemble-graph-21436-665c75b9b7-kp5mh\" (UID: \"db10332e-0ec3-4a3f-aab6-72be0c8234ae\") " pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"
Sep 18 17:18:59.764640 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.764606    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db10332e-0ec3-4a3f-aab6-72be0c8234ae-proxy-tls\") pod \"ensemble-graph-21436-665c75b9b7-kp5mh\" (UID: \"db10332e-0ec3-4a3f-aab6-72be0c8234ae\") " pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"
Sep 18 17:18:59.765296 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.765277    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db10332e-0ec3-4a3f-aab6-72be0c8234ae-openshift-service-ca-bundle\") pod \"ensemble-graph-21436-665c75b9b7-kp5mh\" (UID: \"db10332e-0ec3-4a3f-aab6-72be0c8234ae\") " pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"
Sep 18 17:18:59.767230 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.767199    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db10332e-0ec3-4a3f-aab6-72be0c8234ae-proxy-tls\") pod \"ensemble-graph-21436-665c75b9b7-kp5mh\" (UID: \"db10332e-0ec3-4a3f-aab6-72be0c8234ae\") " pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"
Sep 18 17:18:59.789179 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.789135    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:18:59.821502 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:18:59.821465    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"
Sep 18 17:19:00.101447 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:00.101418    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"]
Sep 18 17:19:00.103983 ip-10-0-142-7 kubenswrapper[2583]: W0918 17:19:00.103950    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb10332e_0ec3_4a3f_aab6_72be0c8234ae.slice/crio-010615d6a4f086dfc1ca6edb6d48f561b1c6ad78935893ae0cba979661cf27c5 WatchSource:0}: Error finding container 010615d6a4f086dfc1ca6edb6d48f561b1c6ad78935893ae0cba979661cf27c5: Status 404 returned error can't find the container with id 010615d6a4f086dfc1ca6edb6d48f561b1c6ad78935893ae0cba979661cf27c5
Sep 18 17:19:00.166490 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:00.166458    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh" event={"ID":"db10332e-0ec3-4a3f-aab6-72be0c8234ae","Type":"ContainerStarted","Data":"010615d6a4f086dfc1ca6edb6d48f561b1c6ad78935893ae0cba979661cf27c5"}
Sep 18 17:19:01.172300 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:01.172262    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh" event={"ID":"db10332e-0ec3-4a3f-aab6-72be0c8234ae","Type":"ContainerStarted","Data":"f93518622e91055eceb8b9cb50eef4ebca3b94917b33b7e42e971d074c1bd6a5"}
Sep 18 17:19:01.172701 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:01.172441    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"
Sep 18 17:19:01.190286 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:01.190227    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh" podStartSLOduration=2.190209043 podStartE2EDuration="2.190209043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:18:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:19:01.189686021 +0000 UTC m=+1791.914967764" watchObservedRunningTime="2026-09-18 17:19:01.190209043 +0000 UTC m=+1791.915490789"
Sep 18 17:19:07.182123 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:07.182086    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"
Sep 18 17:19:10.088497 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:10.088460    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"]
Sep 18 17:19:10.088961 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:10.088684    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh" podUID="db10332e-0ec3-4a3f-aab6-72be0c8234ae" containerName="ensemble-graph-21436" containerID="cri-o://f93518622e91055eceb8b9cb50eef4ebca3b94917b33b7e42e971d074c1bd6a5" gracePeriod=30
Sep 18 17:19:10.095230 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:10.095203    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:19:10.327177 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:10.327146    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:19:10.410761 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:10.410722    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:19:10.546507 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:10.546461    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:19:10.641572 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:10.641543    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:19:10.749460 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:10.749366    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:19:10.851558 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:10.851527    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:19:11.497946 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:11.497915    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:19:11.500407 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:11.500383    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:19:11.500931 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:11.500912    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:19:11.503291 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:11.503274    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:19:12.180883 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:12.180838    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh" podUID="db10332e-0ec3-4a3f-aab6-72be0c8234ae" containerName="ensemble-graph-21436" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:19:17.181387 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:17.181345    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh" podUID="db10332e-0ec3-4a3f-aab6-72be0c8234ae" containerName="ensemble-graph-21436" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:19:22.181529 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:22.181481    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh" podUID="db10332e-0ec3-4a3f-aab6-72be0c8234ae" containerName="ensemble-graph-21436" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:19:22.181985 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:22.181637    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"
Sep 18 17:19:27.180649 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:27.180601    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh" podUID="db10332e-0ec3-4a3f-aab6-72be0c8234ae" containerName="ensemble-graph-21436" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:19:30.153759 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:30.153719    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"]
Sep 18 17:19:30.158101 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:30.158079    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"
Sep 18 17:19:30.160309 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:30.160280    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-78e6b-kube-rbac-proxy-sar-config\""
Sep 18 17:19:30.160465 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:30.160314    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-78e6b-serving-cert\""
Sep 18 17:19:30.169899 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:30.169861    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:19:30.170256 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:30.170237    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"]
Sep 18 17:19:30.213258 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:30.213222    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29750859-9558-4e4c-8f81-24100bdb0fdb-openshift-service-ca-bundle\") pod \"sequence-graph-78e6b-76f9f95c9f-j8gxc\" (UID: \"29750859-9558-4e4c-8f81-24100bdb0fdb\") " pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"
Sep 18 17:19:30.213428 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:30.213268    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/29750859-9558-4e4c-8f81-24100bdb0fdb-proxy-tls\") pod \"sequence-graph-78e6b-76f9f95c9f-j8gxc\" (UID: \"29750859-9558-4e4c-8f81-24100bdb0fdb\") " pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"
Sep 18 17:19:30.262595 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:30.262501    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:19:30.314242 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:30.314201    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/29750859-9558-4e4c-8f81-24100bdb0fdb-proxy-tls\") pod \"sequence-graph-78e6b-76f9f95c9f-j8gxc\" (UID: \"29750859-9558-4e4c-8f81-24100bdb0fdb\") " pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"
Sep 18 17:19:30.314432 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:30.314282    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29750859-9558-4e4c-8f81-24100bdb0fdb-openshift-service-ca-bundle\") pod \"sequence-graph-78e6b-76f9f95c9f-j8gxc\" (UID: \"29750859-9558-4e4c-8f81-24100bdb0fdb\") " pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"
Sep 18 17:19:30.314963 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:30.314945    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29750859-9558-4e4c-8f81-24100bdb0fdb-openshift-service-ca-bundle\") pod \"sequence-graph-78e6b-76f9f95c9f-j8gxc\" (UID: \"29750859-9558-4e4c-8f81-24100bdb0fdb\") " pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"
Sep 18 17:19:30.316997 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:30.316974    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/29750859-9558-4e4c-8f81-24100bdb0fdb-proxy-tls\") pod \"sequence-graph-78e6b-76f9f95c9f-j8gxc\" (UID: \"29750859-9558-4e4c-8f81-24100bdb0fdb\") " pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"
Sep 18 17:19:30.468990 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:30.468889    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"
Sep 18 17:19:30.747442 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:30.747349    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"]
Sep 18 17:19:30.751234 ip-10-0-142-7 kubenswrapper[2583]: W0918 17:19:30.751200    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29750859_9558_4e4c_8f81_24100bdb0fdb.slice/crio-f2f5d394643cf9ce16435566ba4b7939878febf1e1fa123dad014b0d4124639a WatchSource:0}: Error finding container f2f5d394643cf9ce16435566ba4b7939878febf1e1fa123dad014b0d4124639a: Status 404 returned error can't find the container with id f2f5d394643cf9ce16435566ba4b7939878febf1e1fa123dad014b0d4124639a
Sep 18 17:19:31.292100 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:31.292065    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc" event={"ID":"29750859-9558-4e4c-8f81-24100bdb0fdb","Type":"ContainerStarted","Data":"66f98bf77633c8d62f9b283e80ffbc83fd8660a698cb7fb7a1b11ad01404d359"}
Sep 18 17:19:31.292512 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:31.292118    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc" event={"ID":"29750859-9558-4e4c-8f81-24100bdb0fdb","Type":"ContainerStarted","Data":"f2f5d394643cf9ce16435566ba4b7939878febf1e1fa123dad014b0d4124639a"}
Sep 18 17:19:31.292512 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:31.292150    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"
Sep 18 17:19:31.316157 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:31.316100    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc" podStartSLOduration=1.316081327 podStartE2EDuration="1.316081327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:19:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:19:31.314418799 +0000 UTC m=+1822.039700545" watchObservedRunningTime="2026-09-18 17:19:31.316081327 +0000 UTC m=+1822.041363073"
Sep 18 17:19:32.181188 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:32.181144    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh" podUID="db10332e-0ec3-4a3f-aab6-72be0c8234ae" containerName="ensemble-graph-21436" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:19:37.181206 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:37.181157    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh" podUID="db10332e-0ec3-4a3f-aab6-72be0c8234ae" containerName="ensemble-graph-21436" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:19:37.302190 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:37.302160    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"
Sep 18 17:19:40.246337 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:40.246308    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"
Sep 18 17:19:40.327923 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:40.327887    2583 generic.go:356] "Generic (PLEG): container finished" podID="db10332e-0ec3-4a3f-aab6-72be0c8234ae" containerID="f93518622e91055eceb8b9cb50eef4ebca3b94917b33b7e42e971d074c1bd6a5" exitCode=0
Sep 18 17:19:40.328104 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:40.327929    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"
Sep 18 17:19:40.328104 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:40.327935    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh" event={"ID":"db10332e-0ec3-4a3f-aab6-72be0c8234ae","Type":"ContainerDied","Data":"f93518622e91055eceb8b9cb50eef4ebca3b94917b33b7e42e971d074c1bd6a5"}
Sep 18 17:19:40.328104 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:40.327988    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh" event={"ID":"db10332e-0ec3-4a3f-aab6-72be0c8234ae","Type":"ContainerDied","Data":"010615d6a4f086dfc1ca6edb6d48f561b1c6ad78935893ae0cba979661cf27c5"}
Sep 18 17:19:40.328104 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:40.328012    2583 scope.go:117] "RemoveContainer" containerID="f93518622e91055eceb8b9cb50eef4ebca3b94917b33b7e42e971d074c1bd6a5"
Sep 18 17:19:40.336377 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:40.336357    2583 scope.go:117] "RemoveContainer" containerID="f93518622e91055eceb8b9cb50eef4ebca3b94917b33b7e42e971d074c1bd6a5"
Sep 18 17:19:40.336726 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:19:40.336705    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f93518622e91055eceb8b9cb50eef4ebca3b94917b33b7e42e971d074c1bd6a5\": container with ID starting with f93518622e91055eceb8b9cb50eef4ebca3b94917b33b7e42e971d074c1bd6a5 not found: ID does not exist" containerID="f93518622e91055eceb8b9cb50eef4ebca3b94917b33b7e42e971d074c1bd6a5"
Sep 18 17:19:40.336779 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:40.336737    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f93518622e91055eceb8b9cb50eef4ebca3b94917b33b7e42e971d074c1bd6a5"} err="failed to get container status \"f93518622e91055eceb8b9cb50eef4ebca3b94917b33b7e42e971d074c1bd6a5\": rpc error: code = NotFound desc = could not find container \"f93518622e91055eceb8b9cb50eef4ebca3b94917b33b7e42e971d074c1bd6a5\": container with ID starting with f93518622e91055eceb8b9cb50eef4ebca3b94917b33b7e42e971d074c1bd6a5 not found: ID does not exist"
Sep 18 17:19:40.398730 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:40.398691    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db10332e-0ec3-4a3f-aab6-72be0c8234ae-openshift-service-ca-bundle\") pod \"db10332e-0ec3-4a3f-aab6-72be0c8234ae\" (UID: \"db10332e-0ec3-4a3f-aab6-72be0c8234ae\") "
Sep 18 17:19:40.398920 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:40.398738    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db10332e-0ec3-4a3f-aab6-72be0c8234ae-proxy-tls\") pod \"db10332e-0ec3-4a3f-aab6-72be0c8234ae\" (UID: \"db10332e-0ec3-4a3f-aab6-72be0c8234ae\") "
Sep 18 17:19:40.399188 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:40.399160    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db10332e-0ec3-4a3f-aab6-72be0c8234ae-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "db10332e-0ec3-4a3f-aab6-72be0c8234ae" (UID: "db10332e-0ec3-4a3f-aab6-72be0c8234ae"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:19:40.401118 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:40.401096    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db10332e-0ec3-4a3f-aab6-72be0c8234ae-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "db10332e-0ec3-4a3f-aab6-72be0c8234ae" (UID: "db10332e-0ec3-4a3f-aab6-72be0c8234ae"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:19:40.500027 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:40.499986    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db10332e-0ec3-4a3f-aab6-72be0c8234ae-openshift-service-ca-bundle\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:19:40.500027 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:40.500018    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db10332e-0ec3-4a3f-aab6-72be0c8234ae-proxy-tls\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:19:40.652266 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:40.652174    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"]
Sep 18 17:19:40.656976 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:40.656943    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-21436-665c75b9b7-kp5mh"]
Sep 18 17:19:41.156133 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:41.156096    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"]
Sep 18 17:19:41.156355 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:41.156327    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc" podUID="29750859-9558-4e4c-8f81-24100bdb0fdb" containerName="sequence-graph-78e6b" containerID="cri-o://66f98bf77633c8d62f9b283e80ffbc83fd8660a698cb7fb7a1b11ad01404d359" gracePeriod=30
Sep 18 17:19:41.179968 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:41.179932    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:19:41.281732 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:41.281667    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:19:41.362316 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:41.362277    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:19:41.441259 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:41.441160    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:19:41.465075 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:41.465043    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db10332e-0ec3-4a3f-aab6-72be0c8234ae" path="/var/lib/kubelet/pods/db10332e-0ec3-4a3f-aab6-72be0c8234ae/volumes"
Sep 18 17:19:41.610337 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:41.610305    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:19:41.727110 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:41.727025    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:19:41.828992 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:41.828962    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:19:42.301025 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:42.300982    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc" podUID="29750859-9558-4e4c-8f81-24100bdb0fdb" containerName="sequence-graph-78e6b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:19:47.300870 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:47.300796    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc" podUID="29750859-9558-4e4c-8f81-24100bdb0fdb" containerName="sequence-graph-78e6b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:19:52.301028 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:52.300977    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc" podUID="29750859-9558-4e4c-8f81-24100bdb0fdb" containerName="sequence-graph-78e6b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:19:52.301448 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:52.301090    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"
Sep 18 17:19:57.300646 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:19:57.300602    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc" podUID="29750859-9558-4e4c-8f81-24100bdb0fdb" containerName="sequence-graph-78e6b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:20:02.301071 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:02.301027    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc" podUID="29750859-9558-4e4c-8f81-24100bdb0fdb" containerName="sequence-graph-78e6b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:20:07.300984 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:07.300935    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc" podUID="29750859-9558-4e4c-8f81-24100bdb0fdb" containerName="sequence-graph-78e6b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:20:11.306629 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:11.306601    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"
Sep 18 17:20:11.349002 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:11.348954    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/29750859-9558-4e4c-8f81-24100bdb0fdb-proxy-tls\") pod \"29750859-9558-4e4c-8f81-24100bdb0fdb\" (UID: \"29750859-9558-4e4c-8f81-24100bdb0fdb\") "
Sep 18 17:20:11.349182 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:11.349039    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29750859-9558-4e4c-8f81-24100bdb0fdb-openshift-service-ca-bundle\") pod \"29750859-9558-4e4c-8f81-24100bdb0fdb\" (UID: \"29750859-9558-4e4c-8f81-24100bdb0fdb\") "
Sep 18 17:20:11.349428 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:11.349394    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29750859-9558-4e4c-8f81-24100bdb0fdb-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "29750859-9558-4e4c-8f81-24100bdb0fdb" (UID: "29750859-9558-4e4c-8f81-24100bdb0fdb"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:20:11.351401 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:11.351374    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29750859-9558-4e4c-8f81-24100bdb0fdb-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "29750859-9558-4e4c-8f81-24100bdb0fdb" (UID: "29750859-9558-4e4c-8f81-24100bdb0fdb"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:20:11.446331 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:11.446240    2583 generic.go:356] "Generic (PLEG): container finished" podID="29750859-9558-4e4c-8f81-24100bdb0fdb" containerID="66f98bf77633c8d62f9b283e80ffbc83fd8660a698cb7fb7a1b11ad01404d359" exitCode=0
Sep 18 17:20:11.446331 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:11.446298    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"
Sep 18 17:20:11.446331 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:11.446319    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc" event={"ID":"29750859-9558-4e4c-8f81-24100bdb0fdb","Type":"ContainerDied","Data":"66f98bf77633c8d62f9b283e80ffbc83fd8660a698cb7fb7a1b11ad01404d359"}
Sep 18 17:20:11.446576 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:11.446404    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc" event={"ID":"29750859-9558-4e4c-8f81-24100bdb0fdb","Type":"ContainerDied","Data":"f2f5d394643cf9ce16435566ba4b7939878febf1e1fa123dad014b0d4124639a"}
Sep 18 17:20:11.446576 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:11.446428    2583 scope.go:117] "RemoveContainer" containerID="66f98bf77633c8d62f9b283e80ffbc83fd8660a698cb7fb7a1b11ad01404d359"
Sep 18 17:20:11.449552 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:11.449528    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/29750859-9558-4e4c-8f81-24100bdb0fdb-proxy-tls\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:20:11.449661 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:11.449554    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29750859-9558-4e4c-8f81-24100bdb0fdb-openshift-service-ca-bundle\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:20:11.455384 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:11.455364    2583 scope.go:117] "RemoveContainer" containerID="66f98bf77633c8d62f9b283e80ffbc83fd8660a698cb7fb7a1b11ad01404d359"
Sep 18 17:20:11.455730 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:20:11.455708    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66f98bf77633c8d62f9b283e80ffbc83fd8660a698cb7fb7a1b11ad01404d359\": container with ID starting with 66f98bf77633c8d62f9b283e80ffbc83fd8660a698cb7fb7a1b11ad01404d359 not found: ID does not exist" containerID="66f98bf77633c8d62f9b283e80ffbc83fd8660a698cb7fb7a1b11ad01404d359"
Sep 18 17:20:11.455830 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:11.455739    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66f98bf77633c8d62f9b283e80ffbc83fd8660a698cb7fb7a1b11ad01404d359"} err="failed to get container status \"66f98bf77633c8d62f9b283e80ffbc83fd8660a698cb7fb7a1b11ad01404d359\": rpc error: code = NotFound desc = could not find container \"66f98bf77633c8d62f9b283e80ffbc83fd8660a698cb7fb7a1b11ad01404d359\": container with ID starting with 66f98bf77633c8d62f9b283e80ffbc83fd8660a698cb7fb7a1b11ad01404d359 not found: ID does not exist"
Sep 18 17:20:11.468686 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:11.468652    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"]
Sep 18 17:20:11.478504 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:11.478472    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-78e6b-76f9f95c9f-j8gxc"]
Sep 18 17:20:13.464061 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:13.464023    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29750859-9558-4e4c-8f81-24100bdb0fdb" path="/var/lib/kubelet/pods/29750859-9558-4e4c-8f81-24100bdb0fdb/volumes"
Sep 18 17:20:20.350906 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.350868    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"]
Sep 18 17:20:20.351403 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.351298    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29750859-9558-4e4c-8f81-24100bdb0fdb" containerName="sequence-graph-78e6b"
Sep 18 17:20:20.351403 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.351318    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="29750859-9558-4e4c-8f81-24100bdb0fdb" containerName="sequence-graph-78e6b"
Sep 18 17:20:20.351403 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.351337    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db10332e-0ec3-4a3f-aab6-72be0c8234ae" containerName="ensemble-graph-21436"
Sep 18 17:20:20.351403 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.351346    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="db10332e-0ec3-4a3f-aab6-72be0c8234ae" containerName="ensemble-graph-21436"
Sep 18 17:20:20.351614 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.351423    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="29750859-9558-4e4c-8f81-24100bdb0fdb" containerName="sequence-graph-78e6b"
Sep 18 17:20:20.351614 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.351433    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="db10332e-0ec3-4a3f-aab6-72be0c8234ae" containerName="ensemble-graph-21436"
Sep 18 17:20:20.355912 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.355884    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"
Sep 18 17:20:20.358196 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.358162    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-cca0b-serving-cert\""
Sep 18 17:20:20.358370 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.358244    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-97cfm\""
Sep 18 17:20:20.358370 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.358354    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-cca0b-kube-rbac-proxy-sar-config\""
Sep 18 17:20:20.358483 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.358466    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 18 17:20:20.359497 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.359435    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:20:20.362560 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.362528    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"]
Sep 18 17:20:20.422783 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.422742    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b008697-9612-410f-83ee-93b5b25849a3-openshift-service-ca-bundle\") pod \"ensemble-graph-cca0b-846df546c8-8p7wd\" (UID: \"8b008697-9612-410f-83ee-93b5b25849a3\") " pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"
Sep 18 17:20:20.422970 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.422804    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8b008697-9612-410f-83ee-93b5b25849a3-proxy-tls\") pod \"ensemble-graph-cca0b-846df546c8-8p7wd\" (UID: \"8b008697-9612-410f-83ee-93b5b25849a3\") " pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"
Sep 18 17:20:20.523839 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.523764    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8b008697-9612-410f-83ee-93b5b25849a3-proxy-tls\") pod \"ensemble-graph-cca0b-846df546c8-8p7wd\" (UID: \"8b008697-9612-410f-83ee-93b5b25849a3\") " pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"
Sep 18 17:20:20.524026 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.523861    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b008697-9612-410f-83ee-93b5b25849a3-openshift-service-ca-bundle\") pod \"ensemble-graph-cca0b-846df546c8-8p7wd\" (UID: \"8b008697-9612-410f-83ee-93b5b25849a3\") " pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"
Sep 18 17:20:20.524026 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:20:20.523926    2583 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-cca0b-serving-cert: secret "ensemble-graph-cca0b-serving-cert" not found
Sep 18 17:20:20.524026 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:20:20.524002    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b008697-9612-410f-83ee-93b5b25849a3-proxy-tls podName:8b008697-9612-410f-83ee-93b5b25849a3 nodeName:}" failed. No retries permitted until 2026-09-18 17:20:21.023982537 +0000 UTC m=+1871.749264261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/8b008697-9612-410f-83ee-93b5b25849a3-proxy-tls") pod "ensemble-graph-cca0b-846df546c8-8p7wd" (UID: "8b008697-9612-410f-83ee-93b5b25849a3") : secret "ensemble-graph-cca0b-serving-cert" not found
Sep 18 17:20:20.524463 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.524444    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b008697-9612-410f-83ee-93b5b25849a3-openshift-service-ca-bundle\") pod \"ensemble-graph-cca0b-846df546c8-8p7wd\" (UID: \"8b008697-9612-410f-83ee-93b5b25849a3\") " pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"
Sep 18 17:20:20.600941 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:20.600808    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:20:21.028654 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:21.028608    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8b008697-9612-410f-83ee-93b5b25849a3-proxy-tls\") pod \"ensemble-graph-cca0b-846df546c8-8p7wd\" (UID: \"8b008697-9612-410f-83ee-93b5b25849a3\") " pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"
Sep 18 17:20:21.031362 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:21.031339    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8b008697-9612-410f-83ee-93b5b25849a3-proxy-tls\") pod \"ensemble-graph-cca0b-846df546c8-8p7wd\" (UID: \"8b008697-9612-410f-83ee-93b5b25849a3\") " pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"
Sep 18 17:20:21.266346 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:21.266296    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"
Sep 18 17:20:21.543774 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:21.543638    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"]
Sep 18 17:20:21.546956 ip-10-0-142-7 kubenswrapper[2583]: W0918 17:20:21.546924    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b008697_9612_410f_83ee_93b5b25849a3.slice/crio-cadda710ecdb370f380675a846ea75df7c8f4e853d54a93060107c018bc43b8c WatchSource:0}: Error finding container cadda710ecdb370f380675a846ea75df7c8f4e853d54a93060107c018bc43b8c: Status 404 returned error can't find the container with id cadda710ecdb370f380675a846ea75df7c8f4e853d54a93060107c018bc43b8c
Sep 18 17:20:22.490102 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:22.490061    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd" event={"ID":"8b008697-9612-410f-83ee-93b5b25849a3","Type":"ContainerStarted","Data":"0f2518a715777b3abcae0fcb620000a473520f208df844d575d0311da71674ce"}
Sep 18 17:20:22.490333 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:22.490120    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd" event={"ID":"8b008697-9612-410f-83ee-93b5b25849a3","Type":"ContainerStarted","Data":"cadda710ecdb370f380675a846ea75df7c8f4e853d54a93060107c018bc43b8c"}
Sep 18 17:20:22.490333 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:22.490161    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"
Sep 18 17:20:22.507498 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:22.507318    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd" podStartSLOduration=2.507297115 podStartE2EDuration="2.507297115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:20:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:20:22.506965213 +0000 UTC m=+1873.232246958" watchObservedRunningTime="2026-09-18 17:20:22.507297115 +0000 UTC m=+1873.232578862"
Sep 18 17:20:28.503156 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:28.503123    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"
Sep 18 17:20:51.508856 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:51.508801    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:20:51.517798 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:51.517759    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"]
Sep 18 17:20:51.520763 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:51.520742    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"
Sep 18 17:20:51.523175 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:51.523150    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-792b5-kube-rbac-proxy-sar-config\""
Sep 18 17:20:51.523331 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:51.523149    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-792b5-serving-cert\""
Sep 18 17:20:51.530960 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:51.530931    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"]
Sep 18 17:20:51.680522 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:51.680476    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/431670db-f2f5-4c41-a83f-6e51c6521a3e-openshift-service-ca-bundle\") pod \"sequence-graph-792b5-6df85cc95c-krkc5\" (UID: \"431670db-f2f5-4c41-a83f-6e51c6521a3e\") " pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"
Sep 18 17:20:51.680714 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:51.680538    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/431670db-f2f5-4c41-a83f-6e51c6521a3e-proxy-tls\") pod \"sequence-graph-792b5-6df85cc95c-krkc5\" (UID: \"431670db-f2f5-4c41-a83f-6e51c6521a3e\") " pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"
Sep 18 17:20:51.781227 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:51.781138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/431670db-f2f5-4c41-a83f-6e51c6521a3e-openshift-service-ca-bundle\") pod \"sequence-graph-792b5-6df85cc95c-krkc5\" (UID: \"431670db-f2f5-4c41-a83f-6e51c6521a3e\") " pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"
Sep 18 17:20:51.781227 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:51.781201    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/431670db-f2f5-4c41-a83f-6e51c6521a3e-proxy-tls\") pod \"sequence-graph-792b5-6df85cc95c-krkc5\" (UID: \"431670db-f2f5-4c41-a83f-6e51c6521a3e\") " pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"
Sep 18 17:20:51.781404 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:20:51.781308    2583 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-792b5-serving-cert: secret "sequence-graph-792b5-serving-cert" not found
Sep 18 17:20:51.781404 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:20:51.781401    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/431670db-f2f5-4c41-a83f-6e51c6521a3e-proxy-tls podName:431670db-f2f5-4c41-a83f-6e51c6521a3e nodeName:}" failed. No retries permitted until 2026-09-18 17:20:52.281379972 +0000 UTC m=+1903.006661704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/431670db-f2f5-4c41-a83f-6e51c6521a3e-proxy-tls") pod "sequence-graph-792b5-6df85cc95c-krkc5" (UID: "431670db-f2f5-4c41-a83f-6e51c6521a3e") : secret "sequence-graph-792b5-serving-cert" not found
Sep 18 17:20:51.781800 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:51.781776    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/431670db-f2f5-4c41-a83f-6e51c6521a3e-openshift-service-ca-bundle\") pod \"sequence-graph-792b5-6df85cc95c-krkc5\" (UID: \"431670db-f2f5-4c41-a83f-6e51c6521a3e\") " pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"
Sep 18 17:20:52.030892 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:52.030846    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:20:52.285423 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:52.285381    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/431670db-f2f5-4c41-a83f-6e51c6521a3e-proxy-tls\") pod \"sequence-graph-792b5-6df85cc95c-krkc5\" (UID: \"431670db-f2f5-4c41-a83f-6e51c6521a3e\") " pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"
Sep 18 17:20:52.288054 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:52.288033    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/431670db-f2f5-4c41-a83f-6e51c6521a3e-proxy-tls\") pod \"sequence-graph-792b5-6df85cc95c-krkc5\" (UID: \"431670db-f2f5-4c41-a83f-6e51c6521a3e\") " pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"
Sep 18 17:20:52.431295 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:52.431237    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"
Sep 18 17:20:52.722093 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:52.722059    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"]
Sep 18 17:20:52.725644 ip-10-0-142-7 kubenswrapper[2583]: W0918 17:20:52.725613    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod431670db_f2f5_4c41_a83f_6e51c6521a3e.slice/crio-08a0e6b2bbf2d08d21057cf1a2ff52767a8f335686a39187ee1bf0331a31183e WatchSource:0}: Error finding container 08a0e6b2bbf2d08d21057cf1a2ff52767a8f335686a39187ee1bf0331a31183e: Status 404 returned error can't find the container with id 08a0e6b2bbf2d08d21057cf1a2ff52767a8f335686a39187ee1bf0331a31183e
Sep 18 17:20:53.613928 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:53.613891    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5" event={"ID":"431670db-f2f5-4c41-a83f-6e51c6521a3e","Type":"ContainerStarted","Data":"7d9fedbe09ddd89063906a4b4947b602bcd7a76550cd6c8abdc755ead41b81c3"}
Sep 18 17:20:53.614115 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:53.613952    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5" event={"ID":"431670db-f2f5-4c41-a83f-6e51c6521a3e","Type":"ContainerStarted","Data":"08a0e6b2bbf2d08d21057cf1a2ff52767a8f335686a39187ee1bf0331a31183e"}
Sep 18 17:20:53.614115 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:53.614066    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"
Sep 18 17:20:53.636797 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:53.636741    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5" podStartSLOduration=2.6367157580000002 podStartE2EDuration="2.636715758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:20:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:20:53.634571674 +0000 UTC m=+1904.359853421" watchObservedRunningTime="2026-09-18 17:20:53.636715758 +0000 UTC m=+1904.361997565"
Sep 18 17:20:59.624996 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:20:59.624964    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"
Sep 18 17:23:03.993744 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:23:03.993707    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:23:04.075862 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:23:04.075828    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:24:11.523269 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:24:11.523238    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:24:11.525687 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:24:11.525661    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:24:11.527138 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:24:11.527117    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:24:11.529606 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:24:11.529590    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:27:50.659672 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:27:50.659590    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:28:35.570193 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:28:35.570152    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"]
Sep 18 17:28:35.572745 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:28:35.570376    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd" podUID="8b008697-9612-410f-83ee-93b5b25849a3" containerName="ensemble-graph-cca0b" containerID="cri-o://0f2518a715777b3abcae0fcb620000a473520f208df844d575d0311da71674ce" gracePeriod=30
Sep 18 17:28:35.603099 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:28:35.603067    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:28:35.741854 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:28:35.741771    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:28:35.836987 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:28:35.836894    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:28:35.908789 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:28:35.908754    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:28:35.972308 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:28:35.972271    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:28:36.329691 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:28:36.329655    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:28:36.440425 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:28:36.440390    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:28:38.501592 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:28:38.501544    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd" podUID="8b008697-9612-410f-83ee-93b5b25849a3" containerName="ensemble-graph-cca0b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:28:43.501564 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:28:43.501524    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd" podUID="8b008697-9612-410f-83ee-93b5b25849a3" containerName="ensemble-graph-cca0b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:28:48.501501 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:28:48.501460    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd" podUID="8b008697-9612-410f-83ee-93b5b25849a3" containerName="ensemble-graph-cca0b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:28:48.502020 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:28:48.501582    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"
Sep 18 17:28:53.501264 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:28:53.501222    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd" podUID="8b008697-9612-410f-83ee-93b5b25849a3" containerName="ensemble-graph-cca0b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:28:58.501585 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:28:58.501547    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd" podUID="8b008697-9612-410f-83ee-93b5b25849a3" containerName="ensemble-graph-cca0b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:29:03.501731 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:03.501691    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd" podUID="8b008697-9612-410f-83ee-93b5b25849a3" containerName="ensemble-graph-cca0b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:29:05.757943 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:05.757908    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"
Sep 18 17:29:05.824617 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:05.824508    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8b008697-9612-410f-83ee-93b5b25849a3-proxy-tls\") pod \"8b008697-9612-410f-83ee-93b5b25849a3\" (UID: \"8b008697-9612-410f-83ee-93b5b25849a3\") "
Sep 18 17:29:05.824617 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:05.824594    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b008697-9612-410f-83ee-93b5b25849a3-openshift-service-ca-bundle\") pod \"8b008697-9612-410f-83ee-93b5b25849a3\" (UID: \"8b008697-9612-410f-83ee-93b5b25849a3\") "
Sep 18 17:29:05.825017 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:05.824988    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b008697-9612-410f-83ee-93b5b25849a3-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "8b008697-9612-410f-83ee-93b5b25849a3" (UID: "8b008697-9612-410f-83ee-93b5b25849a3"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:29:05.826988 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:05.826948    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b008697-9612-410f-83ee-93b5b25849a3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8b008697-9612-410f-83ee-93b5b25849a3" (UID: "8b008697-9612-410f-83ee-93b5b25849a3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:29:05.926247 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:05.926203    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8b008697-9612-410f-83ee-93b5b25849a3-proxy-tls\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:29:05.926247 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:05.926237    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b008697-9612-410f-83ee-93b5b25849a3-openshift-service-ca-bundle\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:29:06.530713 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:06.530668    2583 generic.go:356] "Generic (PLEG): container finished" podID="8b008697-9612-410f-83ee-93b5b25849a3" containerID="0f2518a715777b3abcae0fcb620000a473520f208df844d575d0311da71674ce" exitCode=0
Sep 18 17:29:06.531032 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:06.530715    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd" event={"ID":"8b008697-9612-410f-83ee-93b5b25849a3","Type":"ContainerDied","Data":"0f2518a715777b3abcae0fcb620000a473520f208df844d575d0311da71674ce"}
Sep 18 17:29:06.531032 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:06.530752    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"
Sep 18 17:29:06.531032 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:06.530778    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd" event={"ID":"8b008697-9612-410f-83ee-93b5b25849a3","Type":"ContainerDied","Data":"cadda710ecdb370f380675a846ea75df7c8f4e853d54a93060107c018bc43b8c"}
Sep 18 17:29:06.531032 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:06.530801    2583 scope.go:117] "RemoveContainer" containerID="0f2518a715777b3abcae0fcb620000a473520f208df844d575d0311da71674ce"
Sep 18 17:29:06.540238 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:06.540217    2583 scope.go:117] "RemoveContainer" containerID="0f2518a715777b3abcae0fcb620000a473520f208df844d575d0311da71674ce"
Sep 18 17:29:06.540620 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:29:06.540597    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f2518a715777b3abcae0fcb620000a473520f208df844d575d0311da71674ce\": container with ID starting with 0f2518a715777b3abcae0fcb620000a473520f208df844d575d0311da71674ce not found: ID does not exist" containerID="0f2518a715777b3abcae0fcb620000a473520f208df844d575d0311da71674ce"
Sep 18 17:29:06.540720 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:06.540627    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f2518a715777b3abcae0fcb620000a473520f208df844d575d0311da71674ce"} err="failed to get container status \"0f2518a715777b3abcae0fcb620000a473520f208df844d575d0311da71674ce\": rpc error: code = NotFound desc = could not find container \"0f2518a715777b3abcae0fcb620000a473520f208df844d575d0311da71674ce\": container with ID starting with 0f2518a715777b3abcae0fcb620000a473520f208df844d575d0311da71674ce not found: ID does not exist"
Sep 18 17:29:06.559971 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:06.559934    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"]
Sep 18 17:29:06.565674 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:06.565642    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-cca0b-846df546c8-8p7wd"]
Sep 18 17:29:06.624794 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:06.624756    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"]
Sep 18 17:29:06.625093 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:06.625060    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5" podUID="431670db-f2f5-4c41-a83f-6e51c6521a3e" containerName="sequence-graph-792b5" containerID="cri-o://7d9fedbe09ddd89063906a4b4947b602bcd7a76550cd6c8abdc755ead41b81c3" gracePeriod=30
Sep 18 17:29:06.679749 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:06.679708    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:29:06.851212 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:06.851127    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:29:06.988397 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:06.988367    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:29:07.156897 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:07.156858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:29:07.326272 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:07.326242    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:29:07.426622 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:07.426526    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:29:07.464037 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:07.464011    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b008697-9612-410f-83ee-93b5b25849a3" path="/var/lib/kubelet/pods/8b008697-9612-410f-83ee-93b5b25849a3/volumes"
Sep 18 17:29:09.623115 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:09.623077    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5" podUID="431670db-f2f5-4c41-a83f-6e51c6521a3e" containerName="sequence-graph-792b5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:29:11.547196 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:11.547155    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:29:11.549823 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:11.549784    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:29:11.552729 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:11.552707    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:29:11.555342 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:11.555320    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:29:14.622894 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:14.622849    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5" podUID="431670db-f2f5-4c41-a83f-6e51c6521a3e" containerName="sequence-graph-792b5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:29:19.622880 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:19.622840    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5" podUID="431670db-f2f5-4c41-a83f-6e51c6521a3e" containerName="sequence-graph-792b5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:29:19.623265 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:19.622975    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"
Sep 18 17:29:24.622528 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:24.622439    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5" podUID="431670db-f2f5-4c41-a83f-6e51c6521a3e" containerName="sequence-graph-792b5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:29:29.622599 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:29.622556    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5" podUID="431670db-f2f5-4c41-a83f-6e51c6521a3e" containerName="sequence-graph-792b5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:29:34.622885 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:34.622841    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5" podUID="431670db-f2f5-4c41-a83f-6e51c6521a3e" containerName="sequence-graph-792b5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:29:36.789782 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:36.789746    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"
Sep 18 17:29:36.879902 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:36.879775    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/431670db-f2f5-4c41-a83f-6e51c6521a3e-openshift-service-ca-bundle\") pod \"431670db-f2f5-4c41-a83f-6e51c6521a3e\" (UID: \"431670db-f2f5-4c41-a83f-6e51c6521a3e\") "
Sep 18 17:29:36.879902 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:36.879861    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/431670db-f2f5-4c41-a83f-6e51c6521a3e-proxy-tls\") pod \"431670db-f2f5-4c41-a83f-6e51c6521a3e\" (UID: \"431670db-f2f5-4c41-a83f-6e51c6521a3e\") "
Sep 18 17:29:36.880202 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:36.880177    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/431670db-f2f5-4c41-a83f-6e51c6521a3e-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "431670db-f2f5-4c41-a83f-6e51c6521a3e" (UID: "431670db-f2f5-4c41-a83f-6e51c6521a3e"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:29:36.882169 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:36.882133    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/431670db-f2f5-4c41-a83f-6e51c6521a3e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "431670db-f2f5-4c41-a83f-6e51c6521a3e" (UID: "431670db-f2f5-4c41-a83f-6e51c6521a3e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:29:36.981264 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:36.981221    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/431670db-f2f5-4c41-a83f-6e51c6521a3e-proxy-tls\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:29:36.981264 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:36.981256    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/431670db-f2f5-4c41-a83f-6e51c6521a3e-openshift-service-ca-bundle\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:29:37.647880 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:37.647799    2583 generic.go:356] "Generic (PLEG): container finished" podID="431670db-f2f5-4c41-a83f-6e51c6521a3e" containerID="7d9fedbe09ddd89063906a4b4947b602bcd7a76550cd6c8abdc755ead41b81c3" exitCode=0
Sep 18 17:29:37.647880 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:37.647858    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"
Sep 18 17:29:37.647880 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:37.647852    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5" event={"ID":"431670db-f2f5-4c41-a83f-6e51c6521a3e","Type":"ContainerDied","Data":"7d9fedbe09ddd89063906a4b4947b602bcd7a76550cd6c8abdc755ead41b81c3"}
Sep 18 17:29:37.648212 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:37.647924    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5" event={"ID":"431670db-f2f5-4c41-a83f-6e51c6521a3e","Type":"ContainerDied","Data":"08a0e6b2bbf2d08d21057cf1a2ff52767a8f335686a39187ee1bf0331a31183e"}
Sep 18 17:29:37.648212 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:37.647948    2583 scope.go:117] "RemoveContainer" containerID="7d9fedbe09ddd89063906a4b4947b602bcd7a76550cd6c8abdc755ead41b81c3"
Sep 18 17:29:37.656402 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:37.656381    2583 scope.go:117] "RemoveContainer" containerID="7d9fedbe09ddd89063906a4b4947b602bcd7a76550cd6c8abdc755ead41b81c3"
Sep 18 17:29:37.656729 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:29:37.656705    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d9fedbe09ddd89063906a4b4947b602bcd7a76550cd6c8abdc755ead41b81c3\": container with ID starting with 7d9fedbe09ddd89063906a4b4947b602bcd7a76550cd6c8abdc755ead41b81c3 not found: ID does not exist" containerID="7d9fedbe09ddd89063906a4b4947b602bcd7a76550cd6c8abdc755ead41b81c3"
Sep 18 17:29:37.656869 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:37.656740    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d9fedbe09ddd89063906a4b4947b602bcd7a76550cd6c8abdc755ead41b81c3"} err="failed to get container status \"7d9fedbe09ddd89063906a4b4947b602bcd7a76550cd6c8abdc755ead41b81c3\": rpc error: code = NotFound desc = could not find container \"7d9fedbe09ddd89063906a4b4947b602bcd7a76550cd6c8abdc755ead41b81c3\": container with ID starting with 7d9fedbe09ddd89063906a4b4947b602bcd7a76550cd6c8abdc755ead41b81c3 not found: ID does not exist"
Sep 18 17:29:37.665604 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:37.665567    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"]
Sep 18 17:29:37.669937 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:37.669906    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-792b5-6df85cc95c-krkc5"]
Sep 18 17:29:39.463926 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:39.463891    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="431670db-f2f5-4c41-a83f-6e51c6521a3e" path="/var/lib/kubelet/pods/431670db-f2f5-4c41-a83f-6e51c6521a3e/volumes"
Sep 18 17:29:45.845786 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:45.845696    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"]
Sep 18 17:29:45.846179 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:45.846124    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="431670db-f2f5-4c41-a83f-6e51c6521a3e" containerName="sequence-graph-792b5"
Sep 18 17:29:45.846179 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:45.846139    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="431670db-f2f5-4c41-a83f-6e51c6521a3e" containerName="sequence-graph-792b5"
Sep 18 17:29:45.846179 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:45.846157    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b008697-9612-410f-83ee-93b5b25849a3" containerName="ensemble-graph-cca0b"
Sep 18 17:29:45.846179 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:45.846164    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b008697-9612-410f-83ee-93b5b25849a3" containerName="ensemble-graph-cca0b"
Sep 18 17:29:45.846317 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:45.846218    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b008697-9612-410f-83ee-93b5b25849a3" containerName="ensemble-graph-cca0b"
Sep 18 17:29:45.846317 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:45.846229    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="431670db-f2f5-4c41-a83f-6e51c6521a3e" containerName="sequence-graph-792b5"
Sep 18 17:29:45.850417 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:45.850396    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"
Sep 18 17:29:45.852390 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:45.852359    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-97cfm\""
Sep 18 17:29:45.852538 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:45.852426    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-054ab-kube-rbac-proxy-sar-config\""
Sep 18 17:29:45.852891 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:45.852873    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-054ab-serving-cert\""
Sep 18 17:29:45.852982 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:45.852881    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 18 17:29:45.858201 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:45.858174    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"]
Sep 18 17:29:45.884864 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:45.884826    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:29:45.954132 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:45.954093    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/da82e16f-de62-41ee-be99-14405245f091-proxy-tls\") pod \"splitter-graph-054ab-78f7d487d-zqdpd\" (UID: \"da82e16f-de62-41ee-be99-14405245f091\") " pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"
Sep 18 17:29:45.954326 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:45.954221    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da82e16f-de62-41ee-be99-14405245f091-openshift-service-ca-bundle\") pod \"splitter-graph-054ab-78f7d487d-zqdpd\" (UID: \"da82e16f-de62-41ee-be99-14405245f091\") " pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"
Sep 18 17:29:46.055710 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:46.055662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da82e16f-de62-41ee-be99-14405245f091-openshift-service-ca-bundle\") pod \"splitter-graph-054ab-78f7d487d-zqdpd\" (UID: \"da82e16f-de62-41ee-be99-14405245f091\") " pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"
Sep 18 17:29:46.055710 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:46.055718    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/da82e16f-de62-41ee-be99-14405245f091-proxy-tls\") pod \"splitter-graph-054ab-78f7d487d-zqdpd\" (UID: \"da82e16f-de62-41ee-be99-14405245f091\") " pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"
Sep 18 17:29:46.056483 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:46.056451    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da82e16f-de62-41ee-be99-14405245f091-openshift-service-ca-bundle\") pod \"splitter-graph-054ab-78f7d487d-zqdpd\" (UID: \"da82e16f-de62-41ee-be99-14405245f091\") " pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"
Sep 18 17:29:46.057793 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:46.057763    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:29:46.058673 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:46.058655    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/da82e16f-de62-41ee-be99-14405245f091-proxy-tls\") pod \"splitter-graph-054ab-78f7d487d-zqdpd\" (UID: \"da82e16f-de62-41ee-be99-14405245f091\") " pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"
Sep 18 17:29:46.161972 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:46.161933    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"
Sep 18 17:29:46.437551 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:46.437467    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"]
Sep 18 17:29:46.440207 ip-10-0-142-7 kubenswrapper[2583]: W0918 17:29:46.440176    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda82e16f_de62_41ee_be99_14405245f091.slice/crio-41283fc8654039bdd5b53f5ee48a51b08b4e4105b157f799b79ceda8b41d3f78 WatchSource:0}: Error finding container 41283fc8654039bdd5b53f5ee48a51b08b4e4105b157f799b79ceda8b41d3f78: Status 404 returned error can't find the container with id 41283fc8654039bdd5b53f5ee48a51b08b4e4105b157f799b79ceda8b41d3f78
Sep 18 17:29:46.684264 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:46.684222    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd" event={"ID":"da82e16f-de62-41ee-be99-14405245f091","Type":"ContainerStarted","Data":"37d003671a0ec5679ce259566d2aa3fcc28be21a5b997ee30c7d017226664055"}
Sep 18 17:29:46.684443 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:46.684286    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd" event={"ID":"da82e16f-de62-41ee-be99-14405245f091","Type":"ContainerStarted","Data":"41283fc8654039bdd5b53f5ee48a51b08b4e4105b157f799b79ceda8b41d3f78"}
Sep 18 17:29:46.684443 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:46.684337    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"
Sep 18 17:29:46.700383 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:46.700255    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd" podStartSLOduration=1.700234593 podStartE2EDuration="1.700234593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:29:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:29:46.699385503 +0000 UTC m=+2437.424667248" watchObservedRunningTime="2026-09-18 17:29:46.700234593 +0000 UTC m=+2437.425516340"
Sep 18 17:29:52.693645 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:52.693613    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"
Sep 18 17:29:56.775107 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:56.775066    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"]
Sep 18 17:29:56.775500 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:56.775278    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd" podUID="da82e16f-de62-41ee-be99-14405245f091" containerName="splitter-graph-054ab" containerID="cri-o://37d003671a0ec5679ce259566d2aa3fcc28be21a5b997ee30c7d017226664055" gracePeriod=30
Sep 18 17:29:56.822717 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:56.822659    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:29:57.017491 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:57.017462    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:29:57.189295 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:57.189254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:29:57.422956 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:57.422920    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:29:57.692068 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:29:57.692016    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd" podUID="da82e16f-de62-41ee-be99-14405245f091" containerName="splitter-graph-054ab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:30:02.692578 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:02.692535    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd" podUID="da82e16f-de62-41ee-be99-14405245f091" containerName="splitter-graph-054ab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:30:07.692359 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:07.692317    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd" podUID="da82e16f-de62-41ee-be99-14405245f091" containerName="splitter-graph-054ab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:30:07.692779 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:07.692451    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"
Sep 18 17:30:12.691491 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:12.691444    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd" podUID="da82e16f-de62-41ee-be99-14405245f091" containerName="splitter-graph-054ab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:30:16.860631 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:16.860590    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"]
Sep 18 17:30:16.864825 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:16.864795    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"
Sep 18 17:30:16.867287 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:16.867256    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-0cb05-serving-cert\""
Sep 18 17:30:16.867430 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:16.867270    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-0cb05-kube-rbac-proxy-sar-config\""
Sep 18 17:30:16.874496 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:16.874464    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"]
Sep 18 17:30:16.885089 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:16.885059    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:30:16.899470 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:16.899439    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1d04580a-981a-41a6-b07e-9434bcd507eb-proxy-tls\") pod \"switch-graph-0cb05-676d55bd6d-klj8m\" (UID: \"1d04580a-981a-41a6-b07e-9434bcd507eb\") " pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"
Sep 18 17:30:16.899641 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:16.899547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d04580a-981a-41a6-b07e-9434bcd507eb-openshift-service-ca-bundle\") pod \"switch-graph-0cb05-676d55bd6d-klj8m\" (UID: \"1d04580a-981a-41a6-b07e-9434bcd507eb\") " pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"
Sep 18 17:30:17.000246 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:17.000197    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d04580a-981a-41a6-b07e-9434bcd507eb-openshift-service-ca-bundle\") pod \"switch-graph-0cb05-676d55bd6d-klj8m\" (UID: \"1d04580a-981a-41a6-b07e-9434bcd507eb\") " pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"
Sep 18 17:30:17.000431 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:17.000260    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1d04580a-981a-41a6-b07e-9434bcd507eb-proxy-tls\") pod \"switch-graph-0cb05-676d55bd6d-klj8m\" (UID: \"1d04580a-981a-41a6-b07e-9434bcd507eb\") " pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"
Sep 18 17:30:17.000431 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:30:17.000386    2583 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-0cb05-serving-cert: secret "switch-graph-0cb05-serving-cert" not found
Sep 18 17:30:17.000506 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:30:17.000442    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d04580a-981a-41a6-b07e-9434bcd507eb-proxy-tls podName:1d04580a-981a-41a6-b07e-9434bcd507eb nodeName:}" failed. No retries permitted until 2026-09-18 17:30:17.500425845 +0000 UTC m=+2468.225707582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/1d04580a-981a-41a6-b07e-9434bcd507eb-proxy-tls") pod "switch-graph-0cb05-676d55bd6d-klj8m" (UID: "1d04580a-981a-41a6-b07e-9434bcd507eb") : secret "switch-graph-0cb05-serving-cert" not found
Sep 18 17:30:17.000890 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:17.000870    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d04580a-981a-41a6-b07e-9434bcd507eb-openshift-service-ca-bundle\") pod \"switch-graph-0cb05-676d55bd6d-klj8m\" (UID: \"1d04580a-981a-41a6-b07e-9434bcd507eb\") " pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"
Sep 18 17:30:17.241710 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:17.241671    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:30:17.505358 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:17.505244    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1d04580a-981a-41a6-b07e-9434bcd507eb-proxy-tls\") pod \"switch-graph-0cb05-676d55bd6d-klj8m\" (UID: \"1d04580a-981a-41a6-b07e-9434bcd507eb\") " pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"
Sep 18 17:30:17.508051 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:17.508019    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1d04580a-981a-41a6-b07e-9434bcd507eb-proxy-tls\") pod \"switch-graph-0cb05-676d55bd6d-klj8m\" (UID: \"1d04580a-981a-41a6-b07e-9434bcd507eb\") " pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"
Sep 18 17:30:17.692320 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:17.692275    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd" podUID="da82e16f-de62-41ee-be99-14405245f091" containerName="splitter-graph-054ab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:30:17.775409 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:17.775306    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"
Sep 18 17:30:18.049719 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:18.049690    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"]
Sep 18 17:30:18.052518 ip-10-0-142-7 kubenswrapper[2583]: W0918 17:30:18.052488    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d04580a_981a_41a6_b07e_9434bcd507eb.slice/crio-497b80a42bfc21b13dea611ad5b109d3ec18295076470d905043a8317ef09c24 WatchSource:0}: Error finding container 497b80a42bfc21b13dea611ad5b109d3ec18295076470d905043a8317ef09c24: Status 404 returned error can't find the container with id 497b80a42bfc21b13dea611ad5b109d3ec18295076470d905043a8317ef09c24
Sep 18 17:30:18.805483 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:18.805445    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m" event={"ID":"1d04580a-981a-41a6-b07e-9434bcd507eb","Type":"ContainerStarted","Data":"537aaad1593f6b9638c838315d69ad7e74beda2d1aea4ec8354c561e74ce7920"}
Sep 18 17:30:18.805694 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:18.805497    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m" event={"ID":"1d04580a-981a-41a6-b07e-9434bcd507eb","Type":"ContainerStarted","Data":"497b80a42bfc21b13dea611ad5b109d3ec18295076470d905043a8317ef09c24"}
Sep 18 17:30:18.805694 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:18.805547    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"
Sep 18 17:30:18.823131 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:18.823075    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m" podStartSLOduration=2.823054538 podStartE2EDuration="2.823054538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:30:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:30:18.822087708 +0000 UTC m=+2469.547369458" watchObservedRunningTime="2026-09-18 17:30:18.823054538 +0000 UTC m=+2469.548336284"
Sep 18 17:30:22.691745 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:22.691699    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd" podUID="da82e16f-de62-41ee-be99-14405245f091" containerName="splitter-graph-054ab" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:30:24.814943 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:24.814913    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"
Sep 18 17:30:26.838245 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:26.838207    2583 generic.go:356] "Generic (PLEG): container finished" podID="da82e16f-de62-41ee-be99-14405245f091" containerID="37d003671a0ec5679ce259566d2aa3fcc28be21a5b997ee30c7d017226664055" exitCode=0
Sep 18 17:30:26.838612 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:26.838273    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd" event={"ID":"da82e16f-de62-41ee-be99-14405245f091","Type":"ContainerDied","Data":"37d003671a0ec5679ce259566d2aa3fcc28be21a5b997ee30c7d017226664055"}
Sep 18 17:30:26.935383 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:26.935352    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"
Sep 18 17:30:26.984125 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:26.984085    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da82e16f-de62-41ee-be99-14405245f091-openshift-service-ca-bundle\") pod \"da82e16f-de62-41ee-be99-14405245f091\" (UID: \"da82e16f-de62-41ee-be99-14405245f091\") "
Sep 18 17:30:26.984125 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:26.984130    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/da82e16f-de62-41ee-be99-14405245f091-proxy-tls\") pod \"da82e16f-de62-41ee-be99-14405245f091\" (UID: \"da82e16f-de62-41ee-be99-14405245f091\") "
Sep 18 17:30:26.984482 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:26.984456    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da82e16f-de62-41ee-be99-14405245f091-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "da82e16f-de62-41ee-be99-14405245f091" (UID: "da82e16f-de62-41ee-be99-14405245f091"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:30:26.986474 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:26.986448    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da82e16f-de62-41ee-be99-14405245f091-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "da82e16f-de62-41ee-be99-14405245f091" (UID: "da82e16f-de62-41ee-be99-14405245f091"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:30:27.084843 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:27.084728    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da82e16f-de62-41ee-be99-14405245f091-openshift-service-ca-bundle\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:30:27.084843 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:27.084760    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/da82e16f-de62-41ee-be99-14405245f091-proxy-tls\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:30:27.843005 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:27.842916    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd" event={"ID":"da82e16f-de62-41ee-be99-14405245f091","Type":"ContainerDied","Data":"41283fc8654039bdd5b53f5ee48a51b08b4e4105b157f799b79ceda8b41d3f78"}
Sep 18 17:30:27.843005 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:27.842931    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"
Sep 18 17:30:27.843005 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:27.842978    2583 scope.go:117] "RemoveContainer" containerID="37d003671a0ec5679ce259566d2aa3fcc28be21a5b997ee30c7d017226664055"
Sep 18 17:30:27.875141 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:27.875104    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"]
Sep 18 17:30:27.878609 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:27.878580    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-054ab-78f7d487d-zqdpd"]
Sep 18 17:30:29.464166 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:29.464133    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da82e16f-de62-41ee-be99-14405245f091" path="/var/lib/kubelet/pods/da82e16f-de62-41ee-be99-14405245f091/volumes"
Sep 18 17:30:52.226028 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:30:52.225943    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:31:07.051006 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.050964    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"]
Sep 18 17:31:07.051415 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.051264    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da82e16f-de62-41ee-be99-14405245f091" containerName="splitter-graph-054ab"
Sep 18 17:31:07.051415 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.051276    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="da82e16f-de62-41ee-be99-14405245f091" containerName="splitter-graph-054ab"
Sep 18 17:31:07.051415 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.051326    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="da82e16f-de62-41ee-be99-14405245f091" containerName="splitter-graph-054ab"
Sep 18 17:31:07.054108 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.054080    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"
Sep 18 17:31:07.061564 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.061537    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-f0fb0-serving-cert\""
Sep 18 17:31:07.062329 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.062305    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-f0fb0-kube-rbac-proxy-sar-config\""
Sep 18 17:31:07.080105 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.080071    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"]
Sep 18 17:31:07.097830 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.097769    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:31:07.114717 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.114687    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff-openshift-service-ca-bundle\") pod \"splitter-graph-f0fb0-64569c6dcf-vjfj9\" (UID: \"0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff\") " pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"
Sep 18 17:31:07.114906 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.114737    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff-proxy-tls\") pod \"splitter-graph-f0fb0-64569c6dcf-vjfj9\" (UID: \"0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff\") " pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"
Sep 18 17:31:07.215173 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.215126    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff-openshift-service-ca-bundle\") pod \"splitter-graph-f0fb0-64569c6dcf-vjfj9\" (UID: \"0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff\") " pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"
Sep 18 17:31:07.215357 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.215200    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff-proxy-tls\") pod \"splitter-graph-f0fb0-64569c6dcf-vjfj9\" (UID: \"0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff\") " pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"
Sep 18 17:31:07.215357 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:31:07.215327    2583 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-f0fb0-serving-cert: secret "splitter-graph-f0fb0-serving-cert" not found
Sep 18 17:31:07.215438 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:31:07.215398    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff-proxy-tls podName:0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff nodeName:}" failed. No retries permitted until 2026-09-18 17:31:07.715380833 +0000 UTC m=+2518.440662562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff-proxy-tls") pod "splitter-graph-f0fb0-64569c6dcf-vjfj9" (UID: "0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff") : secret "splitter-graph-f0fb0-serving-cert" not found
Sep 18 17:31:07.215761 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.215741    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff-openshift-service-ca-bundle\") pod \"splitter-graph-f0fb0-64569c6dcf-vjfj9\" (UID: \"0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff\") " pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"
Sep 18 17:31:07.305038 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.304934    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:31:07.718586 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.718534    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff-proxy-tls\") pod \"splitter-graph-f0fb0-64569c6dcf-vjfj9\" (UID: \"0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff\") " pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"
Sep 18 17:31:07.721202 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.721175    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff-proxy-tls\") pod \"splitter-graph-f0fb0-64569c6dcf-vjfj9\" (UID: \"0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff\") " pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"
Sep 18 17:31:07.964672 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:07.964629    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"
Sep 18 17:31:08.238586 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:08.238559    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"]
Sep 18 17:31:08.240689 ip-10-0-142-7 kubenswrapper[2583]: W0918 17:31:08.240661    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb3ae7c_aa0e_408f_a6e2_890dcaa839ff.slice/crio-c677bf5e95288a4f54c6dcc7498be2e8795160f7001abac05d70219bef1af263 WatchSource:0}: Error finding container c677bf5e95288a4f54c6dcc7498be2e8795160f7001abac05d70219bef1af263: Status 404 returned error can't find the container with id c677bf5e95288a4f54c6dcc7498be2e8795160f7001abac05d70219bef1af263
Sep 18 17:31:09.006008 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:09.005968    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9" event={"ID":"0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff","Type":"ContainerStarted","Data":"da401ca1288782d15140587a57d538ad99d7cb2119340f119d594496e9dbcd56"}
Sep 18 17:31:09.006196 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:09.006023    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9" event={"ID":"0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff","Type":"ContainerStarted","Data":"c677bf5e95288a4f54c6dcc7498be2e8795160f7001abac05d70219bef1af263"}
Sep 18 17:31:09.006196 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:09.006097    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"
Sep 18 17:31:09.022495 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:09.022417    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9" podStartSLOduration=2.022394116 podStartE2EDuration="2.022394116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:31:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:31:09.021688287 +0000 UTC m=+2519.746970034" watchObservedRunningTime="2026-09-18 17:31:09.022394116 +0000 UTC m=+2519.747675897"
Sep 18 17:31:15.015664 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:31:15.015633    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"
Sep 18 17:34:11.572418 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:34:11.572386    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:34:11.574900 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:34:11.574876    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:34:11.577967 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:34:11.577942    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:34:11.580541 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:34:11.580520    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:35:40.846032 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:35:40.845951    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:37:53.394398 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:37:53.394357    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:39:11.596208 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:11.596177    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:39:11.598954 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:11.598936    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:39:11.602715 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:11.602693    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:39:11.605139 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:11.605121    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:39:21.917652 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:21.917617    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"]
Sep 18 17:39:21.918163 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:21.917843    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9" podUID="0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff" containerName="splitter-graph-f0fb0" containerID="cri-o://da401ca1288782d15140587a57d538ad99d7cb2119340f119d594496e9dbcd56" gracePeriod=30
Sep 18 17:39:21.938221 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:21.938188    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:39:22.086229 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:22.086192    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:39:22.179101 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:22.179013    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:39:25.014529 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:25.014488    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9" podUID="0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff" containerName="splitter-graph-f0fb0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:39:30.014084 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:30.014045    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9" podUID="0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff" containerName="splitter-graph-f0fb0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:39:35.015074 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:35.015028    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9" podUID="0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff" containerName="splitter-graph-f0fb0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:39:35.015549 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:35.015157    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"
Sep 18 17:39:40.015025 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:40.014973    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9" podUID="0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff" containerName="splitter-graph-f0fb0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:39:45.014866 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:45.014827    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9" podUID="0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff" containerName="splitter-graph-f0fb0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:39:50.014201 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:50.014152    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9" podUID="0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff" containerName="splitter-graph-f0fb0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:39:52.013592 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:52.013537    2583 generic.go:356] "Generic (PLEG): container finished" podID="0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff" containerID="da401ca1288782d15140587a57d538ad99d7cb2119340f119d594496e9dbcd56" exitCode=0
Sep 18 17:39:52.014021 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:52.013659    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9" event={"ID":"0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff","Type":"ContainerDied","Data":"da401ca1288782d15140587a57d538ad99d7cb2119340f119d594496e9dbcd56"}
Sep 18 17:39:52.073791 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:52.073761    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"
Sep 18 17:39:52.234296 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:52.234200    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff-openshift-service-ca-bundle\") pod \"0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff\" (UID: \"0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff\") "
Sep 18 17:39:52.234296 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:52.234251    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff-proxy-tls\") pod \"0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff\" (UID: \"0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff\") "
Sep 18 17:39:52.234579 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:52.234553    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff" (UID: "0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:39:52.236615 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:52.236589    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff" (UID: "0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:39:52.335036 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:52.334995    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff-openshift-service-ca-bundle\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:39:52.335036 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:52.335031    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff-proxy-tls\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:39:53.019381 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:53.019340    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"
Sep 18 17:39:53.019959 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:53.019347    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9" event={"ID":"0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff","Type":"ContainerDied","Data":"c677bf5e95288a4f54c6dcc7498be2e8795160f7001abac05d70219bef1af263"}
Sep 18 17:39:53.019959 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:53.019503    2583 scope.go:117] "RemoveContainer" containerID="da401ca1288782d15140587a57d538ad99d7cb2119340f119d594496e9dbcd56"
Sep 18 17:39:53.041403 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:53.041368    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"]
Sep 18 17:39:53.048284 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:53.048254    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-f0fb0-64569c6dcf-vjfj9"]
Sep 18 17:39:53.464189 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:39:53.464156    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff" path="/var/lib/kubelet/pods/0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff/volumes"
Sep 18 17:43:14.404801 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:43:14.404717    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:44:11.626340 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:44:11.626304    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:44:11.628777 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:44:11.628761    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:44:11.633742 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:44:11.633719    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:44:11.636226 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:44:11.636205    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:46:36.997302 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:36.997260    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"]
Sep 18 17:46:36.997890 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:36.997565    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m" podUID="1d04580a-981a-41a6-b07e-9434bcd507eb" containerName="switch-graph-0cb05" containerID="cri-o://537aaad1593f6b9638c838315d69ad7e74beda2d1aea4ec8354c561e74ce7920" gracePeriod=30
Sep 18 17:46:37.054451 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:37.054418    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:46:37.160464 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:37.160413    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:46:37.233369 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:37.233335    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:46:38.215699 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.215659    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xgtxg/must-gather-lrwk9"]
Sep 18 17:46:38.216123 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.215991    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff" containerName="splitter-graph-f0fb0"
Sep 18 17:46:38.216123 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.216003    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff" containerName="splitter-graph-f0fb0"
Sep 18 17:46:38.216123 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.216079    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cb3ae7c-aa0e-408f-a6e2-890dcaa839ff" containerName="splitter-graph-f0fb0"
Sep 18 17:46:38.219189 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.219170    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xgtxg/must-gather-lrwk9"
Sep 18 17:46:38.221212 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.221186    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xgtxg\"/\"default-dockercfg-7hxbh\""
Sep 18 17:46:38.221335 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.221259    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xgtxg\"/\"openshift-service-ca.crt\""
Sep 18 17:46:38.221335 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.221198    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xgtxg\"/\"kube-root-ca.crt\""
Sep 18 17:46:38.227805 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.227777    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xgtxg/must-gather-lrwk9"]
Sep 18 17:46:38.233968 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.233943    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:46:38.278429 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.278388    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs82l\" (UniqueName: \"kubernetes.io/projected/450f98ed-b0a7-4e2a-9983-6cd2e857c4c9-kube-api-access-cs82l\") pod \"must-gather-lrwk9\" (UID: \"450f98ed-b0a7-4e2a-9983-6cd2e857c4c9\") " pod="openshift-must-gather-xgtxg/must-gather-lrwk9"
Sep 18 17:46:38.278429 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.278442    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/450f98ed-b0a7-4e2a-9983-6cd2e857c4c9-must-gather-output\") pod \"must-gather-lrwk9\" (UID: \"450f98ed-b0a7-4e2a-9983-6cd2e857c4c9\") " pod="openshift-must-gather-xgtxg/must-gather-lrwk9"
Sep 18 17:46:38.335853 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.335791    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:46:38.379153 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.379113    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs82l\" (UniqueName: \"kubernetes.io/projected/450f98ed-b0a7-4e2a-9983-6cd2e857c4c9-kube-api-access-cs82l\") pod \"must-gather-lrwk9\" (UID: \"450f98ed-b0a7-4e2a-9983-6cd2e857c4c9\") " pod="openshift-must-gather-xgtxg/must-gather-lrwk9"
Sep 18 17:46:38.379153 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.379160    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/450f98ed-b0a7-4e2a-9983-6cd2e857c4c9-must-gather-output\") pod \"must-gather-lrwk9\" (UID: \"450f98ed-b0a7-4e2a-9983-6cd2e857c4c9\") " pod="openshift-must-gather-xgtxg/must-gather-lrwk9"
Sep 18 17:46:38.379479 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.379465    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/450f98ed-b0a7-4e2a-9983-6cd2e857c4c9-must-gather-output\") pod \"must-gather-lrwk9\" (UID: \"450f98ed-b0a7-4e2a-9983-6cd2e857c4c9\") " pod="openshift-must-gather-xgtxg/must-gather-lrwk9"
Sep 18 17:46:38.390261 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.390229    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs82l\" (UniqueName: \"kubernetes.io/projected/450f98ed-b0a7-4e2a-9983-6cd2e857c4c9-kube-api-access-cs82l\") pod \"must-gather-lrwk9\" (UID: \"450f98ed-b0a7-4e2a-9983-6cd2e857c4c9\") " pod="openshift-must-gather-xgtxg/must-gather-lrwk9"
Sep 18 17:46:38.535736 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.535525    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xgtxg/must-gather-lrwk9"
Sep 18 17:46:38.807351 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.807323    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xgtxg/must-gather-lrwk9"]
Sep 18 17:46:38.809862 ip-10-0-142-7 kubenswrapper[2583]: W0918 17:46:38.809827    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod450f98ed_b0a7_4e2a_9983_6cd2e857c4c9.slice/crio-0a894c5e73c362ae4a48b5f6e9b33244eefa5dc5df8c4606af15e6b9d3add865 WatchSource:0}: Error finding container 0a894c5e73c362ae4a48b5f6e9b33244eefa5dc5df8c4606af15e6b9d3add865: Status 404 returned error can't find the container with id 0a894c5e73c362ae4a48b5f6e9b33244eefa5dc5df8c4606af15e6b9d3add865
Sep 18 17:46:38.811790 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:38.811772    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 17:46:39.582926 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:39.582881    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xgtxg/must-gather-lrwk9" event={"ID":"450f98ed-b0a7-4e2a-9983-6cd2e857c4c9","Type":"ContainerStarted","Data":"0a894c5e73c362ae4a48b5f6e9b33244eefa5dc5df8c4606af15e6b9d3add865"}
Sep 18 17:46:39.815547 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:39.815494    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m" podUID="1d04580a-981a-41a6-b07e-9434bcd507eb" containerName="switch-graph-0cb05" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:46:44.813980 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:44.813927    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m" podUID="1d04580a-981a-41a6-b07e-9434bcd507eb" containerName="switch-graph-0cb05" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:46:45.609197 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:45.609091    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xgtxg/must-gather-lrwk9" event={"ID":"450f98ed-b0a7-4e2a-9983-6cd2e857c4c9","Type":"ContainerStarted","Data":"27797143e0c5fab48292f8a88c9292c32b539820085e28bb2401dd6eb0792a45"}
Sep 18 17:46:45.609197 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:45.609140    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xgtxg/must-gather-lrwk9" event={"ID":"450f98ed-b0a7-4e2a-9983-6cd2e857c4c9","Type":"ContainerStarted","Data":"ad63fe1de8a206befec56367785499bec9109b4209134c72cac609b207d4d62b"}
Sep 18 17:46:45.625745 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:45.625677    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xgtxg/must-gather-lrwk9" podStartSLOduration=1.103333253 podStartE2EDuration="7.625654346s" totalImagesPullingTime="6.522321093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:46:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:46:45.624545757 +0000 UTC m=+3456.349827503" watchObservedRunningTime="2026-09-18 17:46:45.625654346 +0000 UTC m=+3456.350936094"
Sep 18 17:46:49.814398 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:49.814351    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m" podUID="1d04580a-981a-41a6-b07e-9434bcd507eb" containerName="switch-graph-0cb05" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:46:49.814952 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:49.814484    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"
Sep 18 17:46:54.762243 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:54.762206    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0cb05-676d55bd6d-klj8m_1d04580a-981a-41a6-b07e-9434bcd507eb/switch-graph-0cb05/0.log"
Sep 18 17:46:54.814519 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:54.814478    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m" podUID="1d04580a-981a-41a6-b07e-9434bcd507eb" containerName="switch-graph-0cb05" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:46:55.645159 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:55.645123    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0cb05-676d55bd6d-klj8m_1d04580a-981a-41a6-b07e-9434bcd507eb/switch-graph-0cb05/0.log"
Sep 18 17:46:56.527872 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:56.527837    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0cb05-676d55bd6d-klj8m_1d04580a-981a-41a6-b07e-9434bcd507eb/switch-graph-0cb05/0.log"
Sep 18 17:46:57.389052 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:57.389021    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0cb05-676d55bd6d-klj8m_1d04580a-981a-41a6-b07e-9434bcd507eb/switch-graph-0cb05/0.log"
Sep 18 17:46:58.317995 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:58.317963    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0cb05-676d55bd6d-klj8m_1d04580a-981a-41a6-b07e-9434bcd507eb/switch-graph-0cb05/0.log"
Sep 18 17:46:59.151906 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:59.151878    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0cb05-676d55bd6d-klj8m_1d04580a-981a-41a6-b07e-9434bcd507eb/switch-graph-0cb05/0.log"
Sep 18 17:46:59.814151 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:59.814101    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m" podUID="1d04580a-981a-41a6-b07e-9434bcd507eb" containerName="switch-graph-0cb05" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:46:59.964583 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:46:59.964551    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0cb05-676d55bd6d-klj8m_1d04580a-981a-41a6-b07e-9434bcd507eb/switch-graph-0cb05/0.log"
Sep 18 17:47:00.796875 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:00.796838    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0cb05-676d55bd6d-klj8m_1d04580a-981a-41a6-b07e-9434bcd507eb/switch-graph-0cb05/0.log"
Sep 18 17:47:01.679174 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:01.679142    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0cb05-676d55bd6d-klj8m_1d04580a-981a-41a6-b07e-9434bcd507eb/switch-graph-0cb05/0.log"
Sep 18 17:47:02.654198 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:02.654167    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0cb05-676d55bd6d-klj8m_1d04580a-981a-41a6-b07e-9434bcd507eb/switch-graph-0cb05/0.log"
Sep 18 17:47:03.537072 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:03.537044    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0cb05-676d55bd6d-klj8m_1d04580a-981a-41a6-b07e-9434bcd507eb/switch-graph-0cb05/0.log"
Sep 18 17:47:04.379568 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:04.379537    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0cb05-676d55bd6d-klj8m_1d04580a-981a-41a6-b07e-9434bcd507eb/switch-graph-0cb05/0.log"
Sep 18 17:47:04.814277 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:04.814183    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m" podUID="1d04580a-981a-41a6-b07e-9434bcd507eb" containerName="switch-graph-0cb05" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:47:05.322232 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:05.322201    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0cb05-676d55bd6d-klj8m_1d04580a-981a-41a6-b07e-9434bcd507eb/switch-graph-0cb05/0.log"
Sep 18 17:47:06.227615 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:06.227582    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0cb05-676d55bd6d-klj8m_1d04580a-981a-41a6-b07e-9434bcd507eb/switch-graph-0cb05/0.log"
Sep 18 17:47:07.144654 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:07.144622    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-0cb05-676d55bd6d-klj8m_1d04580a-981a-41a6-b07e-9434bcd507eb/switch-graph-0cb05/0.log"
Sep 18 17:47:07.702274 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:07.701376    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"
Sep 18 17:47:07.704514 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:07.704477    2583 generic.go:356] "Generic (PLEG): container finished" podID="1d04580a-981a-41a6-b07e-9434bcd507eb" containerID="537aaad1593f6b9638c838315d69ad7e74beda2d1aea4ec8354c561e74ce7920" exitCode=0
Sep 18 17:47:07.704670 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:07.704537    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m" event={"ID":"1d04580a-981a-41a6-b07e-9434bcd507eb","Type":"ContainerDied","Data":"537aaad1593f6b9638c838315d69ad7e74beda2d1aea4ec8354c561e74ce7920"}
Sep 18 17:47:07.704670 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:07.704588    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m" event={"ID":"1d04580a-981a-41a6-b07e-9434bcd507eb","Type":"ContainerDied","Data":"497b80a42bfc21b13dea611ad5b109d3ec18295076470d905043a8317ef09c24"}
Sep 18 17:47:07.704670 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:07.704619    2583 scope.go:117] "RemoveContainer" containerID="537aaad1593f6b9638c838315d69ad7e74beda2d1aea4ec8354c561e74ce7920"
Sep 18 17:47:07.704792 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:07.704784    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"
Sep 18 17:47:07.713589 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:07.713554    2583 scope.go:117] "RemoveContainer" containerID="537aaad1593f6b9638c838315d69ad7e74beda2d1aea4ec8354c561e74ce7920"
Sep 18 17:47:07.714010 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:47:07.713985    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"537aaad1593f6b9638c838315d69ad7e74beda2d1aea4ec8354c561e74ce7920\": container with ID starting with 537aaad1593f6b9638c838315d69ad7e74beda2d1aea4ec8354c561e74ce7920 not found: ID does not exist" containerID="537aaad1593f6b9638c838315d69ad7e74beda2d1aea4ec8354c561e74ce7920"
Sep 18 17:47:07.714125 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:07.714019    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"537aaad1593f6b9638c838315d69ad7e74beda2d1aea4ec8354c561e74ce7920"} err="failed to get container status \"537aaad1593f6b9638c838315d69ad7e74beda2d1aea4ec8354c561e74ce7920\": rpc error: code = NotFound desc = could not find container \"537aaad1593f6b9638c838315d69ad7e74beda2d1aea4ec8354c561e74ce7920\": container with ID starting with 537aaad1593f6b9638c838315d69ad7e74beda2d1aea4ec8354c561e74ce7920 not found: ID does not exist"
Sep 18 17:47:07.846697 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:07.846610    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d04580a-981a-41a6-b07e-9434bcd507eb-openshift-service-ca-bundle\") pod \"1d04580a-981a-41a6-b07e-9434bcd507eb\" (UID: \"1d04580a-981a-41a6-b07e-9434bcd507eb\") "
Sep 18 17:47:07.846883 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:07.846701    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1d04580a-981a-41a6-b07e-9434bcd507eb-proxy-tls\") pod \"1d04580a-981a-41a6-b07e-9434bcd507eb\" (UID: \"1d04580a-981a-41a6-b07e-9434bcd507eb\") "
Sep 18 17:47:07.847134 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:07.847106    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d04580a-981a-41a6-b07e-9434bcd507eb-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "1d04580a-981a-41a6-b07e-9434bcd507eb" (UID: "1d04580a-981a-41a6-b07e-9434bcd507eb"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:47:07.849070 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:07.849039    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d04580a-981a-41a6-b07e-9434bcd507eb-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "1d04580a-981a-41a6-b07e-9434bcd507eb" (UID: "1d04580a-981a-41a6-b07e-9434bcd507eb"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:47:07.947629 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:07.947590    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d04580a-981a-41a6-b07e-9434bcd507eb-openshift-service-ca-bundle\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:47:07.947629 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:07.947622    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1d04580a-981a-41a6-b07e-9434bcd507eb-proxy-tls\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:47:08.026598 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:08.026554    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"]
Sep 18 17:47:08.030890 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:08.030863    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-0cb05-676d55bd6d-klj8m"]
Sep 18 17:47:08.712826 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:08.712779    2583 generic.go:356] "Generic (PLEG): container finished" podID="450f98ed-b0a7-4e2a-9983-6cd2e857c4c9" containerID="ad63fe1de8a206befec56367785499bec9109b4209134c72cac609b207d4d62b" exitCode=0
Sep 18 17:47:08.713329 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:08.712858    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xgtxg/must-gather-lrwk9" event={"ID":"450f98ed-b0a7-4e2a-9983-6cd2e857c4c9","Type":"ContainerDied","Data":"ad63fe1de8a206befec56367785499bec9109b4209134c72cac609b207d4d62b"}
Sep 18 17:47:08.713329 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:08.713251    2583 scope.go:117] "RemoveContainer" containerID="ad63fe1de8a206befec56367785499bec9109b4209134c72cac609b207d4d62b"
Sep 18 17:47:09.252981 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:09.252951    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xgtxg_must-gather-lrwk9_450f98ed-b0a7-4e2a-9983-6cd2e857c4c9/gather/0.log"
Sep 18 17:47:09.463710 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:09.463679    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d04580a-981a-41a6-b07e-9434bcd507eb" path="/var/lib/kubelet/pods/1d04580a-981a-41a6-b07e-9434bcd507eb/volumes"
Sep 18 17:47:09.702090 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:09.702051    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:47:09.836917 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:09.836878    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:47:09.938121 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:09.938089    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:47:12.778697 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:12.778664    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v7vnw_46fb0981-ac5c-4e2b-8212-adae49d948c4/global-pull-secret-syncer/0.log"
Sep 18 17:47:12.910552 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:12.910525    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log"
Sep 18 17:47:13.090442 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:13.090360    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-7.ec2.internal_4f4244c68bf26c3467a2f7dbaa7bd7e6/haproxy/0.log"
Sep 18 17:47:14.689624 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:14.689577    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-xgtxg/must-gather-lrwk9"]
Sep 18 17:47:14.690127 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:14.689925    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-xgtxg/must-gather-lrwk9" podUID="450f98ed-b0a7-4e2a-9983-6cd2e857c4c9" containerName="copy" containerID="cri-o://27797143e0c5fab48292f8a88c9292c32b539820085e28bb2401dd6eb0792a45" gracePeriod=2
Sep 18 17:47:14.691122 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:14.691098    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-xgtxg/must-gather-lrwk9"]
Sep 18 17:47:14.691613 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:47:14.691592    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-lrwk9\" is forbidden: User \"system:node:ip-10-0-142-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xgtxg\": no relationship found between node 'ip-10-0-142-7.ec2.internal' and this object" podUID="450f98ed-b0a7-4e2a-9983-6cd2e857c4c9" pod="openshift-must-gather-xgtxg/must-gather-lrwk9"
Sep 18 17:47:14.924016 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:14.923994    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xgtxg_must-gather-lrwk9_450f98ed-b0a7-4e2a-9983-6cd2e857c4c9/copy/0.log"
Sep 18 17:47:14.926598 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:14.926576    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xgtxg/must-gather-lrwk9"
Sep 18 17:47:14.928640 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:47:14.928610    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-lrwk9\" is forbidden: User \"system:node:ip-10-0-142-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xgtxg\": no relationship found between node 'ip-10-0-142-7.ec2.internal' and this object" podUID="450f98ed-b0a7-4e2a-9983-6cd2e857c4c9" pod="openshift-must-gather-xgtxg/must-gather-lrwk9"
Sep 18 17:47:15.104318 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.104219    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs82l\" (UniqueName: \"kubernetes.io/projected/450f98ed-b0a7-4e2a-9983-6cd2e857c4c9-kube-api-access-cs82l\") pod \"450f98ed-b0a7-4e2a-9983-6cd2e857c4c9\" (UID: \"450f98ed-b0a7-4e2a-9983-6cd2e857c4c9\") "
Sep 18 17:47:15.104318 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.104291    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/450f98ed-b0a7-4e2a-9983-6cd2e857c4c9-must-gather-output\") pod \"450f98ed-b0a7-4e2a-9983-6cd2e857c4c9\" (UID: \"450f98ed-b0a7-4e2a-9983-6cd2e857c4c9\") "
Sep 18 17:47:15.105754 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.105729    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/450f98ed-b0a7-4e2a-9983-6cd2e857c4c9-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "450f98ed-b0a7-4e2a-9983-6cd2e857c4c9" (UID: "450f98ed-b0a7-4e2a-9983-6cd2e857c4c9"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:47:15.106654 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.106632    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/450f98ed-b0a7-4e2a-9983-6cd2e857c4c9-kube-api-access-cs82l" (OuterVolumeSpecName: "kube-api-access-cs82l") pod "450f98ed-b0a7-4e2a-9983-6cd2e857c4c9" (UID: "450f98ed-b0a7-4e2a-9983-6cd2e857c4c9"). InnerVolumeSpecName "kube-api-access-cs82l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:47:15.205246 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.205206    2583 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/450f98ed-b0a7-4e2a-9983-6cd2e857c4c9-must-gather-output\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:47:15.205246 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.205239    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs82l\" (UniqueName: \"kubernetes.io/projected/450f98ed-b0a7-4e2a-9983-6cd2e857c4c9-kube-api-access-cs82l\") on node \"ip-10-0-142-7.ec2.internal\" DevicePath \"\""
Sep 18 17:47:15.464024 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.463985    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="450f98ed-b0a7-4e2a-9983-6cd2e857c4c9" path="/var/lib/kubelet/pods/450f98ed-b0a7-4e2a-9983-6cd2e857c4c9/volumes"
Sep 18 17:47:15.577178 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.577145    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:47:15.648365 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.648318    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxlkv_30c32c6a-c36c-4433-adff-277ef3fa3b16/konnectivity-agent/0.log" limit=1024
Sep 18 17:47:15.741017 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.740940    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xgtxg_must-gather-lrwk9_450f98ed-b0a7-4e2a-9983-6cd2e857c4c9/copy/0.log"
Sep 18 17:47:15.741438 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.741255    2583 generic.go:356] "Generic (PLEG): container finished" podID="450f98ed-b0a7-4e2a-9983-6cd2e857c4c9" containerID="27797143e0c5fab48292f8a88c9292c32b539820085e28bb2401dd6eb0792a45" exitCode=143
Sep 18 17:47:15.741438 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.741344    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xgtxg/must-gather-lrwk9"
Sep 18 17:47:15.741438 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.741364    2583 scope.go:117] "RemoveContainer" containerID="27797143e0c5fab48292f8a88c9292c32b539820085e28bb2401dd6eb0792a45"
Sep 18 17:47:15.749020 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.748999    2583 scope.go:117] "RemoveContainer" containerID="ad63fe1de8a206befec56367785499bec9109b4209134c72cac609b207d4d62b"
Sep 18 17:47:15.762223 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.762203    2583 scope.go:117] "RemoveContainer" containerID="27797143e0c5fab48292f8a88c9292c32b539820085e28bb2401dd6eb0792a45"
Sep 18 17:47:15.762559 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:47:15.762537    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27797143e0c5fab48292f8a88c9292c32b539820085e28bb2401dd6eb0792a45\": container with ID starting with 27797143e0c5fab48292f8a88c9292c32b539820085e28bb2401dd6eb0792a45 not found: ID does not exist" containerID="27797143e0c5fab48292f8a88c9292c32b539820085e28bb2401dd6eb0792a45"
Sep 18 17:47:15.762611 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.762572    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27797143e0c5fab48292f8a88c9292c32b539820085e28bb2401dd6eb0792a45"} err="failed to get container status \"27797143e0c5fab48292f8a88c9292c32b539820085e28bb2401dd6eb0792a45\": rpc error: code = NotFound desc = could not find container \"27797143e0c5fab48292f8a88c9292c32b539820085e28bb2401dd6eb0792a45\": container with ID starting with 27797143e0c5fab48292f8a88c9292c32b539820085e28bb2401dd6eb0792a45 not found: ID does not exist"
Sep 18 17:47:15.762611 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.762595    2583 scope.go:117] "RemoveContainer" containerID="ad63fe1de8a206befec56367785499bec9109b4209134c72cac609b207d4d62b"
Sep 18 17:47:15.762869 ip-10-0-142-7 kubenswrapper[2583]: E0918 17:47:15.762851    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad63fe1de8a206befec56367785499bec9109b4209134c72cac609b207d4d62b\": container with ID starting with ad63fe1de8a206befec56367785499bec9109b4209134c72cac609b207d4d62b not found: ID does not exist" containerID="ad63fe1de8a206befec56367785499bec9109b4209134c72cac609b207d4d62b"
Sep 18 17:47:15.762923 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:15.762874    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad63fe1de8a206befec56367785499bec9109b4209134c72cac609b207d4d62b"} err="failed to get container status \"ad63fe1de8a206befec56367785499bec9109b4209134c72cac609b207d4d62b\": rpc error: code = NotFound desc = could not find container \"ad63fe1de8a206befec56367785499bec9109b4209134c72cac609b207d4d62b\": container with ID starting with ad63fe1de8a206befec56367785499bec9109b4209134c72cac609b207d4d62b not found: ID does not exist"
Sep 18 17:47:18.875980 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:18.875917    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-znrf5_2e1e068c-c33f-477c-a957-071c06e42767/node-exporter/0.log"
Sep 18 17:47:18.913114 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:18.913088    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-znrf5_2e1e068c-c33f-477c-a957-071c06e42767/kube-rbac-proxy/0.log"
Sep 18 17:47:18.952511 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:18.952483    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-znrf5_2e1e068c-c33f-477c-a957-071c06e42767/init-textfile/0.log"
Sep 18 17:47:19.131566 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:19.131539    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83ffef2c-1127-4d5b-a8fb-66a5c2510221/prometheus/0.log"
Sep 18 17:47:19.171528 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:19.171504    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83ffef2c-1127-4d5b-a8fb-66a5c2510221/config-reloader/0.log"
Sep 18 17:47:19.205219 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:19.205187    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83ffef2c-1127-4d5b-a8fb-66a5c2510221/thanos-sidecar/0.log"
Sep 18 17:47:19.240562 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:19.240532    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83ffef2c-1127-4d5b-a8fb-66a5c2510221/kube-rbac-proxy-web/0.log"
Sep 18 17:47:19.277855 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:19.277827    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83ffef2c-1127-4d5b-a8fb-66a5c2510221/kube-rbac-proxy/0.log"
Sep 18 17:47:19.323760 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:19.323723    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83ffef2c-1127-4d5b-a8fb-66a5c2510221/kube-rbac-proxy-thanos/0.log"
Sep 18 17:47:19.360600 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:19.360532    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_83ffef2c-1127-4d5b-a8fb-66a5c2510221/init-config-reloader/0.log"
Sep 18 17:47:19.608379 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:19.608326    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cfb54cf57-rk4vk_6ad9eafc-1395-4450-b738-a0ffee85fcce/thanos-query/0.log"
Sep 18 17:47:19.635716 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:19.635691    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cfb54cf57-rk4vk_6ad9eafc-1395-4450-b738-a0ffee85fcce/kube-rbac-proxy-web/0.log"
Sep 18 17:47:19.664621 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:19.664596    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cfb54cf57-rk4vk_6ad9eafc-1395-4450-b738-a0ffee85fcce/kube-rbac-proxy/0.log"
Sep 18 17:47:19.690943 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:19.690922    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cfb54cf57-rk4vk_6ad9eafc-1395-4450-b738-a0ffee85fcce/prom-label-proxy/0.log"
Sep 18 17:47:19.720927 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:19.720902    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cfb54cf57-rk4vk_6ad9eafc-1395-4450-b738-a0ffee85fcce/kube-rbac-proxy-rules/0.log"
Sep 18 17:47:19.745271 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:19.745241    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cfb54cf57-rk4vk_6ad9eafc-1395-4450-b738-a0ffee85fcce/kube-rbac-proxy-metrics/0.log"
Sep 18 17:47:20.562672 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.562636    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"]
Sep 18 17:47:20.563057 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.562909    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="450f98ed-b0a7-4e2a-9983-6cd2e857c4c9" containerName="copy"
Sep 18 17:47:20.563057 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.562920    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="450f98ed-b0a7-4e2a-9983-6cd2e857c4c9" containerName="copy"
Sep 18 17:47:20.563057 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.562939    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="450f98ed-b0a7-4e2a-9983-6cd2e857c4c9" containerName="gather"
Sep 18 17:47:20.563057 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.562945    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="450f98ed-b0a7-4e2a-9983-6cd2e857c4c9" containerName="gather"
Sep 18 17:47:20.563057 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.562958    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d04580a-981a-41a6-b07e-9434bcd507eb" containerName="switch-graph-0cb05"
Sep 18 17:47:20.563057 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.562964    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d04580a-981a-41a6-b07e-9434bcd507eb" containerName="switch-graph-0cb05"
Sep 18 17:47:20.563057 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.563006    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="450f98ed-b0a7-4e2a-9983-6cd2e857c4c9" containerName="copy"
Sep 18 17:47:20.563057 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.563014    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d04580a-981a-41a6-b07e-9434bcd507eb" containerName="switch-graph-0cb05"
Sep 18 17:47:20.563057 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.563022    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="450f98ed-b0a7-4e2a-9983-6cd2e857c4c9" containerName="gather"
Sep 18 17:47:20.567863 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.567846    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:20.570466 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.570441    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9l6m9\"/\"default-dockercfg-drjkb\""
Sep 18 17:47:20.571173 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.571156    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9l6m9\"/\"kube-root-ca.crt\""
Sep 18 17:47:20.571231 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.571196    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9l6m9\"/\"openshift-service-ca.crt\""
Sep 18 17:47:20.589455 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.589430    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"]
Sep 18 17:47:20.648348 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.648277    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ddcb1404-6268-4622-9278-18d3144a23b8-lib-modules\") pod \"perf-node-gather-daemonset-795cq\" (UID: \"ddcb1404-6268-4622-9278-18d3144a23b8\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:20.648348 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.648322    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ddcb1404-6268-4622-9278-18d3144a23b8-proc\") pod \"perf-node-gather-daemonset-795cq\" (UID: \"ddcb1404-6268-4622-9278-18d3144a23b8\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:20.648525 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.648352    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ddcb1404-6268-4622-9278-18d3144a23b8-podres\") pod \"perf-node-gather-daemonset-795cq\" (UID: \"ddcb1404-6268-4622-9278-18d3144a23b8\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:20.648525 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.648386    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8ktp\" (UniqueName: \"kubernetes.io/projected/ddcb1404-6268-4622-9278-18d3144a23b8-kube-api-access-f8ktp\") pod \"perf-node-gather-daemonset-795cq\" (UID: \"ddcb1404-6268-4622-9278-18d3144a23b8\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:20.648525 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.648435    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddcb1404-6268-4622-9278-18d3144a23b8-sys\") pod \"perf-node-gather-daemonset-795cq\" (UID: \"ddcb1404-6268-4622-9278-18d3144a23b8\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:20.749699 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.749637    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddcb1404-6268-4622-9278-18d3144a23b8-sys\") pod \"perf-node-gather-daemonset-795cq\" (UID: \"ddcb1404-6268-4622-9278-18d3144a23b8\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:20.749950 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.749743    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ddcb1404-6268-4622-9278-18d3144a23b8-lib-modules\") pod \"perf-node-gather-daemonset-795cq\" (UID: \"ddcb1404-6268-4622-9278-18d3144a23b8\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:20.749950 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.749766    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddcb1404-6268-4622-9278-18d3144a23b8-sys\") pod \"perf-node-gather-daemonset-795cq\" (UID: \"ddcb1404-6268-4622-9278-18d3144a23b8\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:20.749950 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.749778    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ddcb1404-6268-4622-9278-18d3144a23b8-proc\") pod \"perf-node-gather-daemonset-795cq\" (UID: \"ddcb1404-6268-4622-9278-18d3144a23b8\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:20.749950 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.749856    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ddcb1404-6268-4622-9278-18d3144a23b8-podres\") pod \"perf-node-gather-daemonset-795cq\" (UID: \"ddcb1404-6268-4622-9278-18d3144a23b8\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:20.749950 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.749896    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8ktp\" (UniqueName: \"kubernetes.io/projected/ddcb1404-6268-4622-9278-18d3144a23b8-kube-api-access-f8ktp\") pod \"perf-node-gather-daemonset-795cq\" (UID: \"ddcb1404-6268-4622-9278-18d3144a23b8\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:20.749950 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.749858    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ddcb1404-6268-4622-9278-18d3144a23b8-proc\") pod \"perf-node-gather-daemonset-795cq\" (UID: \"ddcb1404-6268-4622-9278-18d3144a23b8\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:20.749950 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.749951    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ddcb1404-6268-4622-9278-18d3144a23b8-podres\") pod \"perf-node-gather-daemonset-795cq\" (UID: \"ddcb1404-6268-4622-9278-18d3144a23b8\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:20.750206 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.749972    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ddcb1404-6268-4622-9278-18d3144a23b8-lib-modules\") pod \"perf-node-gather-daemonset-795cq\" (UID: \"ddcb1404-6268-4622-9278-18d3144a23b8\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:20.762318 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.762285    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8ktp\" (UniqueName: \"kubernetes.io/projected/ddcb1404-6268-4622-9278-18d3144a23b8-kube-api-access-f8ktp\") pod \"perf-node-gather-daemonset-795cq\" (UID: \"ddcb1404-6268-4622-9278-18d3144a23b8\") " pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:20.877900 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:20.877869    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:21.152972 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:21.152893    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"]
Sep 18 17:47:21.156366 ip-10-0-142-7 kubenswrapper[2583]: W0918 17:47:21.156334    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podddcb1404_6268_4622_9278_18d3144a23b8.slice/crio-66996e745534b219aa7a5af19c417660c1d93aed3ab0f02d3ab7ec905beaa279 WatchSource:0}: Error finding container 66996e745534b219aa7a5af19c417660c1d93aed3ab0f02d3ab7ec905beaa279: Status 404 returned error can't find the container with id 66996e745534b219aa7a5af19c417660c1d93aed3ab0f02d3ab7ec905beaa279
Sep 18 17:47:21.765300 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:21.765267    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq" event={"ID":"ddcb1404-6268-4622-9278-18d3144a23b8","Type":"ContainerStarted","Data":"18693f03221ef0be7a67ce3cb53cf0e13dbfd02ff64779f05d0d84f1d35fc326"}
Sep 18 17:47:21.765702 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:21.765321    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq" event={"ID":"ddcb1404-6268-4622-9278-18d3144a23b8","Type":"ContainerStarted","Data":"66996e745534b219aa7a5af19c417660c1d93aed3ab0f02d3ab7ec905beaa279"}
Sep 18 17:47:21.765702 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:21.765359    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:21.792330 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:21.792262    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq" podStartSLOduration=1.792240872 podStartE2EDuration="1.792240872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 17:47:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:47:21.786164954 +0000 UTC m=+3492.511446701" watchObservedRunningTime="2026-09-18 17:47:21.792240872 +0000 UTC m=+3492.517522666"
Sep 18 17:47:23.498278 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:23.498251    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wzxxz_fc7c0826-2a12-4bba-8079-b124a25edf1c/dns/0.log"
Sep 18 17:47:23.523297 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:23.523267    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wzxxz_fc7c0826-2a12-4bba-8079-b124a25edf1c/kube-rbac-proxy/0.log"
Sep 18 17:47:23.574919 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:23.574898    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dnzc5_408e7f72-5486-4ec3-9bd8-1a371f4e8160/dns-node-resolver/0.log"
Sep 18 17:47:24.077414 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:24.077381    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-866c5896b7-msjvg_613161f4-7a21-4800-97d0-a1a473fcfba5/registry/0.log"
Sep 18 17:47:24.153365 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:24.153332    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cfqfc_c8f58056-1c0d-498e-9518-a3b9654d6cf3/node-ca/0.log"
Sep 18 17:47:24.980064 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:24.980034    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c58d979fb-ltwh9_ecdbf1ad-4cf9-4de0-bf03-4028b8928c62/router/0.log"
Sep 18 17:47:25.378965 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:25.378936    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ggqml_75856070-e664-44eb-94df-4b885ba029e4/serve-healthcheck-canary/0.log"
Sep 18 17:47:25.966463 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:25.966434    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w48tp_f7e2e1bb-c4ac-4719-91cb-78914b3aafbe/kube-rbac-proxy/0.log"
Sep 18 17:47:25.990553 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:25.990521    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w48tp_f7e2e1bb-c4ac-4719-91cb-78914b3aafbe/exporter/0.log"
Sep 18 17:47:26.016609 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:26.016577    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w48tp_f7e2e1bb-c4ac-4719-91cb-78914b3aafbe/extractor/0.log"
Sep 18 17:47:27.779714 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:27.779680    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9l6m9/perf-node-gather-daemonset-795cq"
Sep 18 17:47:28.555152 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:28.555115    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-7b966d7984-2tqhb_d291e285-b41a-485f-8ca4-7a9e2bd354ce/manager/0.log"
Sep 18 17:47:28.589444 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:28.589411    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-m465s_328f4fbd-63c9-412b-aa32-a65caa13fb1e/s3-init/0.log"
Sep 18 17:47:28.609934 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:28.609908    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-m465s_328f4fbd-63c9-412b-aa32-a65caa13fb1e/download-hf-model/0.log"
Sep 18 17:47:34.829352 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:34.829324    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-29gsb_80c9ac89-c6b7-463f-aea6-f7be8d982fe6/kube-multus-additional-cni-plugins/0.log"
Sep 18 17:47:34.859298 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:34.859265    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-29gsb_80c9ac89-c6b7-463f-aea6-f7be8d982fe6/egress-router-binary-copy/0.log"
Sep 18 17:47:34.887705 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:34.887674    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-29gsb_80c9ac89-c6b7-463f-aea6-f7be8d982fe6/cni-plugins/0.log"
Sep 18 17:47:34.921126 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:34.921095    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-29gsb_80c9ac89-c6b7-463f-aea6-f7be8d982fe6/bond-cni-plugin/0.log"
Sep 18 17:47:34.950049 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:34.950021    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-29gsb_80c9ac89-c6b7-463f-aea6-f7be8d982fe6/routeoverride-cni/0.log"
Sep 18 17:47:34.980076 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:34.980049    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-29gsb_80c9ac89-c6b7-463f-aea6-f7be8d982fe6/whereabouts-cni-bincopy/0.log"
Sep 18 17:47:35.006754 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:35.006720    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-29gsb_80c9ac89-c6b7-463f-aea6-f7be8d982fe6/whereabouts-cni/0.log"
Sep 18 17:47:35.385852 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:35.385798    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/3.log"
Sep 18 17:47:35.391052 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:35.391032    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lkvfz_3eb943e2-ff5c-4e19-bb28-bbf46c305ed6/kube-multus/4.log"
Sep 18 17:47:35.504235 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:35.504208    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qmx4b_83b73597-6182-4df7-bcf5-f6ca3ba721cd/network-metrics-daemon/0.log"
Sep 18 17:47:35.525454 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:35.525432    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qmx4b_83b73597-6182-4df7-bcf5-f6ca3ba721cd/kube-rbac-proxy/0.log"
Sep 18 17:47:36.870309 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:36.870275    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovn-controller/0.log"
Sep 18 17:47:36.890374 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:36.890345    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovn-acl-logging/0.log"
Sep 18 17:47:36.915451 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:36.915426    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/kube-rbac-proxy-node/0.log"
Sep 18 17:47:36.946168 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:36.946142    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/kube-rbac-proxy-ovn-metrics/0.log"
Sep 18 17:47:36.969515 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:36.969490    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/northd/0.log"
Sep 18 17:47:36.992090 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:36.992062    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/nbdb/0.log"
Sep 18 17:47:37.017782 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:37.017761    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/sbdb/0.log"
Sep 18 17:47:37.057198 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:37.057167    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/1.log"
Sep 18 17:47:37.061766 ip-10-0-142-7 kubenswrapper[2583]: I0918 17:47:37.061740    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s746c_97b45f77-6012-44e8-ad30-564e7d1f2a5d/ovnkube-controller/2.log"