Jul 28 17:14:53.904506 ip-10-0-136-239 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 17:14:53.904519 ip-10-0-136-239 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 17:14:53.904528 ip-10-0-136-239 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 17:14:53.904831 ip-10-0-136-239 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 17:15:05.069012 ip-10-0-136-239 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 28 17:15:05.069031 ip-10-0-136-239 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ae042ac7ffba4fd58336fe9d0bc809c5 --
Jul 28 17:17:03.063065 ip-10-0-136-239 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 17:17:03.424132 ip-10-0-136-239 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 17:17:03.424132 ip-10-0-136-239 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 17:17:03.424132 ip-10-0-136-239 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 17:17:03.424132 ip-10-0-136-239 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 17:17:03.424132 ip-10-0-136-239 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 17:17:03.426157 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.426036    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 17:17:03.431689 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431671    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431691    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431696    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431701    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431704    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431709    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431711    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431714    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431717    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431720    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431723    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431726    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431728    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431731    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431734    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431737    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431739    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431743    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:17:03.431737 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431746    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431749    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431752    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431754    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431757    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431759    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431762    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431765    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431768    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431771    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431773    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431776    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431778    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431781    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431783    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431786    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431800    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431803    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431806    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431808    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:17:03.432171 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431811    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431815    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431817    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431820    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431822    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431825    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431827    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431830    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431832    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431834    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431837    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431839    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431841    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431844    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431848    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431850    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431853    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431855    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431858    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431860    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:17:03.432652 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431863    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431865    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431868    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431870    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431873    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431875    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431878    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431880    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431882    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431885    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431887    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431890    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431892    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431897    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431900    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431903    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431906    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431909    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431911    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:17:03.433163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431914    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431916    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431919    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431921    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431924    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431926    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431928    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431931    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431934    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431939    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431942    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431946    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431949    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431951    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431954    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431957    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431960    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431963    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431967    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:17:03.433614 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431969    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431972    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.431975    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433567    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433575    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433579    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433582    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433585    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433589    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433592    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433596    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433600    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433603    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433606    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433609    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433612    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433615    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433618    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433621    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:17:03.434080 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433624    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433626    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433629    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433632    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433634    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433636    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433639    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433641    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433644    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433647    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433649    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433651    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433654    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433656    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433658    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433662    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433665    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433667    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433670    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433672    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:17:03.434544 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433675    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433677    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433680    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433683    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433685    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433688    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433691    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433693    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433697    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433700    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433703    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433705    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433708    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433710    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433712    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433715    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433718    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433720    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433723    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:17:03.435031 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433727    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433730    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433733    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433737    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433740    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433742    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433745    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433747    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433750    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433753    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433755    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433759    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433762    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433765    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433767    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433770    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433773    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433775    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433777    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433780    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:17:03.435490 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433782    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433785    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433805    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433808    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433811    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433813    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433816    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433818    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433821    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433823    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433826    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433828    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433831    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433834    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433836    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433839    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433841    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433844    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433846    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433849    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:17:03.436010 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433851    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433854    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433857    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.433859    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434237    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434242    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434245    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434248    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434251    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434255    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434257    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434260    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434263    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434266    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434270    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434272    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434275    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434278    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434281    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434283    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:17:03.436505 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434286    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434289    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434291    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434294    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434297    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434299    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434302    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434304    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434307    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434309    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434311    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434314    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434317    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434319    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434322    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434324    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434327    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434329    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434332    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434334    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:17:03.437036 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434337    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434340    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434342    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434345    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434347    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434350    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434353    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434355    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434358    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434360    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434363    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434366    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434368    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434370    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434373    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434375    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434377    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434380    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434382    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434385    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:17:03.437508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434388    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434390    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434393    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434395    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434398    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434400    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434403    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434405    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434407    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434410    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434412    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434415    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434417    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434419    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434422    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434425    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434427    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434430    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434433    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434435    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:17:03.438002 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434437    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434440    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434446    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434449    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434451    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434454    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434456    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434459    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434463    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434467    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434471    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434475    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434478    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434482    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434485    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434488    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434491    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434494    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434497    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:17:03.438523 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434500    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434502    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434505    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.434507    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434597    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434618    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434627    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434631    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434636    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434639    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434643    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434648    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434651    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434654    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434657    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434662    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434665    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434668    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434671    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434674    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434676    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434679    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434683    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434686    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 17:17:03.438998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434689    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434692    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434695    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434699    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434702    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434705    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434708    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434711    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434714    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434717    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434720    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434722    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434727    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434730    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434732    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434735    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434738    2563 flags.go:64] FLAG: --enable-server="true"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434748    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434752    2563 flags.go:64] FLAG: --event-burst="100"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434755    2563 flags.go:64] FLAG: --event-qps="50"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434758    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434762    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434764    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434774    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 17:17:03.439581 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434777    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434780    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434783    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434786    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434802    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434805    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434808    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434811    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434814    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434816    2563 flags.go:64] FLAG: --feature-gates=""
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434821    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434824    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434826    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434829    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434832    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434835    2563 flags.go:64] FLAG: --help="false"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434838    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-136-239.ec2.internal"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434841    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434844    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434846    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434850    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434853    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434856    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 17:17:03.440154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434859    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434862    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434864    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434868    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434871    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434874    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434877    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434880    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434884    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434887    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434890    2563 flags.go:64] FLAG: --lock-file=""
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434892    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434895    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434898    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434903    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434906    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434908    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434911    2563 flags.go:64] FLAG: --logging-format="text"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434914    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434917    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434919    2563 flags.go:64] FLAG: --manifest-url=""
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434922    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434927    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434930    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434934    2563 flags.go:64] FLAG: --max-pods="110"
Jul 28 17:17:03.440734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434937    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434939    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434945    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434947    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434950    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434953    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434956    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434964    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434967    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434970    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434974    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434977    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434982    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434985    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434988    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434991    2563 flags.go:64] FLAG: --port="10250"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434996    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.434999    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06cd196b44729ded7"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435002    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435005    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435008    2563 flags.go:64] FLAG: --register-node="true"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435010    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435014    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435017    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 28 17:17:03.441388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435020    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435022    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435026    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435029    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435032    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435034    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435037    2563 flags.go:64] FLAG: --runonce="false"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435040    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435043    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435046    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435050    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435053    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435056    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435059    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435062    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435064    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435067    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435070    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435073    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435076    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435079    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435082    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435087    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435089    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435094    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 17:17:03.442099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435098    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435100    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435103    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435105    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435108    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435111    2563 flags.go:64] FLAG: --v="2"
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435115    2563 flags.go:64] FLAG: --version="false"
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435118    2563 flags.go:64] FLAG: --vmodule=""
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435122    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435125    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435245    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435250    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435253    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435256    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435259    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435262    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435265    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435269    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435271    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435274    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435277    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:17:03.442743 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435279    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435282    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435285    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435288    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435290    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435292    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435295    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435298    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435300    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435303    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435307    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435311    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435314    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435317    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435320    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435323    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435326    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435328    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435331    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:17:03.443547 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435334    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435336    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435339    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435342    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435344    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435347    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435349    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435352    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435354    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435358    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435361    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435363    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435366    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435368    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435371    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435373    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435376    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435379    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435381    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435384    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:17:03.444095 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435386    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435392    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435394    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435398    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435401    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435403    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435406    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435408    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435411    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435414    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435416    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435419    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435421    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435424    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435426    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435428    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435431    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435433    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435436    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435438    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:17:03.444679 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435441    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435445    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435447    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435450    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435452    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435454    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435457    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435459    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435462    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435464    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435467    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435470    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435473    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435476    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435479    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435483    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435485    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435488    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435490    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435493    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:17:03.445192 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435496    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:17:03.445669 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435498    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:17:03.445669 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435501    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:17:03.445669 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435503    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:17:03.445669 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435506    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:17:03.445669 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435508    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:17:03.445669 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435511    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:17:03.445669 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435513    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:17:03.445669 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.435517    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:17:03.445669 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.435984    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 17:17:03.445669 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.443273    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 17:17:03.445669 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.443292    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 17:17:03.445669 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.444106    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 17:17:03.445669 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.444247    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 17:17:03.445669 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444339    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444345    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444350    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444355    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444358    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444363    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444366    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444369    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444372    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444375    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444378    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444382    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444385    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444387    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444390    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444392    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444395    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444397    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:17:03.446033 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444400    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444403    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444406    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444408    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444411    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444414    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444417    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444419    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444422    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444424    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444428    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444431    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444433    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444436    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444439    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444441    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444444    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444447    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444449    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444452    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:17:03.446473 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444454    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444457    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444460    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444463    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444465    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444468    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444470    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444472    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444475    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444477    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444480    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444482    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444484    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444487    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444490    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444492    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444494    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444497    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444500    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444502    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:17:03.446971 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444505    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444507    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444510    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444513    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444516    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444518    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444521    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444524    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444526    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444528    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444531    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444533    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444535    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444538    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444540    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444543    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444545    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444547    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444550    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444552    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:17:03.447521 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444555    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444558    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444561    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444563    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444565    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444568    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444570    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444573    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444575    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444578    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444581    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444583    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444586    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444589    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444592    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444594    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444598    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444600    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444603    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444606    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:17:03.448038 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444608    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:17:03.448561 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.444613    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 17:17:03.448561 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444739    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:17:03.448561 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444744    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:17:03.448561 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444747    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:17:03.448561 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444751    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:17:03.448561 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444755    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:17:03.448561 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444758    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:17:03.448561 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444761    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:17:03.448561 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444764    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:17:03.448561 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444766    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:17:03.448561 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444769    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:17:03.448561 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444772    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:17:03.448561 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444774    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:17:03.448561 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444777    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:17:03.448561 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444780    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444783    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444786    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444809    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444812    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444815    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444817    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444820    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444823    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444825    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444829    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444833    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444836    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444839    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444842    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444845    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444847    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444850    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444853    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:17:03.449043 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444855    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444858    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444860    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444863    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444865    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444868    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444870    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444872    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444875    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444877    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444880    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444882    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444885    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444888    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444891    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444893    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444896    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444898    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444900    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444903    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:17:03.449508 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444905    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444908    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444910    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444914    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444916    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444919    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444921    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444923    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444926    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444928    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444931    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444934    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444936    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444939    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444941    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444944    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444946    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444948    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444951    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444953    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:17:03.450424 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444956    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444958    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444961    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444963    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444966    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444968    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444971    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444974    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444977    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444981    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444984    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444986    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444989    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444992    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444995    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.444998    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.445001    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.445003    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.445006    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.445008    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:17:03.451103 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.445011    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:17:03.451694 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.445013    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:17:03.451694 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.445016    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:17:03.451694 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.445018    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:17:03.451694 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.445021    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:17:03.451694 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.445024    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:17:03.451694 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:03.445026    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:17:03.451694 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.445030    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 17:17:03.451694 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.445137    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 17:17:03.451694 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.447195    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 17:17:03.451694 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.448546    2563 server.go:1019] "Starting client certificate rotation"
Jul 28 17:17:03.451694 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.448658    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 17:17:03.451694 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.448712    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 17:17:03.451694 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.450855    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 17:17:03.453470 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.453455    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 17:17:03.462970 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.462954    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 28 17:17:03.464873 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.464858    2563 log.go:25] "Validated CRI v1 image API"
Jul 28 17:17:03.465707 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.465693    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 17:17:03.468032 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.468002    2563 fs.go:135] Filesystem UUIDs: map[0b4dcd98-c007-4401-9088-2ffeb2f15dd1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ab37e4da-37ed-4d2a-84c0-1b327fd87415:/dev/nvme0n1p4]
Jul 28 17:17:03.468137 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.468031    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 17:17:03.473653 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.473530    2563 manager.go:216] Machine: {Timestamp:2026-07-28 17:17:03.473075534 +0000 UTC m=+0.305306773 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097996 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec211545b9a8e86af059d6ababdebc8d SystemUUID:ec211545-b9a8-e86a-f059-d6ababdebc8d BootID:ae042ac7-ffba-4fd5-8336-fe9d0bc809c5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e2:54:67:3d:99 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e2:54:67:3d:99 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:b7:95:06:aa:96 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 17:17:03.473653 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.473643    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 17:17:03.473821 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.473735    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 17:17:03.474694 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.474670    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 17:17:03.474871 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.474696    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-239.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 17:17:03.475417 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.475402    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 17:17:03.475417 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.475418    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 17:17:03.475478 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.475426    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 17:17:03.475478 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.475435    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 17:17:03.476662 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.476651    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 17:17:03.477459 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.477444    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 17:17:03.479654 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.479642    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 17:17:03.479762 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.479753    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 17:17:03.479817 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.479780    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 17:17:03.479817 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.479812    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 17:17:03.479883 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.479827    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 17:17:03.479883 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.479836    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 28 17:17:03.479883 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.479844    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 17:17:03.480504 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.480486    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 17:17:03.480548 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.480526    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 17:17:03.485889 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.485868    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 17:17:03.487152 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.487139    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 17:17:03.487197 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.487170    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 17:17:03.487804 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.487776    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 17:17:03.487838 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.487810    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 17:17:03.487838 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.487817    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 17:17:03.487838 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.487823    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 17:17:03.487838 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.487831    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 17:17:03.487838 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.487837    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 17:17:03.487971 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.487893    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 17:17:03.487971 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.487899    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 17:17:03.487971 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.487907    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 17:17:03.487971 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.487913    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 17:17:03.487971 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.487921    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 17:17:03.487971 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.487940    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 17:17:03.488584 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.488573    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 17:17:03.488630 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.488585    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 17:17:03.490446 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.490426    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-239.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 17:17:03.490446 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.490440    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-239.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 17:17:03.490521 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.490431    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 17:17:03.492054 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.492041    2563 server.go:1268] "Started kubelet"
Jul 28 17:17:03.492116 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.492094    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 17:17:03.492167 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.492126    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 17:17:03.492212 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.492190    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 17:17:03.492939 ip-10-0-136-239 systemd[1]: Started Kubernetes Kubelet.
Jul 28 17:17:03.494006 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.493989    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 17:17:03.494508 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.494491    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 17:17:03.498658 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.498639    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 17:17:03.499391 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.499376    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jrgvs"
Jul 28 17:17:03.501845 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.501826    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 17:17:03.501845 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.501838    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 17:17:03.502015 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.501969    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-239.ec2.internal\" not found"
Jul 28 17:17:03.502608 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.502593    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 17:17:03.502717 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.502706    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 17:17:03.502813 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.502740    2563 factory.go:55] Registering systemd factory
Jul 28 17:17:03.502869 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.502821    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 28 17:17:03.502926 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.502598    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 17:17:03.502974 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.502946    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 17:17:03.502974 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.502953    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 17:17:03.503070 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.503052    2563 factory.go:153] Registering CRI-O factory
Jul 28 17:17:03.503070 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.503067    2563 factory.go:223] Registration of the crio container factory successfully
Jul 28 17:17:03.503157 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.503118    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 17:17:03.503157 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.503147    2563 factory.go:103] Registering Raw factory
Jul 28 17:17:03.503241 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.503160    2563 manager.go:1196] Started watching for new ooms in manager
Jul 28 17:17:03.503596 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.503583    2563 manager.go:349] Starting recovery of all containers
Jul 28 17:17:03.506482 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.506456    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-239.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 17:17:03.506679 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.506654    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 17:17:03.507832 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.506878    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-239.ec2.internal.18c6839f874d43f9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-239.ec2.internal,UID:ip-10-0-136-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-239.ec2.internal,},FirstTimestamp:2026-07-28 17:17:03.492006905 +0000 UTC m=+0.324238143,LastTimestamp:2026-07-28 17:17:03.492006905 +0000 UTC m=+0.324238143,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-239.ec2.internal,}"
Jul 28 17:17:03.509587 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.509563    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jrgvs"
Jul 28 17:17:03.513406 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.513383    2563 manager.go:354] Recovery completed
Jul 28 17:17:03.515895 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.515866    2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 28 17:17:03.518774 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.518761    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:17:03.521899 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.521881    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:17:03.521969 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.521915    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:17:03.521969 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.521927    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:17:03.522446 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.522430    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 17:17:03.522446 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.522442    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 17:17:03.522571 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.522447    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:17:03.522571 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.522456    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 17:17:03.523145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.523131    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:17:03.523211 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.523163    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:17:03.523211 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.523178    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:17:03.523952 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.523891    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-239.ec2.internal.18c6839f891565f4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-239.ec2.internal,UID:ip-10-0-136-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-239.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-239.ec2.internal,},FirstTimestamp:2026-07-28 17:17:03.52190002 +0000 UTC m=+0.354131265,LastTimestamp:2026-07-28 17:17:03.52190002 +0000 UTC m=+0.354131265,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-239.ec2.internal,}"
Jul 28 17:17:03.524098 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.524086    2563 policy_none.go:49] "None policy: Start"
Jul 28 17:17:03.524098 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.524101    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 17:17:03.524191 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.524111    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 17:17:03.525678 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.525666    2563 policy_none.go:47] "Start"
Jul 28 17:17:03.564128 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.563968    2563 manager.go:337] "Starting Device Plugin manager"
Jul 28 17:17:03.564226 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.564151    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 17:17:03.564226 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.564166    2563 server.go:87] "Starting device plugin registration server"
Jul 28 17:17:03.564389 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.564378    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 17:17:03.564427 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.564392    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 17:17:03.564506 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.564491    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 17:17:03.564580 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.564565    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 17:17:03.564580 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.564580    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 17:17:03.565170 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.565151    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 17:17:03.565243 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.565198    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-239.ec2.internal\" not found"
Jul 28 17:17:03.665095 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.665068    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:17:03.666456 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.666003    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:17:03.666456 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.666031    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:17:03.666456 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.666043    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:17:03.666456 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.666068    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-239.ec2.internal"
Jul 28 17:17:03.674287 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.674236    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-239.ec2.internal"
Jul 28 17:17:03.674287 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.674266    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-239.ec2.internal\": node \"ip-10-0-136-239.ec2.internal\" not found"
Jul 28 17:17:03.683386 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.683362    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 17:17:03.684701 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.684683    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 17:17:03.684816 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.684719    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 17:17:03.684816 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.684737    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 17:17:03.684816 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.684766    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 17:17:03.687005 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.686988    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:17:03.691610 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.691587    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-239.ec2.internal\" not found"
Jul 28 17:17:03.785860 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.785827    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-239.ec2.internal"]
Jul 28 17:17:03.786006 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.785899    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:17:03.787353 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.787337    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:17:03.787445 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.787368    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:17:03.787445 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.787384    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:17:03.788697 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.788685    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:17:03.788839 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.788824    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal"
Jul 28 17:17:03.788889 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.788856    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:17:03.789409 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.789393    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:17:03.789409 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.789401    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:17:03.789532 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.789424    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:17:03.789532 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.789427    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:17:03.789532 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.789435    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:17:03.789532 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.789440    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:17:03.791257 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.791244    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-239.ec2.internal"
Jul 28 17:17:03.791320 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.791268    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:17:03.791729 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.791712    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-239.ec2.internal\" not found"
Jul 28 17:17:03.791925 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.791909    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:17:03.791984 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.791944    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:17:03.791984 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.791959    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:17:03.803938 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.803922    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2117e6a4c54c809a46a13ea3b96feab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal\" (UID: \"b2117e6a4c54c809a46a13ea3b96feab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal"
Jul 28 17:17:03.804007 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.803944    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2117e6a4c54c809a46a13ea3b96feab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal\" (UID: \"b2117e6a4c54c809a46a13ea3b96feab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal"
Jul 28 17:17:03.804007 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.803960    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f5a2e8ae67128845bf7e17c11605aa90-config\") pod \"kube-apiserver-proxy-ip-10-0-136-239.ec2.internal\" (UID: \"f5a2e8ae67128845bf7e17c11605aa90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-239.ec2.internal"
Jul 28 17:17:03.824413 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.824394    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-239.ec2.internal\" not found" node="ip-10-0-136-239.ec2.internal"
Jul 28 17:17:03.828883 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.828869    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-239.ec2.internal\" not found" node="ip-10-0-136-239.ec2.internal"
Jul 28 17:17:03.892698 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.892666    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-239.ec2.internal\" not found"
Jul 28 17:17:03.904882 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.904859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2117e6a4c54c809a46a13ea3b96feab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal\" (UID: \"b2117e6a4c54c809a46a13ea3b96feab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal"
Jul 28 17:17:03.904978 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.904887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2117e6a4c54c809a46a13ea3b96feab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal\" (UID: \"b2117e6a4c54c809a46a13ea3b96feab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal"
Jul 28 17:17:03.904978 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.904906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f5a2e8ae67128845bf7e17c11605aa90-config\") pod \"kube-apiserver-proxy-ip-10-0-136-239.ec2.internal\" (UID: \"f5a2e8ae67128845bf7e17c11605aa90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-239.ec2.internal"
Jul 28 17:17:03.904978 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.904949    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f5a2e8ae67128845bf7e17c11605aa90-config\") pod \"kube-apiserver-proxy-ip-10-0-136-239.ec2.internal\" (UID: \"f5a2e8ae67128845bf7e17c11605aa90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-239.ec2.internal"
Jul 28 17:17:03.904978 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.904961    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2117e6a4c54c809a46a13ea3b96feab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal\" (UID: \"b2117e6a4c54c809a46a13ea3b96feab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal"
Jul 28 17:17:03.905111 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:03.904987    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2117e6a4c54c809a46a13ea3b96feab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal\" (UID: \"b2117e6a4c54c809a46a13ea3b96feab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal"
Jul 28 17:17:03.993355 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:03.993283    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-239.ec2.internal\" not found"
Jul 28 17:17:04.093857 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:04.093828    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-239.ec2.internal\" not found"
Jul 28 17:17:04.127343 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:04.127307    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal"
Jul 28 17:17:04.132785 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:04.132768    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-239.ec2.internal"
Jul 28 17:17:04.194254 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:04.194227    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-239.ec2.internal\" not found"
Jul 28 17:17:04.294844 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:04.294759    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-239.ec2.internal\" not found"
Jul 28 17:17:04.324292 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:04.324260    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:17:04.394877 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:04.394842    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-239.ec2.internal\" not found"
Jul 28 17:17:04.448302 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:04.448264    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 17:17:04.448767 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:04.448443    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 17:17:04.448767 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:04.448481    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 17:17:04.495198 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:04.495173    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-239.ec2.internal\" not found"
Jul 28 17:17:04.516296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:04.516262    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 17:12:04 +0000 UTC" deadline="2027-12-25 04:34:44.812583122 +0000 UTC"
Jul 28 17:17:04.516393 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:04.516336    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12347h17m40.296296306s"
Jul 28 17:17:04.597417 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:04.597352    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-239.ec2.internal\" not found"
Jul 28 17:17:04.698118 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:04.698093    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-239.ec2.internal\" not found"
Jul 28 17:17:04.798671 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:04.798637    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-239.ec2.internal\" not found"
Jul 28 17:17:04.871406 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:04.871372    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2117e6a4c54c809a46a13ea3b96feab.slice/crio-660f29d240d6544649aa3c6f8666bc496689c8f81730831d9f26400b316defc0 WatchSource:0}: Error finding container 660f29d240d6544649aa3c6f8666bc496689c8f81730831d9f26400b316defc0: Status 404 returned error can't find the container with id 660f29d240d6544649aa3c6f8666bc496689c8f81730831d9f26400b316defc0
Jul 28 17:17:04.877682 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:04.877666    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:17:04.899598 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:04.899578    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-239.ec2.internal\" not found"
Jul 28 17:17:04.936758 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:04.936724    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a2e8ae67128845bf7e17c11605aa90.slice/crio-fc3ff0615b33e3cd02b93865796107671af4bad5e5457b6bcdc0531eb0c7c2a3 WatchSource:0}: Error finding container fc3ff0615b33e3cd02b93865796107671af4bad5e5457b6bcdc0531eb0c7c2a3: Status 404 returned error can't find the container with id fc3ff0615b33e3cd02b93865796107671af4bad5e5457b6bcdc0531eb0c7c2a3
Jul 28 17:17:04.963599 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:04.963579    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:17:04.985154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:04.985134    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:17:05.003014 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.002992    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-239.ec2.internal"
Jul 28 17:17:05.014584 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.014566    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 17:17:05.017932 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.017904    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal"
Jul 28 17:17:05.029452 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.029434    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 17:17:05.314089 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.314007    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:17:05.481467 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.481433    2563 apiserver.go:52] "Watching apiserver"
Jul 28 17:17:05.490075 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.490048    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 17:17:05.490607 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.490577    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-kn9rg","openshift-multus/multus-n8656","openshift-multus/network-metrics-daemon-gzx6v","openshift-network-diagnostics/network-check-target-64z5r","kube-system/global-pull-secret-syncer-tdwcc","kube-system/konnectivity-agent-75wzw","kube-system/kube-apiserver-proxy-ip-10-0-136-239.ec2.internal","openshift-dns/node-resolver-nc97c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal","openshift-network-operator/iptables-alerter-wbrnt","openshift-ovn-kubernetes/ovnkube-node-kc2qj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr","openshift-cluster-node-tuning-operator/tuned-8shmh","openshift-image-registry/node-ca-n4p4l"]
Jul 28 17:17:05.492660 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.492633    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wbrnt"
Jul 28 17:17:05.494136 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.494116    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.495419 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.495397    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:05.495520 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.495477    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-td5dk\""
Jul 28 17:17:05.495520 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:05.495474    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:05.495520 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.495486    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 17:17:05.495684 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.495566    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:17:05.495742 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.495709    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 17:17:05.496417 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.496392    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:17:05.496670 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.496653    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xp4xw\""
Jul 28 17:17:05.496936 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.496919    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 17:17:05.497183 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.497163    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:05.497286 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:05.497229    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:05.498961 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.498933    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:05.499199 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:05.499004    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:05.501062 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.500794    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-75wzw"
Jul 28 17:17:05.501959 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.501937    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n4p4l"
Jul 28 17:17:05.504105 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.502778    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 17:17:05.504105 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.503519    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7rxd8\""
Jul 28 17:17:05.504105 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.503551    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nc97c"
Jul 28 17:17:05.504105 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.503961    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 17:17:05.504105 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.503996    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 17:17:05.505185 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.504890    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.505652 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.505496    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 17:17:05.505652 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.505555    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 17:17:05.505652 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.505574    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ptng8\""
Jul 28 17:17:05.505652 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.505633    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 17:17:05.505963 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.505951    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 17:17:05.506278 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.506249    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 17:17:05.506278 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.506258    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r4jfd\""
Jul 28 17:17:05.506529 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.506509    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.508352 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.507262    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 17:17:05.508352 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.507584    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 17:17:05.508352 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.507987    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 17:17:05.508352 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.508091    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6h7zl\""
Jul 28 17:17:05.508352 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.508190    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 17:17:05.508820 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.508798    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 17:17:05.509261 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.509219    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t6k2l\""
Jul 28 17:17:05.509348 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.509263    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 17:17:05.511885 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.511846    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.514959 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.514936    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 17:17:05.515205 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.515189    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.515315 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.515292    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 17:17:05.515374 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.515358    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 17:17:05.515776 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.515755    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-run\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.515845 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.515797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wr9f\" (UniqueName: \"kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f\") pod \"network-check-target-64z5r\" (UID: \"0352e080-a0e6-4977-9f2c-fef0f6488583\") " pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:05.515845 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.515828    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 17:17:05.515978 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.515842    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7q5gm\""
Jul 28 17:17:05.516218 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.515842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mvpc\" (UniqueName: \"kubernetes.io/projected/c72a9af3-651a-493b-b70f-5f70b05ebdf5-kube-api-access-9mvpc\") pod \"node-ca-n4p4l\" (UID: \"c72a9af3-651a-493b-b70f-5f70b05ebdf5\") " pod="openshift-image-registry/node-ca-n4p4l"
Jul 28 17:17:05.516320 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/09a1f566-ddd6-4867-be93-31d4d4b9f98f-dbus\") pod \"global-pull-secret-syncer-tdwcc\" (UID: \"09a1f566-ddd6-4867-be93-31d4d4b9f98f\") " pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:05.516375 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c72a9af3-651a-493b-b70f-5f70b05ebdf5-host\") pod \"node-ca-n4p4l\" (UID: \"c72a9af3-651a-493b-b70f-5f70b05ebdf5\") " pod="openshift-image-registry/node-ca-n4p4l"
Jul 28 17:17:05.516427 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/09a1f566-ddd6-4867-be93-31d4d4b9f98f-kubelet-config\") pod \"global-pull-secret-syncer-tdwcc\" (UID: \"09a1f566-ddd6-4867-be93-31d4d4b9f98f\") " pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:05.516480 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516430    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79c76dc5-da15-4018-af28-c2e1694def83-konnectivity-ca\") pod \"konnectivity-agent-75wzw\" (UID: \"79c76dc5-da15-4018-af28-c2e1694def83\") " pod="kube-system/konnectivity-agent-75wzw"
Jul 28 17:17:05.516549 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-var-lib-kubelet\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.516617 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516600    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs\") pod \"network-metrics-daemon-gzx6v\" (UID: \"cd4c39fa-bc1a-43d4-bd68-a32079e1b915\") " pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:05.516668 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516637    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-systemd\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.516720 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516668    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-kubernetes\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.516770 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-sysctl-conf\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.516770 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516741    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c72a9af3-651a-493b-b70f-5f70b05ebdf5-serviceca\") pod \"node-ca-n4p4l\" (UID: \"c72a9af3-651a-493b-b70f-5f70b05ebdf5\") " pod="openshift-image-registry/node-ca-n4p4l"
Jul 28 17:17:05.516896 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516770    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7911e02d-0046-4260-8006-0c44bd288d44-tmp-dir\") pod \"node-resolver-nc97c\" (UID: \"7911e02d-0046-4260-8006-0c44bd288d44\") " pod="openshift-dns/node-resolver-nc97c"
Jul 28 17:17:05.516896 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516803    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csft7\" (UniqueName: \"kubernetes.io/projected/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-kube-api-access-csft7\") pod \"network-metrics-daemon-gzx6v\" (UID: \"cd4c39fa-bc1a-43d4-bd68-a32079e1b915\") " pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:05.516896 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79c76dc5-da15-4018-af28-c2e1694def83-agent-certs\") pod \"konnectivity-agent-75wzw\" (UID: \"79c76dc5-da15-4018-af28-c2e1694def83\") " pod="kube-system/konnectivity-agent-75wzw"
Jul 28 17:17:05.516896 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ddc85677-135d-4969-8239-538f62db9d7f-etc-tuned\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.517097 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516910    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7911e02d-0046-4260-8006-0c44bd288d44-hosts-file\") pod \"node-resolver-nc97c\" (UID: \"7911e02d-0046-4260-8006-0c44bd288d44\") " pod="openshift-dns/node-resolver-nc97c"
Jul 28 17:17:05.517097 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516934    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 17:17:05.517194 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.516939    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret\") pod \"global-pull-secret-syncer-tdwcc\" (UID: \"09a1f566-ddd6-4867-be93-31d4d4b9f98f\") " pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:05.517265 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.517232    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-sys\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.517399 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.517382    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2nrm\" (UniqueName: \"kubernetes.io/projected/98a2385b-450b-4192-bfd2-f6e192a0b1a1-kube-api-access-m2nrm\") pod \"iptables-alerter-wbrnt\" (UID: \"98a2385b-450b-4192-bfd2-f6e192a0b1a1\") " pod="openshift-network-operator/iptables-alerter-wbrnt"
Jul 28 17:17:05.517453 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.517419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-modprobe-d\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.517503 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.517469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddc85677-135d-4969-8239-538f62db9d7f-tmp\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.517579 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.517560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g6wq\" (UniqueName: \"kubernetes.io/projected/ddc85677-135d-4969-8239-538f62db9d7f-kube-api-access-8g6wq\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.517646 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.517616    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98a2385b-450b-4192-bfd2-f6e192a0b1a1-host-slash\") pod \"iptables-alerter-wbrnt\" (UID: \"98a2385b-450b-4192-bfd2-f6e192a0b1a1\") " pod="openshift-network-operator/iptables-alerter-wbrnt"
Jul 28 17:17:05.517703 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.517678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-sysconfig\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.517805 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.517706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-host\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.517805 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.517761    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98a2385b-450b-4192-bfd2-f6e192a0b1a1-iptables-alerter-script\") pod \"iptables-alerter-wbrnt\" (UID: \"98a2385b-450b-4192-bfd2-f6e192a0b1a1\") " pod="openshift-network-operator/iptables-alerter-wbrnt"
Jul 28 17:17:05.517903 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.517822    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-sysctl-d\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.517903 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.517853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-lib-modules\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.517903 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.517874    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9srs\" (UniqueName: \"kubernetes.io/projected/7911e02d-0046-4260-8006-0c44bd288d44-kube-api-access-j9srs\") pod \"node-resolver-nc97c\" (UID: \"7911e02d-0046-4260-8006-0c44bd288d44\") " pod="openshift-dns/node-resolver-nc97c"
Jul 28 17:17:05.519091 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.519009    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 17:17:05.519091 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.519038    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 17:17:05.519091 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.519058    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 17:17:05.519352 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.519303    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ksdjw\""
Jul 28 17:17:05.519539 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.519518    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 17:17:05.521625 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.521604    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 17:17:05.551323 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.551298    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pb4px"
Jul 28 17:17:05.564657 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.564592    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pb4px"
Jul 28 17:17:05.604444 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.604413    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 17:17:05.618967 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.618935    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-kubelet\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.619140 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.618975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-systemd-units\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.619140 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-node-log\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.619140 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret\") pod \"global-pull-secret-syncer-tdwcc\" (UID: \"09a1f566-ddd6-4867-be93-31d4d4b9f98f\") " pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:05.619140 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-sys\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.619359 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619149    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2nrm\" (UniqueName: \"kubernetes.io/projected/98a2385b-450b-4192-bfd2-f6e192a0b1a1-kube-api-access-m2nrm\") pod \"iptables-alerter-wbrnt\" (UID: \"98a2385b-450b-4192-bfd2-f6e192a0b1a1\") " pod="openshift-network-operator/iptables-alerter-wbrnt"
Jul 28 17:17:05.619359 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:05.619186    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:05.619359 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619180    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddc85677-135d-4969-8239-538f62db9d7f-tmp\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.619359 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g6wq\" (UniqueName: \"kubernetes.io/projected/ddc85677-135d-4969-8239-538f62db9d7f-kube-api-access-8g6wq\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.619359 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:05.619250    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret podName:09a1f566-ddd6-4867-be93-31d4d4b9f98f nodeName:}" failed. No retries permitted until 2026-07-28 17:17:06.119232131 +0000 UTC m=+2.951463358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret") pod "global-pull-secret-syncer-tdwcc" (UID: "09a1f566-ddd6-4867-be93-31d4d4b9f98f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:05.619359 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-cnibin\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.619359 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619306    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hzpb\" (UniqueName: \"kubernetes.io/projected/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-kube-api-access-5hzpb\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.619359 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98a2385b-450b-4192-bfd2-f6e192a0b1a1-host-slash\") pod \"iptables-alerter-wbrnt\" (UID: \"98a2385b-450b-4192-bfd2-f6e192a0b1a1\") " pod="openshift-network-operator/iptables-alerter-wbrnt"
Jul 28 17:17:05.619359 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-host\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.619808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-multus-socket-dir-parent\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.619808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-var-lib-cni-bin\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.619808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-var-lib-kubelet\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.619808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-etc-kubernetes\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.619808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619465    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/551eb815-630c-41f7-888d-39ef9ed0681b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.619808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619485    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-slash\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.619808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-lib-modules\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.619808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619532    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-run-multus-certs\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.619808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-run-ovn\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.619808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.619808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-etc-selinux\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.619808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619643    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wr9f\" (UniqueName: \"kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f\") pod \"network-check-target-64z5r\" (UID: \"0352e080-a0e6-4977-9f2c-fef0f6488583\") " pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:05.619808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619664    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mvpc\" (UniqueName: \"kubernetes.io/projected/c72a9af3-651a-493b-b70f-5f70b05ebdf5-kube-api-access-9mvpc\") pod \"node-ca-n4p4l\" (UID: \"c72a9af3-651a-493b-b70f-5f70b05ebdf5\") " pod="openshift-image-registry/node-ca-n4p4l"
Jul 28 17:17:05.619808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619691    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-run-k8s-cni-cncf-io\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.619808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619709    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c72a9af3-651a-493b-b70f-5f70b05ebdf5-host\") pod \"node-ca-n4p4l\" (UID: \"c72a9af3-651a-493b-b70f-5f70b05ebdf5\") " pod="openshift-image-registry/node-ca-n4p4l"
Jul 28 17:17:05.619808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/09a1f566-ddd6-4867-be93-31d4d4b9f98f-kubelet-config\") pod \"global-pull-secret-syncer-tdwcc\" (UID: \"09a1f566-ddd6-4867-be93-31d4d4b9f98f\") " pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619751    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-multus-daemon-config\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/030e36e0-4ec2-43b9-a317-e4e58138cc29-ovnkube-config\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-host\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg6hj\" (UniqueName: \"kubernetes.io/projected/8ebec48c-f07a-46fe-a818-ae38fee6026a-kube-api-access-vg6hj\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619734    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98a2385b-450b-4192-bfd2-f6e192a0b1a1-host-slash\") pod \"iptables-alerter-wbrnt\" (UID: \"98a2385b-450b-4192-bfd2-f6e192a0b1a1\") " pod="openshift-network-operator/iptables-alerter-wbrnt"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619914    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-sys\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619949    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c72a9af3-651a-493b-b70f-5f70b05ebdf5-host\") pod \"node-ca-n4p4l\" (UID: \"c72a9af3-651a-493b-b70f-5f70b05ebdf5\") " pod="openshift-image-registry/node-ca-n4p4l"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.619956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-log-socket\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620001    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/030e36e0-4ec2-43b9-a317-e4e58138cc29-env-overrides\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620037    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-lib-modules\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620059    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/09a1f566-ddd6-4867-be93-31d4d4b9f98f-kubelet-config\") pod \"global-pull-secret-syncer-tdwcc\" (UID: \"09a1f566-ddd6-4867-be93-31d4d4b9f98f\") " pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-socket-dir\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-kubernetes\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620132    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7911e02d-0046-4260-8006-0c44bd288d44-tmp-dir\") pod \"node-resolver-nc97c\" (UID: \"7911e02d-0046-4260-8006-0c44bd288d44\") " pod="openshift-dns/node-resolver-nc97c"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620203    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-kubernetes\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79c76dc5-da15-4018-af28-c2e1694def83-agent-certs\") pod \"konnectivity-agent-75wzw\" (UID: \"79c76dc5-da15-4018-af28-c2e1694def83\") " pod="kube-system/konnectivity-agent-75wzw"
Jul 28 17:17:05.620589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620269    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-multus-conf-dir\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620310    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-etc-openvswitch\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620318    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-run-openvswitch\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-run-ovn-kubernetes\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-sys-fs\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-modprobe-d\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-system-cni-dir\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/551eb815-630c-41f7-888d-39ef9ed0681b-system-cni-dir\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/551eb815-630c-41f7-888d-39ef9ed0681b-cni-binary-copy\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620510    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7911e02d-0046-4260-8006-0c44bd288d44-tmp-dir\") pod \"node-resolver-nc97c\" (UID: \"7911e02d-0046-4260-8006-0c44bd288d44\") " pod="openshift-dns/node-resolver-nc97c"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-run-systemd\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620571    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-registration-dir\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620587    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-modprobe-d\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-sysconfig\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620629    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-run-netns\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620646    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-sysconfig\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.621296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/551eb815-630c-41f7-888d-39ef9ed0681b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620704    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhjm5\" (UniqueName: \"kubernetes.io/projected/551eb815-630c-41f7-888d-39ef9ed0681b-kube-api-access-nhjm5\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620752    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-cni-netd\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620771    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwq7v\" (UniqueName: \"kubernetes.io/projected/030e36e0-4ec2-43b9-a317-e4e58138cc29-kube-api-access-pwq7v\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98a2385b-450b-4192-bfd2-f6e192a0b1a1-iptables-alerter-script\") pod \"iptables-alerter-wbrnt\" (UID: \"98a2385b-450b-4192-bfd2-f6e192a0b1a1\") " pod="openshift-network-operator/iptables-alerter-wbrnt"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620880    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-sysctl-d\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9srs\" (UniqueName: \"kubernetes.io/projected/7911e02d-0046-4260-8006-0c44bd288d44-kube-api-access-j9srs\") pod \"node-resolver-nc97c\" (UID: \"7911e02d-0046-4260-8006-0c44bd288d44\") " pod="openshift-dns/node-resolver-nc97c"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620935    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-var-lib-cni-multus\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620958    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-run-netns\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.620986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-device-dir\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-run\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/09a1f566-ddd6-4867-be93-31d4d4b9f98f-dbus\") pod \"global-pull-secret-syncer-tdwcc\" (UID: \"09a1f566-ddd6-4867-be93-31d4d4b9f98f\") " pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621061    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79c76dc5-da15-4018-af28-c2e1694def83-konnectivity-ca\") pod \"konnectivity-agent-75wzw\" (UID: \"79c76dc5-da15-4018-af28-c2e1694def83\") " pod="kube-system/konnectivity-agent-75wzw"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621086    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-var-lib-openvswitch\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621094    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-sysctl-d\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/030e36e0-4ec2-43b9-a317-e4e58138cc29-ovnkube-script-lib\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.622186 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621145    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-var-lib-kubelet\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621162    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-run\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621184    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs\") pod \"network-metrics-daemon-gzx6v\" (UID: \"cd4c39fa-bc1a-43d4-bd68-a32079e1b915\") " pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621222    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-multus-cni-dir\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621277    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/09a1f566-ddd6-4867-be93-31d4d4b9f98f-dbus\") pod \"global-pull-secret-syncer-tdwcc\" (UID: \"09a1f566-ddd6-4867-be93-31d4d4b9f98f\") " pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621350    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-var-lib-kubelet\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-os-release\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621455    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/551eb815-630c-41f7-888d-39ef9ed0681b-cnibin\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:05.621461    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621478    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/551eb815-630c-41f7-888d-39ef9ed0681b-os-release\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-cni-bin\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98a2385b-450b-4192-bfd2-f6e192a0b1a1-iptables-alerter-script\") pod \"iptables-alerter-wbrnt\" (UID: \"98a2385b-450b-4192-bfd2-f6e192a0b1a1\") " pod="openshift-network-operator/iptables-alerter-wbrnt"
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:05.621519    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs podName:cd4c39fa-bc1a-43d4-bd68-a32079e1b915 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:06.121501994 +0000 UTC m=+2.953733223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs") pod "network-metrics-daemon-gzx6v" (UID: "cd4c39fa-bc1a-43d4-bd68-a32079e1b915") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621610    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-systemd\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621638    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-sysctl-conf\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c72a9af3-651a-493b-b70f-5f70b05ebdf5-serviceca\") pod \"node-ca-n4p4l\" (UID: \"c72a9af3-651a-493b-b70f-5f70b05ebdf5\") " pod="openshift-image-registry/node-ca-n4p4l"
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621675    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-systemd\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.623021 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csft7\" (UniqueName: \"kubernetes.io/projected/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-kube-api-access-csft7\") pod \"network-metrics-daemon-gzx6v\" (UID: \"cd4c39fa-bc1a-43d4-bd68-a32079e1b915\") " pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:05.623802 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/551eb815-630c-41f7-888d-39ef9ed0681b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.623802 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/030e36e0-4ec2-43b9-a317-e4e58138cc29-ovn-node-metrics-cert\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.623802 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621760    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79c76dc5-da15-4018-af28-c2e1694def83-konnectivity-ca\") pod \"konnectivity-agent-75wzw\" (UID: \"79c76dc5-da15-4018-af28-c2e1694def83\") " pod="kube-system/konnectivity-agent-75wzw"
Jul 28 17:17:05.623802 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621770    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ddc85677-135d-4969-8239-538f62db9d7f-etc-tuned\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.623802 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621796    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7911e02d-0046-4260-8006-0c44bd288d44-hosts-file\") pod \"node-resolver-nc97c\" (UID: \"7911e02d-0046-4260-8006-0c44bd288d44\") " pod="openshift-dns/node-resolver-nc97c"
Jul 28 17:17:05.623802 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621810    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ddc85677-135d-4969-8239-538f62db9d7f-etc-sysctl-conf\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.623802 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-cni-binary-copy\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.623802 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-hostroot\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.623802 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.621999    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7911e02d-0046-4260-8006-0c44bd288d44-hosts-file\") pod \"node-resolver-nc97c\" (UID: \"7911e02d-0046-4260-8006-0c44bd288d44\") " pod="openshift-dns/node-resolver-nc97c"
Jul 28 17:17:05.623802 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.622119    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c72a9af3-651a-493b-b70f-5f70b05ebdf5-serviceca\") pod \"node-ca-n4p4l\" (UID: \"c72a9af3-651a-493b-b70f-5f70b05ebdf5\") " pod="openshift-image-registry/node-ca-n4p4l"
Jul 28 17:17:05.624427 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.623965    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddc85677-135d-4969-8239-538f62db9d7f-tmp\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.624427 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.624255    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79c76dc5-da15-4018-af28-c2e1694def83-agent-certs\") pod \"konnectivity-agent-75wzw\" (UID: \"79c76dc5-da15-4018-af28-c2e1694def83\") " pod="kube-system/konnectivity-agent-75wzw"
Jul 28 17:17:05.624427 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.624285    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ddc85677-135d-4969-8239-538f62db9d7f-etc-tuned\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.627574 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:05.627552    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:17:05.627712 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:05.627580    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:17:05.627712 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:05.627593    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7wr9f for pod openshift-network-diagnostics/network-check-target-64z5r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:05.627712 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:05.627655    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f podName:0352e080-a0e6-4977-9f2c-fef0f6488583 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:06.127634749 +0000 UTC m=+2.959865991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7wr9f" (UniqueName: "kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f") pod "network-check-target-64z5r" (UID: "0352e080-a0e6-4977-9f2c-fef0f6488583") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:05.629812 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.629784    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g6wq\" (UniqueName: \"kubernetes.io/projected/ddc85677-135d-4969-8239-538f62db9d7f-kube-api-access-8g6wq\") pod \"tuned-8shmh\" (UID: \"ddc85677-135d-4969-8239-538f62db9d7f\") " pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.630529 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.630505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9srs\" (UniqueName: \"kubernetes.io/projected/7911e02d-0046-4260-8006-0c44bd288d44-kube-api-access-j9srs\") pod \"node-resolver-nc97c\" (UID: \"7911e02d-0046-4260-8006-0c44bd288d44\") " pod="openshift-dns/node-resolver-nc97c"
Jul 28 17:17:05.631307 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.631282    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mvpc\" (UniqueName: \"kubernetes.io/projected/c72a9af3-651a-493b-b70f-5f70b05ebdf5-kube-api-access-9mvpc\") pod \"node-ca-n4p4l\" (UID: \"c72a9af3-651a-493b-b70f-5f70b05ebdf5\") " pod="openshift-image-registry/node-ca-n4p4l"
Jul 28 17:17:05.631695 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.631673    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2nrm\" (UniqueName: \"kubernetes.io/projected/98a2385b-450b-4192-bfd2-f6e192a0b1a1-kube-api-access-m2nrm\") pod \"iptables-alerter-wbrnt\" (UID: \"98a2385b-450b-4192-bfd2-f6e192a0b1a1\") " pod="openshift-network-operator/iptables-alerter-wbrnt"
Jul 28 17:17:05.633307 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.633277    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csft7\" (UniqueName: \"kubernetes.io/projected/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-kube-api-access-csft7\") pod \"network-metrics-daemon-gzx6v\" (UID: \"cd4c39fa-bc1a-43d4-bd68-a32079e1b915\") " pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:05.691879 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.691700    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-239.ec2.internal" event={"ID":"f5a2e8ae67128845bf7e17c11605aa90","Type":"ContainerStarted","Data":"fc3ff0615b33e3cd02b93865796107671af4bad5e5457b6bcdc0531eb0c7c2a3"}
Jul 28 17:17:05.695665 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.695636    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal" event={"ID":"b2117e6a4c54c809a46a13ea3b96feab","Type":"ContainerStarted","Data":"660f29d240d6544649aa3c6f8666bc496689c8f81730831d9f26400b316defc0"}
Jul 28 17:17:05.722572 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722535    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-run-k8s-cni-cncf-io\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.722745 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-multus-daemon-config\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.722745 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/030e36e0-4ec2-43b9-a317-e4e58138cc29-ovnkube-config\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.722745 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg6hj\" (UniqueName: \"kubernetes.io/projected/8ebec48c-f07a-46fe-a818-ae38fee6026a-kube-api-access-vg6hj\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.722745 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722666    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-log-socket\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.722745 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722671    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-run-k8s-cni-cncf-io\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.722745 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722687    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/030e36e0-4ec2-43b9-a317-e4e58138cc29-env-overrides\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.722745 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-socket-dir\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.722745 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722721    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-multus-conf-dir\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.722745 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-etc-openvswitch\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-run-openvswitch\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-run-ovn-kubernetes\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722797    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-sys-fs\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-system-cni-dir\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/551eb815-630c-41f7-888d-39ef9ed0681b-system-cni-dir\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/551eb815-630c-41f7-888d-39ef9ed0681b-cni-binary-copy\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-run-systemd\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722907    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-registration-dir\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-run-netns\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/551eb815-630c-41f7-888d-39ef9ed0681b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhjm5\" (UniqueName: \"kubernetes.io/projected/551eb815-630c-41f7-888d-39ef9ed0681b-kube-api-access-nhjm5\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722979    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-cni-netd\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.722998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwq7v\" (UniqueName: \"kubernetes.io/projected/030e36e0-4ec2-43b9-a317-e4e58138cc29-kube-api-access-pwq7v\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723034    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-var-lib-cni-multus\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-run-netns\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.723145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723065    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-device-dir\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723084    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-var-lib-openvswitch\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723102    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/030e36e0-4ec2-43b9-a317-e4e58138cc29-ovnkube-script-lib\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-multus-cni-dir\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723143    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-os-release\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/551eb815-630c-41f7-888d-39ef9ed0681b-cnibin\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/551eb815-630c-41f7-888d-39ef9ed0681b-os-release\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723200    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-cni-bin\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/551eb815-630c-41f7-888d-39ef9ed0681b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/030e36e0-4ec2-43b9-a317-e4e58138cc29-ovn-node-metrics-cert\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-cni-binary-copy\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723270    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-hostroot\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-kubelet\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723306    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-systemd-units\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723321    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-node-log\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-cnibin\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723353    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-multus-daemon-config\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hzpb\" (UniqueName: \"kubernetes.io/projected/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-kube-api-access-5hzpb\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.723909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723409    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-var-lib-cni-multus\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723436    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-log-socket\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723736    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/030e36e0-4ec2-43b9-a317-e4e58138cc29-env-overrides\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-socket-dir\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723811    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/030e36e0-4ec2-43b9-a317-e4e58138cc29-ovnkube-config\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723942    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-multus-conf-dir\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.723977    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-etc-openvswitch\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724012    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-run-openvswitch\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724008    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/551eb815-630c-41f7-888d-39ef9ed0681b-cnibin\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724030    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-multus-cni-dir\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724054    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-os-release\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724061    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-run-netns\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724062    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-device-dir\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724081    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-cni-bin\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724093    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-run-ovn-kubernetes\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724094    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-var-lib-openvswitch\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724098    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-systemd-units\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/551eb815-630c-41f7-888d-39ef9ed0681b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.724853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-system-cni-dir\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724141    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/551eb815-630c-41f7-888d-39ef9ed0681b-os-release\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724174    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-sys-fs\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724178    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-node-log\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724184    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-cni-netd\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724239    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-registration-dir\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724230    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-run-systemd\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724291    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-multus-socket-dir-parent\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724325    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-var-lib-cni-bin\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724355    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-var-lib-kubelet\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724381    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-etc-kubernetes\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724427    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-run-netns\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724459    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-hostroot\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-multus-socket-dir-parent\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724515    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724554    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-cnibin\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724563    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-kubelet\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/551eb815-630c-41f7-888d-39ef9ed0681b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.725593 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724600    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/551eb815-630c-41f7-888d-39ef9ed0681b-system-cni-dir\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724607    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-cni-binary-copy\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724636    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-var-lib-cni-bin\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724658    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/030e36e0-4ec2-43b9-a317-e4e58138cc29-ovnkube-script-lib\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724681    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-var-lib-kubelet\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-slash\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724727    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-etc-kubernetes\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724810    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/551eb815-630c-41f7-888d-39ef9ed0681b-cni-binary-copy\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-run-multus-certs\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724846    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-slash\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724915    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-host-run-multus-certs\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724955    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-run-ovn\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724991    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/551eb815-630c-41f7-888d-39ef9ed0681b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.724997    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-run-ovn\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.725026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/030e36e0-4ec2-43b9-a317-e4e58138cc29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.725031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-etc-selinux\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.726263 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.725141    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/551eb815-630c-41f7-888d-39ef9ed0681b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.727152 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.725184    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ebec48c-f07a-46fe-a818-ae38fee6026a-etc-selinux\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.727152 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.726900    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/030e36e0-4ec2-43b9-a317-e4e58138cc29-ovn-node-metrics-cert\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.732068 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.732018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg6hj\" (UniqueName: \"kubernetes.io/projected/8ebec48c-f07a-46fe-a818-ae38fee6026a-kube-api-access-vg6hj\") pod \"aws-ebs-csi-driver-node-xbtvr\" (UID: \"8ebec48c-f07a-46fe-a818-ae38fee6026a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:05.733197 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.733175    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwq7v\" (UniqueName: \"kubernetes.io/projected/030e36e0-4ec2-43b9-a317-e4e58138cc29-kube-api-access-pwq7v\") pod \"ovnkube-node-kc2qj\" (UID: \"030e36e0-4ec2-43b9-a317-e4e58138cc29\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.734404 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.734381    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hzpb\" (UniqueName: \"kubernetes.io/projected/184d85bc-8ddc-40a9-bbfc-65dd6679d5a8-kube-api-access-5hzpb\") pod \"multus-n8656\" (UID: \"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8\") " pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.734639 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.734619    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhjm5\" (UniqueName: \"kubernetes.io/projected/551eb815-630c-41f7-888d-39ef9ed0681b-kube-api-access-nhjm5\") pod \"multus-additional-cni-plugins-kn9rg\" (UID: \"551eb815-630c-41f7-888d-39ef9ed0681b\") " pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.812092 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.811816    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wbrnt"
Jul 28 17:17:05.820897 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.820676    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8shmh"
Jul 28 17:17:05.835338 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.835088    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-75wzw"
Jul 28 17:17:05.838127 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:05.838071    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc85677_135d_4969_8239_538f62db9d7f.slice/crio-6478f67949d03e276b195d00973dbd95bc279731661973b77d9a51c9ab6b7581 WatchSource:0}: Error finding container 6478f67949d03e276b195d00973dbd95bc279731661973b77d9a51c9ab6b7581: Status 404 returned error can't find the container with id 6478f67949d03e276b195d00973dbd95bc279731661973b77d9a51c9ab6b7581
Jul 28 17:17:05.845471 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.845298    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n4p4l"
Jul 28 17:17:05.853212 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.853041    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nc97c"
Jul 28 17:17:05.857902 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:05.857849    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c76dc5_da15_4018_af28_c2e1694def83.slice/crio-7ac0ef8782a540b2a61eacc0b6fdce34458fa4aa56040cc49c3c14cd9b774761 WatchSource:0}: Error finding container 7ac0ef8782a540b2a61eacc0b6fdce34458fa4aa56040cc49c3c14cd9b774761: Status 404 returned error can't find the container with id 7ac0ef8782a540b2a61eacc0b6fdce34458fa4aa56040cc49c3c14cd9b774761
Jul 28 17:17:05.858248 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:05.858222    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72a9af3_651a_493b_b70f_5f70b05ebdf5.slice/crio-01726035070c449d2f2c5640db29fe8150d3797d5c5843bc0bf6bbf0844bf690 WatchSource:0}: Error finding container 01726035070c449d2f2c5640db29fe8150d3797d5c5843bc0bf6bbf0844bf690: Status 404 returned error can't find the container with id 01726035070c449d2f2c5640db29fe8150d3797d5c5843bc0bf6bbf0844bf690
Jul 28 17:17:05.863746 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.863728    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n8656"
Jul 28 17:17:05.864059 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:05.863996    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7911e02d_0046_4260_8006_0c44bd288d44.slice/crio-8a0d980949d69a81eef0444fe9bb719fc8a9b29b5b4b821823ee687913c5af82 WatchSource:0}: Error finding container 8a0d980949d69a81eef0444fe9bb719fc8a9b29b5b4b821823ee687913c5af82: Status 404 returned error can't find the container with id 8a0d980949d69a81eef0444fe9bb719fc8a9b29b5b4b821823ee687913c5af82
Jul 28 17:17:05.872046 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.871904    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kn9rg"
Jul 28 17:17:05.880749 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.880282    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:05.884402 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:05.884373    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551eb815_630c_41f7_888d_39ef9ed0681b.slice/crio-f9e7c69262f5beb8fa46ec66e384363a203237dbb46c1bf51f7a16d277285e8d WatchSource:0}: Error finding container f9e7c69262f5beb8fa46ec66e384363a203237dbb46c1bf51f7a16d277285e8d: Status 404 returned error can't find the container with id f9e7c69262f5beb8fa46ec66e384363a203237dbb46c1bf51f7a16d277285e8d
Jul 28 17:17:05.889763 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:05.889742    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr"
Jul 28 17:17:06.128248 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:06.128156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs\") pod \"network-metrics-daemon-gzx6v\" (UID: \"cd4c39fa-bc1a-43d4-bd68-a32079e1b915\") " pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:06.128248 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:06.128227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret\") pod \"global-pull-secret-syncer-tdwcc\" (UID: \"09a1f566-ddd6-4867-be93-31d4d4b9f98f\") " pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:06.128474 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:06.128275    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wr9f\" (UniqueName: \"kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f\") pod \"network-check-target-64z5r\" (UID: \"0352e080-a0e6-4977-9f2c-fef0f6488583\") " pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:06.128474 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:06.128342    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:06.128474 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:06.128399    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:06.128474 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:06.128425    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs podName:cd4c39fa-bc1a-43d4-bd68-a32079e1b915 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:07.128406485 +0000 UTC m=+3.960637713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs") pod "network-metrics-daemon-gzx6v" (UID: "cd4c39fa-bc1a-43d4-bd68-a32079e1b915") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:06.128474 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:06.128425    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:17:06.128474 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:06.128450    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:17:06.128474 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:06.128460    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret podName:09a1f566-ddd6-4867-be93-31d4d4b9f98f nodeName:}" failed. No retries permitted until 2026-07-28 17:17:07.128443563 +0000 UTC m=+3.960675000 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret") pod "global-pull-secret-syncer-tdwcc" (UID: "09a1f566-ddd6-4867-be93-31d4d4b9f98f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:06.128474 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:06.128465    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7wr9f for pod openshift-network-diagnostics/network-check-target-64z5r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:06.128869 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:06.128533    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f podName:0352e080-a0e6-4977-9f2c-fef0f6488583 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:07.128513761 +0000 UTC m=+3.960745022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7wr9f" (UniqueName: "kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f") pod "network-check-target-64z5r" (UID: "0352e080-a0e6-4977-9f2c-fef0f6488583") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:06.567701 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:06.567655    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:12:06 +0000 UTC" deadline="2027-12-30 12:51:46.194833679 +0000 UTC"
Jul 28 17:17:06.567701 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:06.567695    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12475h34m39.627144085s"
Jul 28 17:17:06.685526 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:06.685497    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:06.685715 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:06.685534    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:06.685715 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:06.685638    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:06.685833 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:06.685770    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:06.698481 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:06.698443    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn9rg" event={"ID":"551eb815-630c-41f7-888d-39ef9ed0681b","Type":"ContainerStarted","Data":"f9e7c69262f5beb8fa46ec66e384363a203237dbb46c1bf51f7a16d277285e8d"}
Jul 28 17:17:06.699828 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:06.699787    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n8656" event={"ID":"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8","Type":"ContainerStarted","Data":"7c80a3babef1300a216dee2ad8e0c94476a71473e2c90d7378e6ae01d2356e13"}
Jul 28 17:17:06.701160 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:06.701138    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nc97c" event={"ID":"7911e02d-0046-4260-8006-0c44bd288d44","Type":"ContainerStarted","Data":"8a0d980949d69a81eef0444fe9bb719fc8a9b29b5b4b821823ee687913c5af82"}
Jul 28 17:17:06.702440 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:06.702410    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n4p4l" event={"ID":"c72a9af3-651a-493b-b70f-5f70b05ebdf5","Type":"ContainerStarted","Data":"01726035070c449d2f2c5640db29fe8150d3797d5c5843bc0bf6bbf0844bf690"}
Jul 28 17:17:06.703575 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:06.703550    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-75wzw" event={"ID":"79c76dc5-da15-4018-af28-c2e1694def83","Type":"ContainerStarted","Data":"7ac0ef8782a540b2a61eacc0b6fdce34458fa4aa56040cc49c3c14cd9b774761"}
Jul 28 17:17:06.704735 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:06.704710    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8shmh" event={"ID":"ddc85677-135d-4969-8239-538f62db9d7f","Type":"ContainerStarted","Data":"6478f67949d03e276b195d00973dbd95bc279731661973b77d9a51c9ab6b7581"}
Jul 28 17:17:06.705958 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:06.705933    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wbrnt" event={"ID":"98a2385b-450b-4192-bfd2-f6e192a0b1a1","Type":"ContainerStarted","Data":"1daf8ea436e86f91d36143ba1e864c8e9951948a74bf2e51a275df320191ed5e"}
Jul 28 17:17:06.842651 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:06.842572    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:17:07.090885 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:07.090779    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod030e36e0_4ec2_43b9_a317_e4e58138cc29.slice/crio-a93f436dfee68f81641c4b6cec285abf58dbe393fc7c5d5be177bafc4ca0ec39 WatchSource:0}: Error finding container a93f436dfee68f81641c4b6cec285abf58dbe393fc7c5d5be177bafc4ca0ec39: Status 404 returned error can't find the container with id a93f436dfee68f81641c4b6cec285abf58dbe393fc7c5d5be177bafc4ca0ec39
Jul 28 17:17:07.135122 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:07.135091    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ebec48c_f07a_46fe_a818_ae38fee6026a.slice/crio-804a6c3d764b667f7f2a6a908ab01d933776c5954b94b5e915f828d539e7429e WatchSource:0}: Error finding container 804a6c3d764b667f7f2a6a908ab01d933776c5954b94b5e915f828d539e7429e: Status 404 returned error can't find the container with id 804a6c3d764b667f7f2a6a908ab01d933776c5954b94b5e915f828d539e7429e
Jul 28 17:17:07.137515 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:07.137135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wr9f\" (UniqueName: \"kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f\") pod \"network-check-target-64z5r\" (UID: \"0352e080-a0e6-4977-9f2c-fef0f6488583\") " pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:07.137515 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:07.137203    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs\") pod \"network-metrics-daemon-gzx6v\" (UID: \"cd4c39fa-bc1a-43d4-bd68-a32079e1b915\") " pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:07.137515 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:07.137360    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:17:07.137515 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:07.137386    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:17:07.137515 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:07.137402    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7wr9f for pod openshift-network-diagnostics/network-check-target-64z5r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:07.137515 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:07.137425    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:07.137515 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:07.137460    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f podName:0352e080-a0e6-4977-9f2c-fef0f6488583 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:09.137440131 +0000 UTC m=+5.969671372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7wr9f" (UniqueName: "kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f") pod "network-check-target-64z5r" (UID: "0352e080-a0e6-4977-9f2c-fef0f6488583") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:07.137515 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:07.137491    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs podName:cd4c39fa-bc1a-43d4-bd68-a32079e1b915 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:09.137472703 +0000 UTC m=+5.969703934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs") pod "network-metrics-daemon-gzx6v" (UID: "cd4c39fa-bc1a-43d4-bd68-a32079e1b915") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:07.137948 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:07.137528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret\") pod \"global-pull-secret-syncer-tdwcc\" (UID: \"09a1f566-ddd6-4867-be93-31d4d4b9f98f\") " pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:07.137948 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:07.137631    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:07.137948 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:07.137696    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret podName:09a1f566-ddd6-4867-be93-31d4d4b9f98f nodeName:}" failed. No retries permitted until 2026-07-28 17:17:09.137675567 +0000 UTC m=+5.969906812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret") pod "global-pull-secret-syncer-tdwcc" (UID: "09a1f566-ddd6-4867-be93-31d4d4b9f98f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:07.568846 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:07.568474    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:12:06 +0000 UTC" deadline="2028-04-24 14:50:41.527910896 +0000 UTC"
Jul 28 17:17:07.568846 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:07.568765    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15261h33m33.959151504s"
Jul 28 17:17:07.687650 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:07.687620    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:07.687804 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:07.687756    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:07.720422 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:07.719590    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr" event={"ID":"8ebec48c-f07a-46fe-a818-ae38fee6026a","Type":"ContainerStarted","Data":"804a6c3d764b667f7f2a6a908ab01d933776c5954b94b5e915f828d539e7429e"}
Jul 28 17:17:07.725070 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:07.725031    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj" event={"ID":"030e36e0-4ec2-43b9-a317-e4e58138cc29","Type":"ContainerStarted","Data":"a93f436dfee68f81641c4b6cec285abf58dbe393fc7c5d5be177bafc4ca0ec39"}
Jul 28 17:17:07.728749 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:07.728716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-239.ec2.internal" event={"ID":"f5a2e8ae67128845bf7e17c11605aa90","Type":"ContainerStarted","Data":"45b04f9510574b669975204e872c7abdfd58b44d9c7d4f6da81b224e8f6b0119"}
Jul 28 17:17:08.685045 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:08.685008    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:08.685544 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:08.685174    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:08.685626 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:08.685595    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:08.685719 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:08.685697    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:08.743884 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:08.742705    2563 generic.go:356] "Generic (PLEG): container finished" podID="b2117e6a4c54c809a46a13ea3b96feab" containerID="c1abf06fd0fd4c6a94a605e03318910c71db19f8b5fa79c703f87e21f4c2c357" exitCode=0
Jul 28 17:17:08.743884 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:08.743644    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal" event={"ID":"b2117e6a4c54c809a46a13ea3b96feab","Type":"ContainerDied","Data":"c1abf06fd0fd4c6a94a605e03318910c71db19f8b5fa79c703f87e21f4c2c357"}
Jul 28 17:17:08.761610 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:08.760807    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-239.ec2.internal" podStartSLOduration=3.7607845060000002 podStartE2EDuration="3.760784506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:17:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:07.748945827 +0000 UTC m=+4.581177071" watchObservedRunningTime="2026-07-28 17:17:08.760784506 +0000 UTC m=+5.593015759"
Jul 28 17:17:09.155440 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:09.155351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs\") pod \"network-metrics-daemon-gzx6v\" (UID: \"cd4c39fa-bc1a-43d4-bd68-a32079e1b915\") " pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:09.155440 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:09.155418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret\") pod \"global-pull-secret-syncer-tdwcc\" (UID: \"09a1f566-ddd6-4867-be93-31d4d4b9f98f\") " pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:09.155678 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:09.155465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wr9f\" (UniqueName: \"kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f\") pod \"network-check-target-64z5r\" (UID: \"0352e080-a0e6-4977-9f2c-fef0f6488583\") " pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:09.155678 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:09.155658    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:17:09.155782 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:09.155684    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:17:09.155782 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:09.155698    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7wr9f for pod openshift-network-diagnostics/network-check-target-64z5r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:09.155782 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:09.155764    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f podName:0352e080-a0e6-4977-9f2c-fef0f6488583 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:13.15574439 +0000 UTC m=+9.987975645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7wr9f" (UniqueName: "kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f") pod "network-check-target-64z5r" (UID: "0352e080-a0e6-4977-9f2c-fef0f6488583") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:09.156236 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:09.156212    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:09.156329 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:09.156276    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs podName:cd4c39fa-bc1a-43d4-bd68-a32079e1b915 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:13.156260126 +0000 UTC m=+9.988491359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs") pod "network-metrics-daemon-gzx6v" (UID: "cd4c39fa-bc1a-43d4-bd68-a32079e1b915") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:09.156393 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:09.156341    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:09.156393 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:09.156379    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret podName:09a1f566-ddd6-4867-be93-31d4d4b9f98f nodeName:}" failed. No retries permitted until 2026-07-28 17:17:13.156367774 +0000 UTC m=+9.988599005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret") pod "global-pull-secret-syncer-tdwcc" (UID: "09a1f566-ddd6-4867-be93-31d4d4b9f98f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:09.688655 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:09.688097    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:09.688655 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:09.688275    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:10.686475 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:10.685956    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:10.686475 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:10.686067    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:10.686475 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:10.686285    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:10.686475 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:10.686382    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:11.688370 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:11.686991    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:11.688370 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:11.687142    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:12.685927 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:12.685895    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:12.686125 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:12.686047    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:12.686125 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:12.686104    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:12.686284 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:12.686236    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:13.193070 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:13.193038    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret\") pod \"global-pull-secret-syncer-tdwcc\" (UID: \"09a1f566-ddd6-4867-be93-31d4d4b9f98f\") " pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:13.193527 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:13.193097    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wr9f\" (UniqueName: \"kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f\") pod \"network-check-target-64z5r\" (UID: \"0352e080-a0e6-4977-9f2c-fef0f6488583\") " pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:13.193527 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:13.193150    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs\") pod \"network-metrics-daemon-gzx6v\" (UID: \"cd4c39fa-bc1a-43d4-bd68-a32079e1b915\") " pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:13.193527 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:13.193275    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:13.193527 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:13.193337    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs podName:cd4c39fa-bc1a-43d4-bd68-a32079e1b915 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:21.193316805 +0000 UTC m=+18.025548051 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs") pod "network-metrics-daemon-gzx6v" (UID: "cd4c39fa-bc1a-43d4-bd68-a32079e1b915") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:13.193766 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:13.193629    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:13.193766 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:13.193652    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:17:13.193766 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:13.193678    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:17:13.193766 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:13.193683    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret podName:09a1f566-ddd6-4867-be93-31d4d4b9f98f nodeName:}" failed. No retries permitted until 2026-07-28 17:17:21.193668912 +0000 UTC m=+18.025900140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret") pod "global-pull-secret-syncer-tdwcc" (UID: "09a1f566-ddd6-4867-be93-31d4d4b9f98f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:13.193766 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:13.193692    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7wr9f for pod openshift-network-diagnostics/network-check-target-64z5r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:13.193766 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:13.193754    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f podName:0352e080-a0e6-4977-9f2c-fef0f6488583 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:21.193735891 +0000 UTC m=+18.025967142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7wr9f" (UniqueName: "kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f") pod "network-check-target-64z5r" (UID: "0352e080-a0e6-4977-9f2c-fef0f6488583") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:13.687663 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:13.686266    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:13.687663 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:13.686390    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:14.685757 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:14.685710    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:14.686265 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:14.685758    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:14.686265 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:14.685869    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:14.686265 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:14.686257    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:15.687058 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:15.686980    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:15.687479 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:15.687110    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:16.685518 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:16.685478    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:16.685518 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:16.685512    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:16.685761 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:16.685635    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:16.685832 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:16.685767    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:17.685641 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:17.685614    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:17.686124 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:17.685743    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:18.686052 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:18.686012    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:18.686516 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:18.686164    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:18.686575 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:18.686514    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:18.686673 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:18.686647    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:19.685828 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:19.685666    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:19.685828 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:19.685818    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:20.685835 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:20.685785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:20.686294 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:20.685938    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:20.686294 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:20.685995    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:20.686294 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:20.686104    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:21.261143 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:21.261108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret\") pod \"global-pull-secret-syncer-tdwcc\" (UID: \"09a1f566-ddd6-4867-be93-31d4d4b9f98f\") " pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:21.261399 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:21.261154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wr9f\" (UniqueName: \"kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f\") pod \"network-check-target-64z5r\" (UID: \"0352e080-a0e6-4977-9f2c-fef0f6488583\") " pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:21.261399 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:21.261278    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:21.261399 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:21.261293    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:17:21.261399 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:21.261307    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:17:21.261399 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:21.261317    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7wr9f for pod openshift-network-diagnostics/network-check-target-64z5r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:21.261399 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:21.261343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs\") pod \"network-metrics-daemon-gzx6v\" (UID: \"cd4c39fa-bc1a-43d4-bd68-a32079e1b915\") " pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:21.261399 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:21.261361    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f podName:0352e080-a0e6-4977-9f2c-fef0f6488583 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:37.261342819 +0000 UTC m=+34.093574044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7wr9f" (UniqueName: "kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f") pod "network-check-target-64z5r" (UID: "0352e080-a0e6-4977-9f2c-fef0f6488583") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:21.261399 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:21.261386    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret podName:09a1f566-ddd6-4867-be93-31d4d4b9f98f nodeName:}" failed. No retries permitted until 2026-07-28 17:17:37.261375998 +0000 UTC m=+34.093607228 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret") pod "global-pull-secret-syncer-tdwcc" (UID: "09a1f566-ddd6-4867-be93-31d4d4b9f98f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:21.261715 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:21.261416    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:21.261715 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:21.261464    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs podName:cd4c39fa-bc1a-43d4-bd68-a32079e1b915 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:37.261446961 +0000 UTC m=+34.093678193 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs") pod "network-metrics-daemon-gzx6v" (UID: "cd4c39fa-bc1a-43d4-bd68-a32079e1b915") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:21.685568 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:21.685486    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:21.685722 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:21.685656    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:22.685881 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:22.685847    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:22.686376 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:22.685906    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:22.686376 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:22.686024    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:22.686376 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:22.686155    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:23.685745 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:23.685715    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:23.685942 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:23.685809    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:24.685976 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:24.685940    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:24.686441 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:24.685985    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:24.686441 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:24.686094    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:24.686441 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:24.686231    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:25.685844 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:25.685785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:25.686102 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:25.685932    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:26.686239 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.685929    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:26.686895 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.685929    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:26.686895 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:26.686324    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:26.686895 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:26.686402    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:26.782949 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.782914    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal" event={"ID":"b2117e6a4c54c809a46a13ea3b96feab","Type":"ContainerStarted","Data":"3df52280d51b2be6d8f2df771a11ca4708e997d20a9dad9a2cb2ec78998cbfd7"}
Jul 28 17:17:26.784205 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.784180    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nc97c" event={"ID":"7911e02d-0046-4260-8006-0c44bd288d44","Type":"ContainerStarted","Data":"f78ec15c7ad3ddbc59afb283160365929ef98901d20ce91db9348d92abac88de"}
Jul 28 17:17:26.785445 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.785426    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n4p4l" event={"ID":"c72a9af3-651a-493b-b70f-5f70b05ebdf5","Type":"ContainerStarted","Data":"ca3eaeb33ca502b083b2673a4134879919c736415ef7843dca25307bc94b1ade"}
Jul 28 17:17:26.786743 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.786721    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-75wzw" event={"ID":"79c76dc5-da15-4018-af28-c2e1694def83","Type":"ContainerStarted","Data":"0043c1322e582b207aebb5f454ae6b631d81d574db39d363af4520b5a5615ce2"}
Jul 28 17:17:26.788213 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.788192    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8shmh" event={"ID":"ddc85677-135d-4969-8239-538f62db9d7f","Type":"ContainerStarted","Data":"1b5e169ee1c9365102925229119c0006aa906a8e45420411da4f715bab554ea9"}
Jul 28 17:17:26.789546 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.789528    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr" event={"ID":"8ebec48c-f07a-46fe-a818-ae38fee6026a","Type":"ContainerStarted","Data":"8cf8f42c89c1c498db8b9f46c8a5adac87a25257ef1b0931b78ff30a03e7c5e3"}
Jul 28 17:17:26.792232 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.792214    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj" event={"ID":"030e36e0-4ec2-43b9-a317-e4e58138cc29","Type":"ContainerStarted","Data":"8e3db1792174b9edfe2c17c5ce46050ed2c71f2e44a35c39888826fec99728b4"}
Jul 28 17:17:26.792312 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.792279    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj" event={"ID":"030e36e0-4ec2-43b9-a317-e4e58138cc29","Type":"ContainerStarted","Data":"8c8b6cd22671b7d251ff6aefb8a9d6aa60faf6d3a0bbb36983c5df911ec52680"}
Jul 28 17:17:26.792362 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.792330    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj" event={"ID":"030e36e0-4ec2-43b9-a317-e4e58138cc29","Type":"ContainerStarted","Data":"6bbbdca329d3d473594797af3c4f5dd34f5aa8e7a3d134cf712bd5868f56abda"}
Jul 28 17:17:26.792396 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.792383    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj" event={"ID":"030e36e0-4ec2-43b9-a317-e4e58138cc29","Type":"ContainerStarted","Data":"b6ff1e82063b4c2c5ea844409cb5d829934c6e9e5a4d5ff5cb7648efa49f3007"}
Jul 28 17:17:26.792442 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.792429    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj" event={"ID":"030e36e0-4ec2-43b9-a317-e4e58138cc29","Type":"ContainerStarted","Data":"532ed0f2038253c0626e0613cfdf3764b9358405188d8cb2b6b69a5c8b6e1d9f"}
Jul 28 17:17:26.792485 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.792469    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj" event={"ID":"030e36e0-4ec2-43b9-a317-e4e58138cc29","Type":"ContainerStarted","Data":"b9bba75d9b18ed20ffceb88c6260b0f7d0a95d84a35c3c0264bd64a3d1dba728"}
Jul 28 17:17:26.793535 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.793517    2563 generic.go:356] "Generic (PLEG): container finished" podID="551eb815-630c-41f7-888d-39ef9ed0681b" containerID="c937fc24c83ba1b9da49088e6f0bef5352531126421ca8308134074341e375e5" exitCode=0
Jul 28 17:17:26.793631 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.793574    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn9rg" event={"ID":"551eb815-630c-41f7-888d-39ef9ed0681b","Type":"ContainerDied","Data":"c937fc24c83ba1b9da49088e6f0bef5352531126421ca8308134074341e375e5"}
Jul 28 17:17:26.795087 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.795068    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n8656" event={"ID":"184d85bc-8ddc-40a9-bbfc-65dd6679d5a8","Type":"ContainerStarted","Data":"8dc38dbc62e7a2f0d074d9df679e727efe26670704e4694521c832ec4716f753"}
Jul 28 17:17:26.831242 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.831200    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-239.ec2.internal" podStartSLOduration=21.831187713 podStartE2EDuration="21.831187713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:17:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:26.8059742 +0000 UTC m=+23.638205447" watchObservedRunningTime="2026-07-28 17:17:26.831187713 +0000 UTC m=+23.663418962"
Jul 28 17:17:26.831557 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.831523    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8shmh" podStartSLOduration=2.814583897 podStartE2EDuration="22.831510663s" totalImagesPullingTime="20.016926766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:26.831441403 +0000 UTC m=+23.663672652" watchObservedRunningTime="2026-07-28 17:17:26.831510663 +0000 UTC m=+23.663741911"
Jul 28 17:17:26.848683 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.848637    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-75wzw" podStartSLOduration=10.720315908 podStartE2EDuration="22.848622048s" totalImagesPullingTime="12.12830614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:26.848580135 +0000 UTC m=+23.680811383" watchObservedRunningTime="2026-07-28 17:17:26.848622048 +0000 UTC m=+23.680853300"
Jul 28 17:17:26.865378 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.865334    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n4p4l" podStartSLOduration=2.877921751 podStartE2EDuration="22.865320523s" totalImagesPullingTime="19.987398772s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:26.865314852 +0000 UTC m=+23.697546102" watchObservedRunningTime="2026-07-28 17:17:26.865320523 +0000 UTC m=+23.697551771"
Jul 28 17:17:26.885854 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.885809    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nc97c" podStartSLOduration=2.899354783 podStartE2EDuration="22.885776547s" totalImagesPullingTime="19.986421764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:26.885255242 +0000 UTC m=+23.717486491" watchObservedRunningTime="2026-07-28 17:17:26.885776547 +0000 UTC m=+23.718007795"
Jul 28 17:17:26.945017 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.944962    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n8656" podStartSLOduration=2.9075249789999997 podStartE2EDuration="22.944947432s" totalImagesPullingTime="20.037422453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:26.913289979 +0000 UTC m=+23.745521228" watchObservedRunningTime="2026-07-28 17:17:26.944947432 +0000 UTC m=+23.777178681"
Jul 28 17:17:26.978213 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:26.978171    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:27.052396 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:27.052329    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:27.152877 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:27.152833    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:27.560225 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:27.560199    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 17:17:27.579319 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:27.579218    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T17:17:27.560220066Z","UUID":"56869559-b778-4a5a-8849-d8b4362a18af","Handler":null,"Name":"","Endpoint":""}
Jul 28 17:17:27.580863 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:27.580844    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 17:17:27.580979 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:27.580881    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 17:17:27.686116 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:27.686041    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:27.686303 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:27.686177    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:27.800535 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:27.800494    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wbrnt" event={"ID":"98a2385b-450b-4192-bfd2-f6e192a0b1a1","Type":"ContainerStarted","Data":"88c3d73739e5f22a5db946e9e1f9ac002078bcb38f3fc5db5fc1bd49d49ec92c"}
Jul 28 17:17:27.803165 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:27.803097    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr" event={"ID":"8ebec48c-f07a-46fe-a818-ae38fee6026a","Type":"ContainerStarted","Data":"b6a83dc6ad67c1f39362e78eccc35a89a83ec3407c7a75c45602957a28fc0b7d"}
Jul 28 17:17:27.815685 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:27.815640    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wbrnt" podStartSLOduration=3.795060587 podStartE2EDuration="23.815626318s" totalImagesPullingTime="20.020565731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:27.815519853 +0000 UTC m=+24.647751101" watchObservedRunningTime="2026-07-28 17:17:27.815626318 +0000 UTC m=+24.647857576"
Jul 28 17:17:27.932661 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:27.932629    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:28.008845 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:28.008806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:28.178392 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:28.178356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:28.578218 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:28.578182    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:28.679075 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:28.679037    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:28.685327 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:28.685308    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:28.685441 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:28.685409    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:28.685555 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:28.685473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:28.685636 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:28.685603    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:28.809591 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:28.809550    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj" event={"ID":"030e36e0-4ec2-43b9-a317-e4e58138cc29","Type":"ContainerStarted","Data":"9133e8744962afaed3deeb82ea34f87b97a9843c075b45bcfdd77c5742aadc26"}
Jul 28 17:17:29.242771 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:29.242690    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-75wzw"
Jul 28 17:17:29.243356 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:29.243321    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-75wzw"
Jul 28 17:17:29.685928 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:29.685899    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:29.686088 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:29.686029    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:29.814203 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:29.814168    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr" event={"ID":"8ebec48c-f07a-46fe-a818-ae38fee6026a","Type":"ContainerStarted","Data":"0ac58be906c902ee8e2938ae04579e07e62b0fdebd85973e66e9e28ededb4cc3"}
Jul 28 17:17:29.814658 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:29.814335    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-75wzw"
Jul 28 17:17:29.814989 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:29.814969    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-75wzw"
Jul 28 17:17:29.836045 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:29.836000    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbtvr" podStartSLOduration=4.433642649 podStartE2EDuration="25.835984475s" totalImagesPullingTime="21.402341826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:17:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:29.835355949 +0000 UTC m=+26.667587197" watchObservedRunningTime="2026-07-28 17:17:29.835984475 +0000 UTC m=+26.668215722"
Jul 28 17:17:29.906604 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:29.906575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:30.685221 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:30.685022    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:30.685389 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:30.685033    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:30.685389 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:30.685316    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:30.685501 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:30.685400    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:31.685273 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:31.685193    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:31.685891 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:31.685299    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:31.822318 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:31.822099    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj" event={"ID":"030e36e0-4ec2-43b9-a317-e4e58138cc29","Type":"ContainerStarted","Data":"adbab5e1431804bb1c9b355560d23ef055ffbabb58bb46729e72b4374f9e5de5"}
Jul 28 17:17:31.822473 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:31.822377    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:31.822473 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:31.822432    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:31.823972 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:31.823947    2563 generic.go:356] "Generic (PLEG): container finished" podID="551eb815-630c-41f7-888d-39ef9ed0681b" containerID="add840166c90b6b18c8a10a5917b6718dd12afc2673004b5fa1698a7fd4408e0" exitCode=0
Jul 28 17:17:31.824109 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:31.824030    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn9rg" event={"ID":"551eb815-630c-41f7-888d-39ef9ed0681b","Type":"ContainerDied","Data":"add840166c90b6b18c8a10a5917b6718dd12afc2673004b5fa1698a7fd4408e0"}
Jul 28 17:17:31.839032 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:31.839007    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:31.857959 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:31.857920    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj" podStartSLOduration=9.035313713 podStartE2EDuration="27.857907924s" totalImagesPullingTime="18.822594211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:31.856261853 +0000 UTC m=+28.688493101" watchObservedRunningTime="2026-07-28 17:17:31.857907924 +0000 UTC m=+28.690139171"
Jul 28 17:17:31.928113 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:31.928081    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:31.990224 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:31.990126    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:32.685927 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:32.685889    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:32.686397 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:32.686007    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:32.686397 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:32.686056    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:32.686397 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:32.686165    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:32.826359 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:32.826331    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:32.842598 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:32.842561    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:17:33.328307 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:33.328275    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tdwcc"]
Jul 28 17:17:33.328501 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:33.328404    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:33.328578 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:33.328516    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:33.329952 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:33.329928    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-64z5r"]
Jul 28 17:17:33.330090 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:33.330048    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:33.330171 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:33.330146    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:33.330544 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:33.330527    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gzx6v"]
Jul 28 17:17:33.330621 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:33.330606    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:33.330711 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:33.330682    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:33.830288 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:33.830260    2563 generic.go:356] "Generic (PLEG): container finished" podID="551eb815-630c-41f7-888d-39ef9ed0681b" containerID="ed1d8c494c23ed0317b73f51b757dce04d571986a3e2a0209c61640e7269b3a3" exitCode=0
Jul 28 17:17:33.830758 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:33.830362    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn9rg" event={"ID":"551eb815-630c-41f7-888d-39ef9ed0681b","Type":"ContainerDied","Data":"ed1d8c494c23ed0317b73f51b757dce04d571986a3e2a0209c61640e7269b3a3"}
Jul 28 17:17:33.933704 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:33.933670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:34.034008 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:34.033965    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:34.361931 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:34.361896    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:34.685365 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:34.685281    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:34.685527 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:34.685379    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:34.685527 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:34.685406    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:34.685527 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:34.685467    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:35.312232 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:35.312200    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nc97c_7911e02d-0046-4260-8006-0c44bd288d44/dns-node-resolver/0.log"
Jul 28 17:17:35.685662 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:35.685636    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:35.685812 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:35.685769    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:35.836538 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:35.836463    2563 generic.go:356] "Generic (PLEG): container finished" podID="551eb815-630c-41f7-888d-39ef9ed0681b" containerID="029650f1e55f216561af415b21707074414e9cbd77571cb30bea6ba80578ec51" exitCode=0
Jul 28 17:17:35.836538 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:35.836509    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn9rg" event={"ID":"551eb815-630c-41f7-888d-39ef9ed0681b","Type":"ContainerDied","Data":"029650f1e55f216561af415b21707074414e9cbd77571cb30bea6ba80578ec51"}
Jul 28 17:17:36.685560 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:36.685532    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:36.685983 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:36.685535    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:36.685983 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:36.685630    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64z5r" podUID="0352e080-a0e6-4977-9f2c-fef0f6488583"
Jul 28 17:17:36.685983 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:36.685690    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdwcc" podUID="09a1f566-ddd6-4867-be93-31d4d4b9f98f"
Jul 28 17:17:36.711396 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:36.711369    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n4p4l_c72a9af3-651a-493b-b70f-5f70b05ebdf5/node-ca/0.log"
Jul 28 17:17:37.284421 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:37.284395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs\") pod \"network-metrics-daemon-gzx6v\" (UID: \"cd4c39fa-bc1a-43d4-bd68-a32079e1b915\") " pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:37.284596 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:37.284443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret\") pod \"global-pull-secret-syncer-tdwcc\" (UID: \"09a1f566-ddd6-4867-be93-31d4d4b9f98f\") " pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:37.284596 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:37.284483    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wr9f\" (UniqueName: \"kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f\") pod \"network-check-target-64z5r\" (UID: \"0352e080-a0e6-4977-9f2c-fef0f6488583\") " pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:37.284596 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:37.284574    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:37.284760 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:37.284615    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:37.284760 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:37.284625    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:17:37.284760 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:37.284642    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:17:37.284760 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:37.284645    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs podName:cd4c39fa-bc1a-43d4-bd68-a32079e1b915 nodeName:}" failed. No retries permitted until 2026-07-28 17:18:09.284623602 +0000 UTC m=+66.116854836 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs") pod "network-metrics-daemon-gzx6v" (UID: "cd4c39fa-bc1a-43d4-bd68-a32079e1b915") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:37.284760 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:37.284653    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7wr9f for pod openshift-network-diagnostics/network-check-target-64z5r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:37.284760 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:37.284675    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret podName:09a1f566-ddd6-4867-be93-31d4d4b9f98f nodeName:}" failed. No retries permitted until 2026-07-28 17:18:09.284656863 +0000 UTC m=+66.116888096 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret") pod "global-pull-secret-syncer-tdwcc" (UID: "09a1f566-ddd6-4867-be93-31d4d4b9f98f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:37.284760 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:37.284693    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f podName:0352e080-a0e6-4977-9f2c-fef0f6488583 nodeName:}" failed. No retries permitted until 2026-07-28 17:18:09.284683711 +0000 UTC m=+66.116914938 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7wr9f" (UniqueName: "kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f") pod "network-check-target-64z5r" (UID: "0352e080-a0e6-4977-9f2c-fef0f6488583") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:37.485577 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:37.485486    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:37.555222 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:37.555191    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:37.685173 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:37.685143    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:37.685356 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:37.685324    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gzx6v" podUID="cd4c39fa-bc1a-43d4-bd68-a32079e1b915"
Jul 28 17:17:37.912408 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:37.912321    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:37.985007 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:37.984977    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:38.190647 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.190566    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:38.287070 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.287039    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:38.498125 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.498049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:38.501179 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.501160    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-239.ec2.internal" event="NodeReady"
Jul 28 17:17:38.501375 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.501363    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 17:17:38.560851 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.560819    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mxg6l"]
Jul 28 17:17:38.562938 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.562910    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mxg6l"
Jul 28 17:17:38.564809 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.564771    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zbcdc"]
Jul 28 17:17:38.565944 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.565667    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jwr5z\""
Jul 28 17:17:38.565944 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.565706    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 17:17:38.565944 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.565672    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 17:17:38.566160 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.566011    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 17:17:38.566628 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.566610    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:38.568857 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.568838    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9lnwf\""
Jul 28 17:17:38.568955 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.568938    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 17:17:38.569131 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.569111    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 17:17:38.580266 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.580243    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mxg6l"]
Jul 28 17:17:38.582404 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.582377    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zbcdc"]
Jul 28 17:17:38.588365 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.588179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:38.589742 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.589721    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hjqct"]
Jul 28 17:17:38.591701 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.591682    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:38.595308 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.595155    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5lhcj\""
Jul 28 17:17:38.595904 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.595886    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 17:17:38.595986 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.595923    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 17:17:38.596586 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.596566    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 17:17:38.596680 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.596603    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 17:17:38.606539 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.606518    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hjqct"]
Jul 28 17:17:38.680720 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.680671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:38.685575 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.685548    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:17:38.685854 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.685834    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:17:38.689114 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.689088    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 17:17:38.689114 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.689106    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 17:17:38.689327 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.689169    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c94ch\""
Jul 28 17:17:38.689392 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.689361    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 17:17:38.693856 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.693836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5752d920-0452-446a-b3ee-9c76b72ceda0-tmp-dir\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:38.693950 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.693871    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/654aefc2-49e8-4014-85bf-c9ab3f564acb-crio-socket\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:38.693950 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.693928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:38.694065 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.693952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5272r\" (UniqueName: \"kubernetes.io/projected/8537c98d-4f50-4d39-b36e-598c5b23bce9-kube-api-access-5272r\") pod \"ingress-canary-mxg6l\" (UID: \"8537c98d-4f50-4d39-b36e-598c5b23bce9\") " pod="openshift-ingress-canary/ingress-canary-mxg6l"
Jul 28 17:17:38.694065 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.694043    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5752d920-0452-446a-b3ee-9c76b72ceda0-config-volume\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:38.694138 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.694090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/654aefc2-49e8-4014-85bf-c9ab3f564acb-data-volume\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:38.694138 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.694119    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:38.694240 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.694154    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:38.694240 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.694188    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjrrq\" (UniqueName: \"kubernetes.io/projected/5752d920-0452-446a-b3ee-9c76b72ceda0-kube-api-access-bjrrq\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:38.694240 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.694212    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8537c98d-4f50-4d39-b36e-598c5b23bce9-cert\") pod \"ingress-canary-mxg6l\" (UID: \"8537c98d-4f50-4d39-b36e-598c5b23bce9\") " pod="openshift-ingress-canary/ingress-canary-mxg6l"
Jul 28 17:17:38.694240 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.694227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rrwj\" (UniqueName: \"kubernetes.io/projected/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-api-access-8rrwj\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:38.780633 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.780603    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:38.794672 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.794644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5752d920-0452-446a-b3ee-9c76b72ceda0-config-volume\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:38.794849 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.794700    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/654aefc2-49e8-4014-85bf-c9ab3f564acb-data-volume\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:38.794849 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.794731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:38.794849 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.794755    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:38.794849 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.794806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjrrq\" (UniqueName: \"kubernetes.io/projected/5752d920-0452-446a-b3ee-9c76b72ceda0-kube-api-access-bjrrq\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:38.795034 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:38.794900    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:17:38.795034 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:38.794916    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:38.795034 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:38.794976    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm podName:654aefc2-49e8-4014-85bf-c9ab3f564acb nodeName:}" failed. No retries permitted until 2026-07-28 17:17:39.294955904 +0000 UTC m=+36.127187146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjqct" (UID: "654aefc2-49e8-4014-85bf-c9ab3f564acb") : configmap "kube-rbac-proxy" not found
Jul 28 17:17:38.795034 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:38.794996    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls podName:654aefc2-49e8-4014-85bf-c9ab3f564acb nodeName:}" failed. No retries permitted until 2026-07-28 17:17:39.294986986 +0000 UTC m=+36.127218215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjqct" (UID: "654aefc2-49e8-4014-85bf-c9ab3f564acb") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:38.795034 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.795017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8537c98d-4f50-4d39-b36e-598c5b23bce9-cert\") pod \"ingress-canary-mxg6l\" (UID: \"8537c98d-4f50-4d39-b36e-598c5b23bce9\") " pod="openshift-ingress-canary/ingress-canary-mxg6l"
Jul 28 17:17:38.795224 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.795048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rrwj\" (UniqueName: \"kubernetes.io/projected/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-api-access-8rrwj\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:38.795224 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.795076    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5752d920-0452-446a-b3ee-9c76b72ceda0-tmp-dir\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:38.795224 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.795111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/654aefc2-49e8-4014-85bf-c9ab3f564acb-crio-socket\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:38.795224 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.795121    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/654aefc2-49e8-4014-85bf-c9ab3f564acb-data-volume\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:38.795356 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.795229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:38.795356 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.795259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5272r\" (UniqueName: \"kubernetes.io/projected/8537c98d-4f50-4d39-b36e-598c5b23bce9-kube-api-access-5272r\") pod \"ingress-canary-mxg6l\" (UID: \"8537c98d-4f50-4d39-b36e-598c5b23bce9\") " pod="openshift-ingress-canary/ingress-canary-mxg6l"
Jul 28 17:17:38.795356 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.795296    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5752d920-0452-446a-b3ee-9c76b72ceda0-config-volume\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:38.795489 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.795362    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/654aefc2-49e8-4014-85bf-c9ab3f564acb-crio-socket\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:38.795489 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:38.795388    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:17:38.795583 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:38.795509    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls podName:5752d920-0452-446a-b3ee-9c76b72ceda0 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:39.295492092 +0000 UTC m=+36.127723317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls") pod "dns-default-zbcdc" (UID: "5752d920-0452-446a-b3ee-9c76b72ceda0") : secret "dns-default-metrics-tls" not found
Jul 28 17:17:38.795635 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.795607    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5752d920-0452-446a-b3ee-9c76b72ceda0-tmp-dir\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:38.800106 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.799896    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8537c98d-4f50-4d39-b36e-598c5b23bce9-cert\") pod \"ingress-canary-mxg6l\" (UID: \"8537c98d-4f50-4d39-b36e-598c5b23bce9\") " pod="openshift-ingress-canary/ingress-canary-mxg6l"
Jul 28 17:17:38.804333 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.804315    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5272r\" (UniqueName: \"kubernetes.io/projected/8537c98d-4f50-4d39-b36e-598c5b23bce9-kube-api-access-5272r\") pod \"ingress-canary-mxg6l\" (UID: \"8537c98d-4f50-4d39-b36e-598c5b23bce9\") " pod="openshift-ingress-canary/ingress-canary-mxg6l"
Jul 28 17:17:38.804420 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.804354    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rrwj\" (UniqueName: \"kubernetes.io/projected/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-api-access-8rrwj\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:38.804502 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.804482    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjrrq\" (UniqueName: \"kubernetes.io/projected/5752d920-0452-446a-b3ee-9c76b72ceda0-kube-api-access-bjrrq\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:38.876672 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.876628    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mxg6l"
Jul 28 17:17:38.880808 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:38.880768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:39.298749 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.298707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:39.299391 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.298812    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:39.299391 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.298846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:39.299391 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:39.298933    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:17:39.299391 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:39.298976    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:39.299391 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:39.298988    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:17:39.299391 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:39.299009    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls podName:5752d920-0452-446a-b3ee-9c76b72ceda0 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:40.298991804 +0000 UTC m=+37.131223030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls") pod "dns-default-zbcdc" (UID: "5752d920-0452-446a-b3ee-9c76b72ceda0") : secret "dns-default-metrics-tls" not found
Jul 28 17:17:39.299391 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:39.299051    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls podName:654aefc2-49e8-4014-85bf-c9ab3f564acb nodeName:}" failed. No retries permitted until 2026-07-28 17:17:40.299019786 +0000 UTC m=+37.131251030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjqct" (UID: "654aefc2-49e8-4014-85bf-c9ab3f564acb") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:39.299391 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:39.299073    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm podName:654aefc2-49e8-4014-85bf-c9ab3f564acb nodeName:}" failed. No retries permitted until 2026-07-28 17:17:40.299061827 +0000 UTC m=+37.131293059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjqct" (UID: "654aefc2-49e8-4014-85bf-c9ab3f564acb") : configmap "kube-rbac-proxy" not found
Jul 28 17:17:39.685339 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.685252    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:17:39.688082 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.687902    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 17:17:39.688082 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.687989    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hrst7\""
Jul 28 17:17:39.799554 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.799513    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-r4b25"]
Jul 28 17:17:39.802473 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.802453    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-r4b25"
Jul 28 17:17:39.805398 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.805066    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 28 17:17:39.805398 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.805074    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 28 17:17:39.805398 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.805096    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 28 17:17:39.805398 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.805121    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pdv2f\""
Jul 28 17:17:39.805398 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.805231    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 28 17:17:39.813052 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.813028    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-r4b25"]
Jul 28 17:17:39.832833 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.832782    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:39.904572 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.904532    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/58e4ed65-aa6b-489f-8d00-848b5fb8ae7f-signing-cabundle\") pod \"service-ca-658d7b7c78-r4b25\" (UID: \"58e4ed65-aa6b-489f-8d00-848b5fb8ae7f\") " pod="openshift-service-ca/service-ca-658d7b7c78-r4b25"
Jul 28 17:17:39.904572 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.904575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45pq2\" (UniqueName: \"kubernetes.io/projected/58e4ed65-aa6b-489f-8d00-848b5fb8ae7f-kube-api-access-45pq2\") pod \"service-ca-658d7b7c78-r4b25\" (UID: \"58e4ed65-aa6b-489f-8d00-848b5fb8ae7f\") " pod="openshift-service-ca/service-ca-658d7b7c78-r4b25"
Jul 28 17:17:39.904771 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.904636    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/58e4ed65-aa6b-489f-8d00-848b5fb8ae7f-signing-key\") pod \"service-ca-658d7b7c78-r4b25\" (UID: \"58e4ed65-aa6b-489f-8d00-848b5fb8ae7f\") " pod="openshift-service-ca/service-ca-658d7b7c78-r4b25"
Jul 28 17:17:39.919517 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:39.919487    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:40.005986 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.005958    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/58e4ed65-aa6b-489f-8d00-848b5fb8ae7f-signing-cabundle\") pod \"service-ca-658d7b7c78-r4b25\" (UID: \"58e4ed65-aa6b-489f-8d00-848b5fb8ae7f\") " pod="openshift-service-ca/service-ca-658d7b7c78-r4b25"
Jul 28 17:17:40.006144 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.005992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45pq2\" (UniqueName: \"kubernetes.io/projected/58e4ed65-aa6b-489f-8d00-848b5fb8ae7f-kube-api-access-45pq2\") pod \"service-ca-658d7b7c78-r4b25\" (UID: \"58e4ed65-aa6b-489f-8d00-848b5fb8ae7f\") " pod="openshift-service-ca/service-ca-658d7b7c78-r4b25"
Jul 28 17:17:40.006195 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.006150    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/58e4ed65-aa6b-489f-8d00-848b5fb8ae7f-signing-key\") pod \"service-ca-658d7b7c78-r4b25\" (UID: \"58e4ed65-aa6b-489f-8d00-848b5fb8ae7f\") " pod="openshift-service-ca/service-ca-658d7b7c78-r4b25"
Jul 28 17:17:40.006840 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.006819    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/58e4ed65-aa6b-489f-8d00-848b5fb8ae7f-signing-cabundle\") pod \"service-ca-658d7b7c78-r4b25\" (UID: \"58e4ed65-aa6b-489f-8d00-848b5fb8ae7f\") " pod="openshift-service-ca/service-ca-658d7b7c78-r4b25"
Jul 28 17:17:40.009085 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.009061    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/58e4ed65-aa6b-489f-8d00-848b5fb8ae7f-signing-key\") pod \"service-ca-658d7b7c78-r4b25\" (UID: \"58e4ed65-aa6b-489f-8d00-848b5fb8ae7f\") " pod="openshift-service-ca/service-ca-658d7b7c78-r4b25"
Jul 28 17:17:40.014863 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.014846    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45pq2\" (UniqueName: \"kubernetes.io/projected/58e4ed65-aa6b-489f-8d00-848b5fb8ae7f-kube-api-access-45pq2\") pod \"service-ca-658d7b7c78-r4b25\" (UID: \"58e4ed65-aa6b-489f-8d00-848b5fb8ae7f\") " pod="openshift-service-ca/service-ca-658d7b7c78-r4b25"
Jul 28 17:17:40.113866 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.113833    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-r4b25"
Jul 28 17:17:40.308069 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.307981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:40.308069 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.308045    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:40.308069 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.308073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:40.308671 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:40.308150    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:17:40.308671 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:40.308158    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:17:40.308671 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:40.308189    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:40.308671 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:40.308218    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls podName:5752d920-0452-446a-b3ee-9c76b72ceda0 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:42.308195718 +0000 UTC m=+39.140426944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls") pod "dns-default-zbcdc" (UID: "5752d920-0452-446a-b3ee-9c76b72ceda0") : secret "dns-default-metrics-tls" not found
Jul 28 17:17:40.308671 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:40.308235    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm podName:654aefc2-49e8-4014-85bf-c9ab3f564acb nodeName:}" failed. No retries permitted until 2026-07-28 17:17:42.308228341 +0000 UTC m=+39.140459569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjqct" (UID: "654aefc2-49e8-4014-85bf-c9ab3f564acb") : configmap "kube-rbac-proxy" not found
Jul 28 17:17:40.308671 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:40.308246    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls podName:654aefc2-49e8-4014-85bf-c9ab3f564acb nodeName:}" failed. No retries permitted until 2026-07-28 17:17:42.308240893 +0000 UTC m=+39.140472124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjqct" (UID: "654aefc2-49e8-4014-85bf-c9ab3f564acb") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:40.511104 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.510903    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-r4b25"]
Jul 28 17:17:40.512934 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.512876    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mxg6l"]
Jul 28 17:17:40.515005 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:40.513818    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e4ed65_aa6b_489f_8d00_848b5fb8ae7f.slice/crio-2dfa700d5f3f4f4b698c612643c6ac1bc3e66fab190444290755ef59157aee3b WatchSource:0}: Error finding container 2dfa700d5f3f4f4b698c612643c6ac1bc3e66fab190444290755ef59157aee3b: Status 404 returned error can't find the container with id 2dfa700d5f3f4f4b698c612643c6ac1bc3e66fab190444290755ef59157aee3b
Jul 28 17:17:40.516341 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:40.516306    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8537c98d_4f50_4d39_b36e_598c5b23bce9.slice/crio-1fc40883d1ebe91ac9bfef01f4c913eeca544251365416a3e6526ea46b9294d5 WatchSource:0}: Error finding container 1fc40883d1ebe91ac9bfef01f4c913eeca544251365416a3e6526ea46b9294d5: Status 404 returned error can't find the container with id 1fc40883d1ebe91ac9bfef01f4c913eeca544251365416a3e6526ea46b9294d5
Jul 28 17:17:40.779761 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.779731    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:40.849868 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.849778    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-r4b25" event={"ID":"58e4ed65-aa6b-489f-8d00-848b5fb8ae7f","Type":"ContainerStarted","Data":"2dfa700d5f3f4f4b698c612643c6ac1bc3e66fab190444290755ef59157aee3b"}
Jul 28 17:17:40.850946 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.850921    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mxg6l" event={"ID":"8537c98d-4f50-4d39-b36e-598c5b23bce9","Type":"ContainerStarted","Data":"1fc40883d1ebe91ac9bfef01f4c913eeca544251365416a3e6526ea46b9294d5"}
Jul 28 17:17:40.853505 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.853484    2563 generic.go:356] "Generic (PLEG): container finished" podID="551eb815-630c-41f7-888d-39ef9ed0681b" containerID="612430af948a64c73f8ece68712403a99eb5c11fd93d659c0af69e8375458f20" exitCode=0
Jul 28 17:17:40.853607 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.853510    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn9rg" event={"ID":"551eb815-630c-41f7-888d-39ef9ed0681b","Type":"ContainerDied","Data":"612430af948a64c73f8ece68712403a99eb5c11fd93d659c0af69e8375458f20"}
Jul 28 17:17:40.944348 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:40.944310    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:41.006747 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:41.006718    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:41.860724 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:41.860686    2563 generic.go:356] "Generic (PLEG): container finished" podID="551eb815-630c-41f7-888d-39ef9ed0681b" containerID="90ad97e6dfd1d9fa363e2b4c0173922557ff9da4754e1d4eb48e8da6bc5c6b95" exitCode=0
Jul 28 17:17:41.861233 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:41.860753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn9rg" event={"ID":"551eb815-630c-41f7-888d-39ef9ed0681b","Type":"ContainerDied","Data":"90ad97e6dfd1d9fa363e2b4c0173922557ff9da4754e1d4eb48e8da6bc5c6b95"}
Jul 28 17:17:42.326224 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:42.326033    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:42.326389 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:42.326283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:42.326389 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:42.326165    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:17:42.326389 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:42.326343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:42.326389 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:42.326379    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm podName:654aefc2-49e8-4014-85bf-c9ab3f564acb nodeName:}" failed. No retries permitted until 2026-07-28 17:17:46.326357722 +0000 UTC m=+43.158588950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjqct" (UID: "654aefc2-49e8-4014-85bf-c9ab3f564acb") : configmap "kube-rbac-proxy" not found
Jul 28 17:17:42.326598 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:42.326451    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:42.326598 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:42.326462    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:17:42.326598 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:42.326515    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls podName:654aefc2-49e8-4014-85bf-c9ab3f564acb nodeName:}" failed. No retries permitted until 2026-07-28 17:17:46.326500543 +0000 UTC m=+43.158731785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjqct" (UID: "654aefc2-49e8-4014-85bf-c9ab3f564acb") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:42.326598 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:42.326528    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls podName:5752d920-0452-446a-b3ee-9c76b72ceda0 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:46.326522693 +0000 UTC m=+43.158753918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls") pod "dns-default-zbcdc" (UID: "5752d920-0452-446a-b3ee-9c76b72ceda0") : secret "dns-default-metrics-tls" not found
Jul 28 17:17:42.867883 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:42.867835    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kn9rg" event={"ID":"551eb815-630c-41f7-888d-39ef9ed0681b","Type":"ContainerStarted","Data":"871ec1939eeddbabbcee142cd8421ade6b0cdda56befc4605d7f3a4701ae5580"}
Jul 28 17:17:42.895695 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:42.895644    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kn9rg" podStartSLOduration=6.685531041 podStartE2EDuration="38.89562465s" totalImagesPullingTime="32.210093609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:17:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:42.894775969 +0000 UTC m=+39.727007218" watchObservedRunningTime="2026-07-28 17:17:42.89562465 +0000 UTC m=+39.727855901"
Jul 28 17:17:43.018132 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:43.018094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:43.776569 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:43.776532    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:43.881982 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:43.881949    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:44.827736 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:44.827701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:44.883110 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:44.883058    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-r4b25" event={"ID":"58e4ed65-aa6b-489f-8d00-848b5fb8ae7f","Type":"ContainerStarted","Data":"7a4868fb5cf4df3a55939be39948555210023fb9934c6ef5da4de9fe930979ec"}
Jul 28 17:17:44.885666 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:44.885628    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mxg6l" event={"ID":"8537c98d-4f50-4d39-b36e-598c5b23bce9","Type":"ContainerStarted","Data":"5bb88e4c7a378612dc215198db410f5cfa9f1dc118b8ba7f5be9d6b956f3119a"}
Jul 28 17:17:44.903764 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:44.903717    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-r4b25" podStartSLOduration=2.606466206 podStartE2EDuration="5.903684806s" totalImagesPullingTime="3.2972186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:44.902481102 +0000 UTC m=+41.734712351" watchObservedRunningTime="2026-07-28 17:17:44.903684806 +0000 UTC m=+41.735916058"
Jul 28 17:17:44.908611 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:44.908587    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:44.925868 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:44.925804    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mxg6l" podStartSLOduration=3.6362254529999998 podStartE2EDuration="6.925769248s" totalImagesPullingTime="3.289543795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:44.924498147 +0000 UTC m=+41.756729396" watchObservedRunningTime="2026-07-28 17:17:44.925769248 +0000 UTC m=+41.758000489"
Jul 28 17:17:45.034545 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:45.034505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:45.126616 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:45.126529    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:45.206133 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:45.206103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:45.725237 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:45.725208    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:46.331706 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:46.331658    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:46.352674 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:46.352645    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:46.352821 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:46.352687    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:46.352821 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:46.352758    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:46.352821 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:46.352810    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:46.352984 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:46.352844    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:17:46.352984 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:46.352877    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls podName:654aefc2-49e8-4014-85bf-c9ab3f564acb nodeName:}" failed. No retries permitted until 2026-07-28 17:17:54.352859128 +0000 UTC m=+51.185090357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjqct" (UID: "654aefc2-49e8-4014-85bf-c9ab3f564acb") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:46.352984 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:46.352895    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm podName:654aefc2-49e8-4014-85bf-c9ab3f564acb nodeName:}" failed. No retries permitted until 2026-07-28 17:17:54.352886933 +0000 UTC m=+51.185118159 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjqct" (UID: "654aefc2-49e8-4014-85bf-c9ab3f564acb") : configmap "kube-rbac-proxy" not found
Jul 28 17:17:46.352984 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:46.352920    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:17:46.352984 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:46.352980    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls podName:5752d920-0452-446a-b3ee-9c76b72ceda0 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:54.352964133 +0000 UTC m=+51.185195382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls") pod "dns-default-zbcdc" (UID: "5752d920-0452-446a-b3ee-9c76b72ceda0") : secret "dns-default-metrics-tls" not found
Jul 28 17:17:46.733337 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:46.733237    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:46.919778 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:46.919739    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:47.340512 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:47.340475    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:47.502975 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:47.502943    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:47.923411 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:47.923373    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:48.327859 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:48.327822    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:48.766367 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:48.766338    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:48.855020 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:48.854992    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:48.944709 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:48.944678    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:49.337570 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:49.337538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:49.431243 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:49.431212    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:49.939760 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:49.939728    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:50.331716 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:50.331685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:50.539261 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:50.539236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:50.927157 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:50.927128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:51.223452 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:51.223376    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:51.533101 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:51.533067    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:51.943509 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:51.943413    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:52.333632 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:52.333593    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:52.554158 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:52.554125    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:52.695874 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:52.695753    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:53.137827 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:53.137780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:53.734485 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:53.734456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:53.927906 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:53.927871    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:54.365038 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:54.365004    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:54.410346 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:54.410318    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:54.410470 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:54.410378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:54.410470 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:54.410405    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:54.410582 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:54.410549    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:54.410649 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:17:54.410636    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls podName:654aefc2-49e8-4014-85bf-c9ab3f564acb nodeName:}" failed. No retries permitted until 2026-07-28 17:18:10.410614284 +0000 UTC m=+67.242845532 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjqct" (UID: "654aefc2-49e8-4014-85bf-c9ab3f564acb") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:54.410923 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:54.410902    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/654aefc2-49e8-4014-85bf-c9ab3f564acb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:17:54.414480 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:54.414460    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5752d920-0452-446a-b3ee-9c76b72ceda0-metrics-tls\") pod \"dns-default-zbcdc\" (UID: \"5752d920-0452-446a-b3ee-9c76b72ceda0\") " pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:54.483325 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:54.483299    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:54.539786 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:54.539753    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:54.627649 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:54.627575    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zbcdc"]
Jul 28 17:17:54.630249 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:17:54.630219    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5752d920_0452_446a_b3ee_9c76b72ceda0.slice/crio-356e07b49b9c42ad7b8544075b8bdf514b07915a1f0cf6fd2af17ef3d9c5a19e WatchSource:0}: Error finding container 356e07b49b9c42ad7b8544075b8bdf514b07915a1f0cf6fd2af17ef3d9c5a19e: Status 404 returned error can't find the container with id 356e07b49b9c42ad7b8544075b8bdf514b07915a1f0cf6fd2af17ef3d9c5a19e
Jul 28 17:17:54.912210 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:54.912134    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zbcdc" event={"ID":"5752d920-0452-446a-b3ee-9c76b72ceda0","Type":"ContainerStarted","Data":"356e07b49b9c42ad7b8544075b8bdf514b07915a1f0cf6fd2af17ef3d9c5a19e"}
Jul 28 17:17:54.943687 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:54.943657    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:55.334260 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:55.334228    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:55.556123 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:55.556092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:56.919996 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:56.919960    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zbcdc" event={"ID":"5752d920-0452-446a-b3ee-9c76b72ceda0","Type":"ContainerStarted","Data":"f81c84ce7ad098855adee879514a40540fd0a06816cce4124345721b62583cde"}
Jul 28 17:17:57.924311 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:57.924274    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zbcdc" event={"ID":"5752d920-0452-446a-b3ee-9c76b72ceda0","Type":"ContainerStarted","Data":"10549efcde1cef7edbfa9458a9a30b92244b8ea4eb4921b2cd5ad85803157496"}
Jul 28 17:17:57.924821 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:57.924498    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:17:57.951310 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:57.951259    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zbcdc" podStartSLOduration=17.869723282 podStartE2EDuration="19.951245087s" totalImagesPullingTime="2.081521805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:57.949864926 +0000 UTC m=+54.782096175" watchObservedRunningTime="2026-07-28 17:17:57.951245087 +0000 UTC m=+54.783476335"
Jul 28 17:17:58.820437 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:58.820402    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:58.925114 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:58.925070    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:59.019998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:59.019967    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:59.082946 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:17:59.082853    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:02.115479 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:02.115443    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:02.177678 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:02.177646    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:03.547975 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.547945    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-7xgtq"]
Jul 28 17:18:03.550812 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.550602    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7xgtq"
Jul 28 17:18:03.554129 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.554098    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-njr9v\""
Jul 28 17:18:03.554129 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.554109    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 28 17:18:03.554412 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.554168    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 28 17:18:03.561143 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.561122    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-7xgtq"]
Jul 28 17:18:03.578528 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.578503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11b040c7-84fb-47ec-b6b0-9ee6d7ff5aa4-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7xgtq\" (UID: \"11b040c7-84fb-47ec-b6b0-9ee6d7ff5aa4\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7xgtq"
Jul 28 17:18:03.578649 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.578551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/11b040c7-84fb-47ec-b6b0-9ee6d7ff5aa4-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-7xgtq\" (UID: \"11b040c7-84fb-47ec-b6b0-9ee6d7ff5aa4\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7xgtq"
Jul 28 17:18:03.660107 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.659611    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l8dbb"]
Jul 28 17:18:03.661592 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.661569    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:03.661955 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.661940    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5497fb74fb-qg822"]
Jul 28 17:18:03.662068 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.662052    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l8dbb"
Jul 28 17:18:03.663587 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.663570    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.665959 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.665943    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lcd8c\""
Jul 28 17:18:03.666097 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.666083    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qp66m\""
Jul 28 17:18:03.666369 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.666356    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 28 17:18:03.666433 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.666369    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 17:18:03.666910 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.666894    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 17:18:03.666959 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.666934    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 17:18:03.679208 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.679177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11b040c7-84fb-47ec-b6b0-9ee6d7ff5aa4-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7xgtq\" (UID: \"11b040c7-84fb-47ec-b6b0-9ee6d7ff5aa4\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7xgtq"
Jul 28 17:18:03.679397 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.679243    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/11b040c7-84fb-47ec-b6b0-9ee6d7ff5aa4-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-7xgtq\" (UID: \"11b040c7-84fb-47ec-b6b0-9ee6d7ff5aa4\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7xgtq"
Jul 28 17:18:03.680470 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.680441    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/11b040c7-84fb-47ec-b6b0-9ee6d7ff5aa4-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-7xgtq\" (UID: \"11b040c7-84fb-47ec-b6b0-9ee6d7ff5aa4\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7xgtq"
Jul 28 17:18:03.680685 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.680666    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 17:18:03.682077 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.682057    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/11b040c7-84fb-47ec-b6b0-9ee6d7ff5aa4-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7xgtq\" (UID: \"11b040c7-84fb-47ec-b6b0-9ee6d7ff5aa4\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7xgtq"
Jul 28 17:18:03.689294 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.689274    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l8dbb"]
Jul 28 17:18:03.689393 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.689319    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5497fb74fb-qg822"]
Jul 28 17:18:03.775806 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.775756    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:03.779807 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.779768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80b23439-c00f-4371-83bb-f310d313b706-bound-sa-token\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.779945 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.779825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtjs6\" (UniqueName: \"kubernetes.io/projected/80b23439-c00f-4371-83bb-f310d313b706-kube-api-access-rtjs6\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.779945 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.779853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3b0db1a4-8933-4cd8-9d4e-3532fd47396b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-l8dbb\" (UID: \"3b0db1a4-8933-4cd8-9d4e-3532fd47396b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l8dbb"
Jul 28 17:18:03.779945 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.779877    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80b23439-c00f-4371-83bb-f310d313b706-installation-pull-secrets\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.779945 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.779940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80b23439-c00f-4371-83bb-f310d313b706-image-registry-private-configuration\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.780114 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.779969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80b23439-c00f-4371-83bb-f310d313b706-trusted-ca\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.780114 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.780012    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80b23439-c00f-4371-83bb-f310d313b706-registry-tls\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.780114 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.780030    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80b23439-c00f-4371-83bb-f310d313b706-ca-trust-extracted\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.780114 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.780045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80b23439-c00f-4371-83bb-f310d313b706-registry-certificates\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.860151 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.860080    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7xgtq"
Jul 28 17:18:03.874113 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.874090    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:03.881228 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.881201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80b23439-c00f-4371-83bb-f310d313b706-bound-sa-token\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.881324 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.881236    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtjs6\" (UniqueName: \"kubernetes.io/projected/80b23439-c00f-4371-83bb-f310d313b706-kube-api-access-rtjs6\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.881324 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.881260    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3b0db1a4-8933-4cd8-9d4e-3532fd47396b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-l8dbb\" (UID: \"3b0db1a4-8933-4cd8-9d4e-3532fd47396b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l8dbb"
Jul 28 17:18:03.881324 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.881287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80b23439-c00f-4371-83bb-f310d313b706-installation-pull-secrets\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.881501 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.881479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80b23439-c00f-4371-83bb-f310d313b706-image-registry-private-configuration\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.881559 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.881528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80b23439-c00f-4371-83bb-f310d313b706-trusted-ca\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.881615 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.881587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80b23439-c00f-4371-83bb-f310d313b706-registry-tls\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.881668 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.881621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80b23439-c00f-4371-83bb-f310d313b706-ca-trust-extracted\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.881668 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.881646    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80b23439-c00f-4371-83bb-f310d313b706-registry-certificates\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.882063 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.882035    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80b23439-c00f-4371-83bb-f310d313b706-ca-trust-extracted\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.882737 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.882684    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80b23439-c00f-4371-83bb-f310d313b706-registry-certificates\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.883096 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.883070    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80b23439-c00f-4371-83bb-f310d313b706-trusted-ca\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.884325 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.884308    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80b23439-c00f-4371-83bb-f310d313b706-image-registry-private-configuration\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.884554 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.884522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80b23439-c00f-4371-83bb-f310d313b706-installation-pull-secrets\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.884913 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.884892    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3b0db1a4-8933-4cd8-9d4e-3532fd47396b-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-l8dbb\" (UID: \"3b0db1a4-8933-4cd8-9d4e-3532fd47396b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l8dbb"
Jul 28 17:18:03.885092 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.885076    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80b23439-c00f-4371-83bb-f310d313b706-registry-tls\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.899175 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.899148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80b23439-c00f-4371-83bb-f310d313b706-bound-sa-token\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.900206 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.900187    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtjs6\" (UniqueName: \"kubernetes.io/projected/80b23439-c00f-4371-83bb-f310d313b706-kube-api-access-rtjs6\") pod \"image-registry-5497fb74fb-qg822\" (UID: \"80b23439-c00f-4371-83bb-f310d313b706\") " pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.972344 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.972312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l8dbb"
Jul 28 17:18:03.977364 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.977328    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:03.978252 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:03.978223    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:04.007009 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:04.006974    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-7xgtq"]
Jul 28 17:18:04.010381 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:18:04.010335    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b040c7_84fb_47ec_b6b0_9ee6d7ff5aa4.slice/crio-14e57fa58873c951077d2894b748772edcf574b452c626c2082b526ea567a8ba WatchSource:0}: Error finding container 14e57fa58873c951077d2894b748772edcf574b452c626c2082b526ea567a8ba: Status 404 returned error can't find the container with id 14e57fa58873c951077d2894b748772edcf574b452c626c2082b526ea567a8ba
Jul 28 17:18:04.111612 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:04.111549    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l8dbb"]
Jul 28 17:18:04.114548 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:18:04.114525    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b0db1a4_8933_4cd8_9d4e_3532fd47396b.slice/crio-391dde1685424d19b137817230e8e34976edd1a3c84a59efa2c0cfb50c6e1c0a WatchSource:0}: Error finding container 391dde1685424d19b137817230e8e34976edd1a3c84a59efa2c0cfb50c6e1c0a: Status 404 returned error can't find the container with id 391dde1685424d19b137817230e8e34976edd1a3c84a59efa2c0cfb50c6e1c0a
Jul 28 17:18:04.130480 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:04.130450    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5497fb74fb-qg822"]
Jul 28 17:18:04.132418 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:18:04.132394    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80b23439_c00f_4371_83bb_f310d313b706.slice/crio-ffde70b0c3a4c42f3520c9668bcdaf685359730417de7581f402efb98d4e9bc8 WatchSource:0}: Error finding container ffde70b0c3a4c42f3520c9668bcdaf685359730417de7581f402efb98d4e9bc8: Status 404 returned error can't find the container with id ffde70b0c3a4c42f3520c9668bcdaf685359730417de7581f402efb98d4e9bc8
Jul 28 17:18:04.587902 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:04.587858    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:04.658613 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:04.658568    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:04.846424 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:04.846347    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc2qj"
Jul 28 17:18:04.942968 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:04.942924    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5497fb74fb-qg822" event={"ID":"80b23439-c00f-4371-83bb-f310d313b706","Type":"ContainerStarted","Data":"a6f5f40aa6a5187860fa10631c5ebb2ab026096c11acdb0b80e5ec8dbb1608d2"}
Jul 28 17:18:04.943155 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:04.942991    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5497fb74fb-qg822" event={"ID":"80b23439-c00f-4371-83bb-f310d313b706","Type":"ContainerStarted","Data":"ffde70b0c3a4c42f3520c9668bcdaf685359730417de7581f402efb98d4e9bc8"}
Jul 28 17:18:04.943155 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:04.943038    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:04.944604 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:04.944574    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l8dbb" event={"ID":"3b0db1a4-8933-4cd8-9d4e-3532fd47396b","Type":"ContainerStarted","Data":"391dde1685424d19b137817230e8e34976edd1a3c84a59efa2c0cfb50c6e1c0a"}
Jul 28 17:18:04.946287 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:04.946263    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7xgtq" event={"ID":"11b040c7-84fb-47ec-b6b0-9ee6d7ff5aa4","Type":"ContainerStarted","Data":"14e57fa58873c951077d2894b748772edcf574b452c626c2082b526ea567a8ba"}
Jul 28 17:18:04.969537 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:04.969487    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5497fb74fb-qg822" podStartSLOduration=1.969470203 podStartE2EDuration="1.969470203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:04.969156837 +0000 UTC m=+61.801388088" watchObservedRunningTime="2026-07-28 17:18:04.969470203 +0000 UTC m=+61.801701450"
Jul 28 17:18:05.000321 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:05.000290    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:05.065966 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:05.065936    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:05.802300 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:05.802251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:05.902485 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:05.902456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:05.951475 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:05.951442    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l8dbb" event={"ID":"3b0db1a4-8933-4cd8-9d4e-3532fd47396b","Type":"ContainerStarted","Data":"42b86e619f0ef20f8e59878bf5337d3ec8e43f423ca426a6843d87f1f7c606a2"}
Jul 28 17:18:05.951647 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:05.951542    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l8dbb"
Jul 28 17:18:05.953066 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:05.953041    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7xgtq" event={"ID":"11b040c7-84fb-47ec-b6b0-9ee6d7ff5aa4","Type":"ContainerStarted","Data":"a747d284f10f11d9395900c2f818af6a18b414e8454145724d103543366fd644"}
Jul 28 17:18:05.956519 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:05.956498    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l8dbb"
Jul 28 17:18:05.971062 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:05.971020    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l8dbb" podStartSLOduration=1.281042359 podStartE2EDuration="2.971007069s" totalImagesPullingTime="1.68996471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:05.970407858 +0000 UTC m=+62.802639117" watchObservedRunningTime="2026-07-28 17:18:05.971007069 +0000 UTC m=+62.803238308"
Jul 28 17:18:06.004629 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:06.004586    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7xgtq" podStartSLOduration=1.213704902 podStartE2EDuration="3.004570831s" totalImagesPullingTime="1.790865929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:06.00408381 +0000 UTC m=+62.836315060" watchObservedRunningTime="2026-07-28 17:18:06.004570831 +0000 UTC m=+62.836802090"
Jul 28 17:18:06.197170 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:06.197094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:06.273012 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:06.272981    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:06.961737 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:06.961705    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:07.042935 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:07.042904    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:07.214001 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:07.213922    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:07.315683 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:07.315658    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:07.615435 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:07.615401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:07.715698 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:07.715668    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:07.928256 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:07.928174    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zbcdc"
Jul 28 17:18:09.320341 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.320301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret\") pod \"global-pull-secret-syncer-tdwcc\" (UID: \"09a1f566-ddd6-4867-be93-31d4d4b9f98f\") " pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:18:09.320341 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.320347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wr9f\" (UniqueName: \"kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f\") pod \"network-check-target-64z5r\" (UID: \"0352e080-a0e6-4977-9f2c-fef0f6488583\") " pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:18:09.320775 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.320402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs\") pod \"network-metrics-daemon-gzx6v\" (UID: \"cd4c39fa-bc1a-43d4-bd68-a32079e1b915\") " pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:18:09.323573 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.323553    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 17:18:09.323650 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.323588    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 17:18:09.324479 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.324459    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 17:18:09.333871 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.333850    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4c39fa-bc1a-43d4-bd68-a32079e1b915-metrics-certs\") pod \"network-metrics-daemon-gzx6v\" (UID: \"cd4c39fa-bc1a-43d4-bd68-a32079e1b915\") " pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:18:09.333871 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.333861    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/09a1f566-ddd6-4867-be93-31d4d4b9f98f-original-pull-secret\") pod \"global-pull-secret-syncer-tdwcc\" (UID: \"09a1f566-ddd6-4867-be93-31d4d4b9f98f\") " pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:18:09.334303 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.334288    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 17:18:09.344880 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.344862    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wr9f\" (UniqueName: \"kubernetes.io/projected/0352e080-a0e6-4977-9f2c-fef0f6488583-kube-api-access-7wr9f\") pod \"network-check-target-64z5r\" (UID: \"0352e080-a0e6-4977-9f2c-fef0f6488583\") " pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:18:09.398529 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.398506    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hrst7\""
Jul 28 17:18:09.406495 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.406480    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gzx6v"
Jul 28 17:18:09.528222 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.528188    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gzx6v"]
Jul 28 17:18:09.531109 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:18:09.531084    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd4c39fa_bc1a_43d4_bd68_a32079e1b915.slice/crio-42586b5fd4d64c0cfbf1eeecfeb4842e03940c58251f10d3ac93aa30c25590c5 WatchSource:0}: Error finding container 42586b5fd4d64c0cfbf1eeecfeb4842e03940c58251f10d3ac93aa30c25590c5: Status 404 returned error can't find the container with id 42586b5fd4d64c0cfbf1eeecfeb4842e03940c58251f10d3ac93aa30c25590c5
Jul 28 17:18:09.596940 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.596868    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdwcc"
Jul 28 17:18:09.605940 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.605914    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c94ch\""
Jul 28 17:18:09.613993 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.613976    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:18:09.734197 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.734167    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tdwcc"]
Jul 28 17:18:09.737085 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:18:09.737062    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a1f566_ddd6_4867_be93_31d4d4b9f98f.slice/crio-aaf29e496809c0fdcb463408d5651b459c51f04dadf8624514b01a5f43e927a7 WatchSource:0}: Error finding container aaf29e496809c0fdcb463408d5651b459c51f04dadf8624514b01a5f43e927a7: Status 404 returned error can't find the container with id aaf29e496809c0fdcb463408d5651b459c51f04dadf8624514b01a5f43e927a7
Jul 28 17:18:09.747868 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.747843    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-64z5r"]
Jul 28 17:18:09.750841 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:18:09.750820    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0352e080_a0e6_4977_9f2c_fef0f6488583.slice/crio-b6d016fe3ecbdeaad27cb0efed5470089fc6d711351fb7358fdfa92adfc9132f WatchSource:0}: Error finding container b6d016fe3ecbdeaad27cb0efed5470089fc6d711351fb7358fdfa92adfc9132f: Status 404 returned error can't find the container with id b6d016fe3ecbdeaad27cb0efed5470089fc6d711351fb7358fdfa92adfc9132f
Jul 28 17:18:09.966469 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.966386    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tdwcc" event={"ID":"09a1f566-ddd6-4867-be93-31d4d4b9f98f","Type":"ContainerStarted","Data":"aaf29e496809c0fdcb463408d5651b459c51f04dadf8624514b01a5f43e927a7"}
Jul 28 17:18:09.967487 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.967465    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-64z5r" event={"ID":"0352e080-a0e6-4977-9f2c-fef0f6488583","Type":"ContainerStarted","Data":"b6d016fe3ecbdeaad27cb0efed5470089fc6d711351fb7358fdfa92adfc9132f"}
Jul 28 17:18:09.968616 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:09.968594    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gzx6v" event={"ID":"cd4c39fa-bc1a-43d4-bd68-a32079e1b915","Type":"ContainerStarted","Data":"42586b5fd4d64c0cfbf1eeecfeb4842e03940c58251f10d3ac93aa30c25590c5"}
Jul 28 17:18:10.004969 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:10.004932    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:10.429625 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:10.429591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:18:10.432584 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:10.432549    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/654aefc2-49e8-4014-85bf-c9ab3f564acb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjqct\" (UID: \"654aefc2-49e8-4014-85bf-c9ab3f564acb\") " pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:18:10.704734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:10.704468    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5lhcj\""
Jul 28 17:18:10.712154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:10.712126    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hjqct"
Jul 28 17:18:10.883358 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:10.883328    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hjqct"]
Jul 28 17:18:10.888352 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:18:10.888311    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654aefc2_49e8_4014_85bf_c9ab3f564acb.slice/crio-40af8f80490704aeed5d460f92e2542dba37bbfef1a065f58c0ada23b7df0d51 WatchSource:0}: Error finding container 40af8f80490704aeed5d460f92e2542dba37bbfef1a065f58c0ada23b7df0d51: Status 404 returned error can't find the container with id 40af8f80490704aeed5d460f92e2542dba37bbfef1a065f58c0ada23b7df0d51
Jul 28 17:18:10.975430 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:10.975389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hjqct" event={"ID":"654aefc2-49e8-4014-85bf-c9ab3f564acb","Type":"ContainerStarted","Data":"40af8f80490704aeed5d460f92e2542dba37bbfef1a065f58c0ada23b7df0d51"}
Jul 28 17:18:10.980400 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:10.979738    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gzx6v" event={"ID":"cd4c39fa-bc1a-43d4-bd68-a32079e1b915","Type":"ContainerStarted","Data":"0d80ca019ea4c5f3ec8f77dd4b678a3767c30c91fbc6e156a31ac215258a22e4"}
Jul 28 17:18:10.980400 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:10.979822    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gzx6v" event={"ID":"cd4c39fa-bc1a-43d4-bd68-a32079e1b915","Type":"ContainerStarted","Data":"c7800f1dab20a569115f4c1e87aae81efef88a6fe0d725d60facd25b09ca8664"}
Jul 28 17:18:11.004423 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:11.004369    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gzx6v" podStartSLOduration=65.806713255 podStartE2EDuration="1m7.004353196s" totalImagesPullingTime="1.197639941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:11.001413222 +0000 UTC m=+67.833644491" watchObservedRunningTime="2026-07-28 17:18:11.004353196 +0000 UTC m=+67.836584443"
Jul 28 17:18:11.132754 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:11.132642    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:11.679071 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:11.679036    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:11.740132 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:11.740089    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:11.803701 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:11.803662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:11.999592 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:11.999502    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:12.105557 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.105477    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:12.213339 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.213273    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:12.332213 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.331532    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:12.403251 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.402883    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"]
Jul 28 17:18:12.425827 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.425428    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"
Jul 28 17:18:12.431332 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.431071    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-t2w7j\""
Jul 28 17:18:12.431332 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.431123    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 17:18:12.431332 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.431071    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 28 17:18:12.431332 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.431332    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 17:18:12.433981 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.432422    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 17:18:12.437146 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.436970    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 28 17:18:12.439160 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.438256    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"]
Jul 28 17:18:12.456447 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.456113    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mbb6v"]
Jul 28 17:18:12.486611 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.486575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:12.489850 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.487873    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"]
Jul 28 17:18:12.491882 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.490060    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.494032 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.493603    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mkft5\""
Jul 28 17:18:12.495031 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.494384    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 17:18:12.495031 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.494601    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 17:18:12.495031 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.494878    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 17:18:12.502457 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.501372    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"]
Jul 28 17:18:12.502457 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.501491    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.505253 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.504945    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 28 17:18:12.506296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.506074    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 28 17:18:12.506296 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.506132    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 28 17:18:12.506484 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.506351    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ktfpg\""
Jul 28 17:18:12.557046 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.554870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9469e45c-b060-49d7-84c3-4145dd93f053-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.557046 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.554917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-wtmp\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.557046 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.554950    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44382ef3-6f81-4975-bf37-de90506f9469-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-tjbs9\" (UID: \"44382ef3-6f81-4975-bf37-de90506f9469\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"
Jul 28 17:18:12.557046 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.554984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9469e45c-b060-49d7-84c3-4145dd93f053-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.557046 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.555011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44382ef3-6f81-4975-bf37-de90506f9469-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-tjbs9\" (UID: \"44382ef3-6f81-4975-bf37-de90506f9469\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"
Jul 28 17:18:12.557046 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.555041    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.557046 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.555082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44382ef3-6f81-4975-bf37-de90506f9469-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-tjbs9\" (UID: \"44382ef3-6f81-4975-bf37-de90506f9469\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"
Jul 28 17:18:12.557046 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.555114    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk4d8\" (UniqueName: \"kubernetes.io/projected/9469e45c-b060-49d7-84c3-4145dd93f053-kube-api-access-vk4d8\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.557046 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.555141    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41ef7f50-2193-4a50-87ac-67156b096874-metrics-client-ca\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.557046 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.555170    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9469e45c-b060-49d7-84c3-4145dd93f053-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.557046 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.555199    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41ef7f50-2193-4a50-87ac-67156b096874-sys\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.557046 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.555223    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-tls\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.557046 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.555252    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-textfile\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.557046 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.555276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsrxl\" (UniqueName: \"kubernetes.io/projected/41ef7f50-2193-4a50-87ac-67156b096874-kube-api-access-qsrxl\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.557046 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.555318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9469e45c-b060-49d7-84c3-4145dd93f053-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.557963 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.555344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m98v\" (UniqueName: \"kubernetes.io/projected/44382ef3-6f81-4975-bf37-de90506f9469-kube-api-access-8m98v\") pod \"openshift-state-metrics-b8f49f5c6-tjbs9\" (UID: \"44382ef3-6f81-4975-bf37-de90506f9469\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"
Jul 28 17:18:12.557963 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.555396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9469e45c-b060-49d7-84c3-4145dd93f053-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.557963 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.555427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-accelerators-collector-config\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.557963 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.555456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41ef7f50-2193-4a50-87ac-67156b096874-root\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.656526 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656445    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9469e45c-b060-49d7-84c3-4145dd93f053-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.656526 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656495    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-wtmp\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.656763 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656530    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44382ef3-6f81-4975-bf37-de90506f9469-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-tjbs9\" (UID: \"44382ef3-6f81-4975-bf37-de90506f9469\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"
Jul 28 17:18:12.656763 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9469e45c-b060-49d7-84c3-4145dd93f053-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.656763 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44382ef3-6f81-4975-bf37-de90506f9469-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-tjbs9\" (UID: \"44382ef3-6f81-4975-bf37-de90506f9469\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"
Jul 28 17:18:12.656763 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.656763 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44382ef3-6f81-4975-bf37-de90506f9469-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-tjbs9\" (UID: \"44382ef3-6f81-4975-bf37-de90506f9469\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"
Jul 28 17:18:12.656763 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656695    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk4d8\" (UniqueName: \"kubernetes.io/projected/9469e45c-b060-49d7-84c3-4145dd93f053-kube-api-access-vk4d8\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.656763 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41ef7f50-2193-4a50-87ac-67156b096874-metrics-client-ca\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.656763 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656750    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9469e45c-b060-49d7-84c3-4145dd93f053-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.657121 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656777    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41ef7f50-2193-4a50-87ac-67156b096874-sys\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.657121 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656822    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-tls\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.657121 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656852    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-textfile\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.657121 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsrxl\" (UniqueName: \"kubernetes.io/projected/41ef7f50-2193-4a50-87ac-67156b096874-kube-api-access-qsrxl\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.657121 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656917    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9469e45c-b060-49d7-84c3-4145dd93f053-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.657121 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656944    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m98v\" (UniqueName: \"kubernetes.io/projected/44382ef3-6f81-4975-bf37-de90506f9469-kube-api-access-8m98v\") pod \"openshift-state-metrics-b8f49f5c6-tjbs9\" (UID: \"44382ef3-6f81-4975-bf37-de90506f9469\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"
Jul 28 17:18:12.657121 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.656992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9469e45c-b060-49d7-84c3-4145dd93f053-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.657121 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.657021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-accelerators-collector-config\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.657121 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.657047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41ef7f50-2193-4a50-87ac-67156b096874-root\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.657542 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.657141    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41ef7f50-2193-4a50-87ac-67156b096874-root\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.657542 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:18:12.657253    2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 28 17:18:12.657542 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:18:12.657315    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9469e45c-b060-49d7-84c3-4145dd93f053-kube-state-metrics-tls podName:9469e45c-b060-49d7-84c3-4145dd93f053 nodeName:}" failed. No retries permitted until 2026-07-28 17:18:13.157293521 +0000 UTC m=+69.989524754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9469e45c-b060-49d7-84c3-4145dd93f053-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-crv2w" (UID: "9469e45c-b060-49d7-84c3-4145dd93f053") : secret "kube-state-metrics-tls" not found
Jul 28 17:18:12.657824 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.657710    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-wtmp\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.657970 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.657904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41ef7f50-2193-4a50-87ac-67156b096874-sys\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.660126 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:18:12.658093    2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 28 17:18:12.660126 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:18:12.658154    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44382ef3-6f81-4975-bf37-de90506f9469-openshift-state-metrics-tls podName:44382ef3-6f81-4975-bf37-de90506f9469 nodeName:}" failed. No retries permitted until 2026-07-28 17:18:13.158135857 +0000 UTC m=+69.990367089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/44382ef3-6f81-4975-bf37-de90506f9469-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-tjbs9" (UID: "44382ef3-6f81-4975-bf37-de90506f9469") : secret "openshift-state-metrics-tls" not found
Jul 28 17:18:12.660126 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.658472    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9469e45c-b060-49d7-84c3-4145dd93f053-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.660126 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:18:12.658581    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 28 17:18:12.660126 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:18:12.658628    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-tls podName:41ef7f50-2193-4a50-87ac-67156b096874 nodeName:}" failed. No retries permitted until 2026-07-28 17:18:13.158611547 +0000 UTC m=+69.990842787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-tls") pod "node-exporter-mbb6v" (UID: "41ef7f50-2193-4a50-87ac-67156b096874") : secret "node-exporter-tls" not found
Jul 28 17:18:12.660126 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.658683    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9469e45c-b060-49d7-84c3-4145dd93f053-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.660126 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.658937    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-textfile\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.660126 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.659141    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9469e45c-b060-49d7-84c3-4145dd93f053-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.660126 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.659371    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44382ef3-6f81-4975-bf37-de90506f9469-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-tjbs9\" (UID: \"44382ef3-6f81-4975-bf37-de90506f9469\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"
Jul 28 17:18:12.660126 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.659687    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-accelerators-collector-config\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.660126 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.659941    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41ef7f50-2193-4a50-87ac-67156b096874-metrics-client-ca\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.669149 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.668917    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44382ef3-6f81-4975-bf37-de90506f9469-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-tjbs9\" (UID: \"44382ef3-6f81-4975-bf37-de90506f9469\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"
Jul 28 17:18:12.672678 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.672259    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk4d8\" (UniqueName: \"kubernetes.io/projected/9469e45c-b060-49d7-84c3-4145dd93f053-kube-api-access-vk4d8\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.682993 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.677923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m98v\" (UniqueName: \"kubernetes.io/projected/44382ef3-6f81-4975-bf37-de90506f9469-kube-api-access-8m98v\") pod \"openshift-state-metrics-b8f49f5c6-tjbs9\" (UID: \"44382ef3-6f81-4975-bf37-de90506f9469\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"
Jul 28 17:18:12.683538 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.683446    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.718837 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.690081    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9469e45c-b060-49d7-84c3-4145dd93f053-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:12.718837 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.690211    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsrxl\" (UniqueName: \"kubernetes.io/projected/41ef7f50-2193-4a50-87ac-67156b096874-kube-api-access-qsrxl\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:12.740268 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.740193    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:12.842334 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.842246    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:12.942848 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:12.942741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:13.045370 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:13.045293    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:13.146854 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:13.146758    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:13.162348 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:13.162317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9469e45c-b060-49d7-84c3-4145dd93f053-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:13.162348 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:13.162351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44382ef3-6f81-4975-bf37-de90506f9469-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-tjbs9\" (UID: \"44382ef3-6f81-4975-bf37-de90506f9469\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"
Jul 28 17:18:13.162578 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:13.162386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-tls\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:13.166746 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:13.166715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44382ef3-6f81-4975-bf37-de90506f9469-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-tjbs9\" (UID: \"44382ef3-6f81-4975-bf37-de90506f9469\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"
Jul 28 17:18:13.167485 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:13.167454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9469e45c-b060-49d7-84c3-4145dd93f053-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-crv2w\" (UID: \"9469e45c-b060-49d7-84c3-4145dd93f053\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:13.167781 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:13.167759    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41ef7f50-2193-4a50-87ac-67156b096874-node-exporter-tls\") pod \"node-exporter-mbb6v\" (UID: \"41ef7f50-2193-4a50-87ac-67156b096874\") " pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:13.342117 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:13.342082    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"
Jul 28 17:18:13.392226 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:13.392161    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:13.406208 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:13.406178    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mbb6v"
Jul 28 17:18:13.419745 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:13.419673    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"
Jul 28 17:18:13.492103 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:13.492060    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:13.694184 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:13.694104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:13.824486 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:13.824442    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:13.895579 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:13.895539    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:14.077554 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:14.077492    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:14.177253 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:14.177219    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:15.419484 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.419407    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:15.481674 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.481622    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-dc7467688-kwc9l"]
Jul 28 17:18:15.486013 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.485950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:15.491640 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.490969    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9"]
Jul 28 17:18:15.491640 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.491117    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.495658 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.495367    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 28 17:18:15.495658 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.495385    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 28 17:18:15.495658 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.495421    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 28 17:18:15.495658 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.495370    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-86fxk\""
Jul 28 17:18:15.495658 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.495488    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4onufthmdskuq\""
Jul 28 17:18:15.495959 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.495678    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 28 17:18:15.496358 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.496337    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 28 17:18:15.499943 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.499849    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-dc7467688-kwc9l"]
Jul 28 17:18:15.584562 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.584483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.584562 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.584536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.584764 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.584597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c00fe89-f91e-413b-a8c6-e4e1895260b9-metrics-client-ca\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.584764 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.584638    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-thanos-querier-tls\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.584764 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.584676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlkwl\" (UniqueName: \"kubernetes.io/projected/8c00fe89-f91e-413b-a8c6-e4e1895260b9-kube-api-access-hlkwl\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.584764 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.584734    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-grpc-tls\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.584979 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.584830    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.584979 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.584880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.586605 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.586578    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:15.685483 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.685444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.685483 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.685487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.685714 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.685506    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c00fe89-f91e-413b-a8c6-e4e1895260b9-metrics-client-ca\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.685714 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.685533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-thanos-querier-tls\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.685714 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.685549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlkwl\" (UniqueName: \"kubernetes.io/projected/8c00fe89-f91e-413b-a8c6-e4e1895260b9-kube-api-access-hlkwl\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.685714 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.685583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-grpc-tls\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.685714 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.685605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.685714 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.685649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.686699 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.686647    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c00fe89-f91e-413b-a8c6-e4e1895260b9-metrics-client-ca\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.689453 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.689385    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.689575 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.689558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-thanos-querier-tls\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.689637 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.689601    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.689697 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.689661    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-grpc-tls\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.691007 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.690987    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.691440 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.691423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8c00fe89-f91e-413b-a8c6-e4e1895260b9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.696079 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.696061    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlkwl\" (UniqueName: \"kubernetes.io/projected/8c00fe89-f91e-413b-a8c6-e4e1895260b9-kube-api-access-hlkwl\") pod \"thanos-querier-dc7467688-kwc9l\" (UID: \"8c00fe89-f91e-413b-a8c6-e4e1895260b9\") " pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.805902 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.805598    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:15.939301 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:15.939216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:17.133383 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:17.133343    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:17.151410 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:17.151379    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl"]
Jul 28 17:18:17.170272 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:17.168862    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl"]
Jul 28 17:18:17.170272 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:17.168969    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl"
Jul 28 17:18:17.172264 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:17.171878    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 28 17:18:17.172264 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:17.171941    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-b7nnr\""
Jul 28 17:18:17.200536 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:17.200509    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:17.300264 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:17.300230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp9mq\" (UniqueName: \"kubernetes.io/projected/caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db-kube-api-access-xp9mq\") pod \"monitoring-plugin-68b7fc9574-87hcl\" (UID: \"caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl"
Jul 28 17:18:17.300456 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:17.300280    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-87hcl\" (UID: \"caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl"
Jul 28 17:18:17.401529 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:17.401448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp9mq\" (UniqueName: \"kubernetes.io/projected/caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db-kube-api-access-xp9mq\") pod \"monitoring-plugin-68b7fc9574-87hcl\" (UID: \"caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl"
Jul 28 17:18:17.401529 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:17.401493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-87hcl\" (UID: \"caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl"
Jul 28 17:18:17.401705 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:18:17.401622    2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 28 17:18:17.401705 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:18:17.401687    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db-monitoring-plugin-cert podName:caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db nodeName:}" failed. No retries permitted until 2026-07-28 17:18:17.901670788 +0000 UTC m=+74.733902033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-87hcl" (UID: "caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db") : secret "monitoring-plugin-cert" not found
Jul 28 17:18:17.410569 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:17.410523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp9mq\" (UniqueName: \"kubernetes.io/projected/caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db-kube-api-access-xp9mq\") pod \"monitoring-plugin-68b7fc9574-87hcl\" (UID: \"caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl"
Jul 28 17:18:17.425637 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:18:17.425604    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44382ef3_6f81_4975_bf37_de90506f9469.slice/crio-0d82e314326cbaa955cab4cadc00cc281651bed7096336babdbc574f248ff775 WatchSource:0}: Error finding container 0d82e314326cbaa955cab4cadc00cc281651bed7096336babdbc574f248ff775: Status 404 returned error can't find the container with id 0d82e314326cbaa955cab4cadc00cc281651bed7096336babdbc574f248ff775
Jul 28 17:18:17.571074 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:17.571034    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w"]
Jul 28 17:18:17.637469 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:17.637432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:17.794210 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:18:17.794181    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41ef7f50_2193_4a50_87ac_67156b096874.slice/crio-59289dbea42642340568682a946ae537440ddc24a68655eafc6992b8da84bbff WatchSource:0}: Error finding container 59289dbea42642340568682a946ae537440ddc24a68655eafc6992b8da84bbff: Status 404 returned error can't find the container with id 59289dbea42642340568682a946ae537440ddc24a68655eafc6992b8da84bbff
Jul 28 17:18:17.794830 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:18:17.794730    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9469e45c_b060_49d7_84c3_4145dd93f053.slice/crio-ae5937899c2ab1f6c22aad3f07e6ce8fc723b6b6dea4cba39b18e8dd344c0eb3 WatchSource:0}: Error finding container ae5937899c2ab1f6c22aad3f07e6ce8fc723b6b6dea4cba39b18e8dd344c0eb3: Status 404 returned error can't find the container with id ae5937899c2ab1f6c22aad3f07e6ce8fc723b6b6dea4cba39b18e8dd344c0eb3
Jul 28 17:18:17.905032 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:17.904979    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-87hcl\" (UID: \"caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl"
Jul 28 17:18:17.907724 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:17.907701    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-87hcl\" (UID: \"caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl"
Jul 28 17:18:18.021752 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:18.021716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbb6v" event={"ID":"41ef7f50-2193-4a50-87ac-67156b096874","Type":"ContainerStarted","Data":"59289dbea42642340568682a946ae537440ddc24a68655eafc6992b8da84bbff"}
Jul 28 17:18:18.023044 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:18.023016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w" event={"ID":"9469e45c-b060-49d7-84c3-4145dd93f053","Type":"ContainerStarted","Data":"ae5937899c2ab1f6c22aad3f07e6ce8fc723b6b6dea4cba39b18e8dd344c0eb3"}
Jul 28 17:18:18.024237 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:18.024215    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9" event={"ID":"44382ef3-6f81-4975-bf37-de90506f9469","Type":"ContainerStarted","Data":"0d82e314326cbaa955cab4cadc00cc281651bed7096336babdbc574f248ff775"}
Jul 28 17:18:18.080783 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:18.080687    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl"
Jul 28 17:18:18.301378 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:18.301347    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-dc7467688-kwc9l"]
Jul 28 17:18:18.306468 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:18:18.305963    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c00fe89_f91e_413b_a8c6_e4e1895260b9.slice/crio-7be9ed030e8c1f926239c3ef6e36d311c1edfe6268db4449fc7b578a47681262 WatchSource:0}: Error finding container 7be9ed030e8c1f926239c3ef6e36d311c1edfe6268db4449fc7b578a47681262: Status 404 returned error can't find the container with id 7be9ed030e8c1f926239c3ef6e36d311c1edfe6268db4449fc7b578a47681262
Jul 28 17:18:18.309395 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:18.309195    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl"]
Jul 28 17:18:18.313355 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:18:18.313325    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa58b29_4b1a_4c1f_b3e2_63d5eba8e5db.slice/crio-7c116a2e94e443da988e41422cf95f94be9c911085653f2906ecfddf206633ac WatchSource:0}: Error finding container 7c116a2e94e443da988e41422cf95f94be9c911085653f2906ecfddf206633ac: Status 404 returned error can't find the container with id 7c116a2e94e443da988e41422cf95f94be9c911085653f2906ecfddf206633ac
Jul 28 17:18:18.962843 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:18.962785    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:19.033618 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:19.033275    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tdwcc" event={"ID":"09a1f566-ddd6-4867-be93-31d4d4b9f98f","Type":"ContainerStarted","Data":"d30321c5e7d31e63ee147ff068c1380c22a2709b6d79aa18b2eb93d69548eabb"}
Jul 28 17:18:19.035943 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:19.035894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hjqct" event={"ID":"654aefc2-49e8-4014-85bf-c9ab3f564acb","Type":"ContainerStarted","Data":"635b91201c359a21fdd7ac836c401fc8e5147acbbed3d163666b546a8d73fd8b"}
Jul 28 17:18:19.038079 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:19.038050    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl" event={"ID":"caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db","Type":"ContainerStarted","Data":"7c116a2e94e443da988e41422cf95f94be9c911085653f2906ecfddf206633ac"}
Jul 28 17:18:19.041399 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:19.041373    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-64z5r" event={"ID":"0352e080-a0e6-4977-9f2c-fef0f6488583","Type":"ContainerStarted","Data":"cdc67f0cbd72084f5e57ff5b212c060a64b389efc36e49e417f636e596be8d58"}
Jul 28 17:18:19.041957 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:19.041899    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:18:19.044744 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:19.044650    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9" event={"ID":"44382ef3-6f81-4975-bf37-de90506f9469","Type":"ContainerStarted","Data":"11599820d825bef5e131f8eeacf59be448b4a5d706a076ff759d5285738ceb17"}
Jul 28 17:18:19.044744 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:19.044699    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9" event={"ID":"44382ef3-6f81-4975-bf37-de90506f9469","Type":"ContainerStarted","Data":"8bd7767160110f001004b89d92642c31f58d6150a657392a6b94d1b4defcaeff"}
Jul 28 17:18:19.046110 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:19.046089    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l" event={"ID":"8c00fe89-f91e-413b-a8c6-e4e1895260b9","Type":"ContainerStarted","Data":"7be9ed030e8c1f926239c3ef6e36d311c1edfe6268db4449fc7b578a47681262"}
Jul 28 17:18:19.057418 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:19.056007    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tdwcc" podStartSLOduration=66.673184704 podStartE2EDuration="1m15.055987043s" totalImagesPullingTime="8.382802339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:19.05556207 +0000 UTC m=+75.887793319" watchObservedRunningTime="2026-07-28 17:18:19.055987043 +0000 UTC m=+75.888218273"
Jul 28 17:18:19.077547 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:19.076346    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-64z5r" podStartSLOduration=67.03867854 podStartE2EDuration="1m15.076324992s" totalImagesPullingTime="8.037646452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:19.075741571 +0000 UTC m=+75.907972821" watchObservedRunningTime="2026-07-28 17:18:19.076324992 +0000 UTC m=+75.908556242"
Jul 28 17:18:21.645584 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.645541    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54b46ff5c5-nnkgj"]
Jul 28 17:18:21.664418 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.664381    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b46ff5c5-nnkgj"]
Jul 28 17:18:21.664557 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.664506    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.669544 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.669519    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 17:18:21.669626 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.669556    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 17:18:21.669720 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.669698    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 17:18:21.670650 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.670573    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k7g67\""
Jul 28 17:18:21.670807 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.670764    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 17:18:21.670941 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.670915    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 17:18:21.671324 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.671302    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 17:18:21.671731 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.671711    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 17:18:21.741258 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.741217    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-oauth-config\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.741433 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.741283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-service-ca\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.741433 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.741367    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-oauth-serving-cert\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.741527 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.741442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-744g5\" (UniqueName: \"kubernetes.io/projected/6defdd60-86c8-4c60-ba49-75c424a2c5cb-kube-api-access-744g5\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.741527 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.741477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-serving-cert\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.741612 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.741527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-config\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.765384 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.765348    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:21.842474 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.842441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-744g5\" (UniqueName: \"kubernetes.io/projected/6defdd60-86c8-4c60-ba49-75c424a2c5cb-kube-api-access-744g5\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.842648 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.842482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-serving-cert\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.842648 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.842521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-config\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.842648 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.842561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-oauth-config\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.842648 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.842599    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-service-ca\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.842648 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.842640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-oauth-serving-cert\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.843436 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.843410    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-oauth-serving-cert\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.843617 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.843592    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-config\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.844113 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.844073    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-service-ca\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.845562 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.845522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-oauth-config\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.846054 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.846033    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-serving-cert\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.851279 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.851261    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-744g5\" (UniqueName: \"kubernetes.io/projected/6defdd60-86c8-4c60-ba49-75c424a2c5cb-kube-api-access-744g5\") pod \"console-54b46ff5c5-nnkgj\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") " pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:21.864880 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.864842    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:21.929189 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.929111    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:21.976990 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:21.976957    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:23.009561 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:23.009267    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54b46ff5c5-nnkgj"]
Jul 28 17:18:23.016227 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:18:23.016187    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6defdd60_86c8_4c60_ba49_75c424a2c5cb.slice/crio-c6954099eb5bcbbfd1b08a167b4b30135e705332544cbb1944eed0dcaf76485c WatchSource:0}: Error finding container c6954099eb5bcbbfd1b08a167b4b30135e705332544cbb1944eed0dcaf76485c: Status 404 returned error can't find the container with id c6954099eb5bcbbfd1b08a167b4b30135e705332544cbb1944eed0dcaf76485c
Jul 28 17:18:23.068133 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:23.068094    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hjqct" event={"ID":"654aefc2-49e8-4014-85bf-c9ab3f564acb","Type":"ContainerStarted","Data":"adea1ec455a14ff554c3cba98eb3c39260402434a7f52f299255886c21921576"}
Jul 28 17:18:23.069671 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:23.069609    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl" event={"ID":"caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db","Type":"ContainerStarted","Data":"c8a092e58f0051b1938f901e1299fd613af4f2690d0945abe50258616543a8bf"}
Jul 28 17:18:23.070497 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:23.070450    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl"
Jul 28 17:18:23.075118 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:23.073506    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbb6v" event={"ID":"41ef7f50-2193-4a50-87ac-67156b096874","Type":"ContainerStarted","Data":"2ab3cb2eeb0d445e15c9360452d37e89a7c12927937475869834d628c491706f"}
Jul 28 17:18:23.076258 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:23.075619    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w" event={"ID":"9469e45c-b060-49d7-84c3-4145dd93f053","Type":"ContainerStarted","Data":"f84d71a6e4cfb481576eab1e600d012dd6180f01ab53ed890ff120d78e0e7134"}
Jul 28 17:18:23.076929 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:23.076880    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl"
Jul 28 17:18:23.078618 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:23.078558    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9" event={"ID":"44382ef3-6f81-4975-bf37-de90506f9469","Type":"ContainerStarted","Data":"bfd56da68a8604d4b240d3a12da246edfe7fe93bfcd33382e38217f4ed7d81d5"}
Jul 28 17:18:23.080354 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:23.080334    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b46ff5c5-nnkgj" event={"ID":"6defdd60-86c8-4c60-ba49-75c424a2c5cb","Type":"ContainerStarted","Data":"c6954099eb5bcbbfd1b08a167b4b30135e705332544cbb1944eed0dcaf76485c"}
Jul 28 17:18:23.084306 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:23.084204    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l" event={"ID":"8c00fe89-f91e-413b-a8c6-e4e1895260b9","Type":"ContainerStarted","Data":"fab56ba0ac650dc83ae9c66a5be6c6940375da16ef62bb3138d29223c37133ea"}
Jul 28 17:18:23.092326 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:23.090805    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-87hcl" podStartSLOduration=1.549227101 podStartE2EDuration="6.090770637s" totalImagesPullingTime="4.541543536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:23.089623088 +0000 UTC m=+79.921854337" watchObservedRunningTime="2026-07-28 17:18:23.090770637 +0000 UTC m=+79.923001886"
Jul 28 17:18:23.126922 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:23.126115    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-tjbs9" podStartSLOduration=6.574357977 podStartE2EDuration="11.126095515s" totalImagesPullingTime="4.551737538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:23.125951494 +0000 UTC m=+79.958182754" watchObservedRunningTime="2026-07-28 17:18:23.126095515 +0000 UTC m=+79.958326763"
Jul 28 17:18:24.092522 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:24.092055    2563 generic.go:356] "Generic (PLEG): container finished" podID="41ef7f50-2193-4a50-87ac-67156b096874" containerID="2ab3cb2eeb0d445e15c9360452d37e89a7c12927937475869834d628c491706f" exitCode=0
Jul 28 17:18:24.092522 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:24.092157    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbb6v" event={"ID":"41ef7f50-2193-4a50-87ac-67156b096874","Type":"ContainerDied","Data":"2ab3cb2eeb0d445e15c9360452d37e89a7c12927937475869834d628c491706f"}
Jul 28 17:18:24.096770 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:24.096741    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w" event={"ID":"9469e45c-b060-49d7-84c3-4145dd93f053","Type":"ContainerStarted","Data":"86a89c550db8cf5a5b5162a74172ca0337d80630e3bd7c9797a774fc2e00684a"}
Jul 28 17:18:24.096916 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:24.096827    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w" event={"ID":"9469e45c-b060-49d7-84c3-4145dd93f053","Type":"ContainerStarted","Data":"0dd23d0cc17e45b058876d55c6fef28242c30a4a72f4dccfd86c226b16a23587"}
Jul 28 17:18:24.105056 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:24.104421    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l" event={"ID":"8c00fe89-f91e-413b-a8c6-e4e1895260b9","Type":"ContainerStarted","Data":"1064bd66a22b4abc552e5d4566a31728cf4e741feec6d6e123519d5bd477dea6"}
Jul 28 17:18:24.105056 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:24.104493    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l" event={"ID":"8c00fe89-f91e-413b-a8c6-e4e1895260b9","Type":"ContainerStarted","Data":"4f5893951718f333dce801e8c5cf17ddf747ef6404ed695a8ad2a44c2484325d"}
Jul 28 17:18:24.137730 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:24.137519    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-crv2w" podStartSLOduration=7.7145143449999996 podStartE2EDuration="12.13749841s" totalImagesPullingTime="4.422984065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:24.135284627 +0000 UTC m=+80.967515888" watchObservedRunningTime="2026-07-28 17:18:24.13749841 +0000 UTC m=+80.969729654"
Jul 28 17:18:25.114057 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:25.113999    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l" event={"ID":"8c00fe89-f91e-413b-a8c6-e4e1895260b9","Type":"ContainerStarted","Data":"2c6861e58940acb9695eeedd4959d973aaed9cea612d8a2d87560dba6594fbaa"}
Jul 28 17:18:25.114485 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:25.114099    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l" event={"ID":"8c00fe89-f91e-413b-a8c6-e4e1895260b9","Type":"ContainerStarted","Data":"d32a67bd5c38735307e29661a59e36a16c9d6976ee1405b81cccd123a848721d"}
Jul 28 17:18:25.114485 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:25.114141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l" event={"ID":"8c00fe89-f91e-413b-a8c6-e4e1895260b9","Type":"ContainerStarted","Data":"df294d8178eea95d2d09fce008f5d77527edf00e51a20bb322d96c07141cb3a5"}
Jul 28 17:18:25.114485 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:25.114236    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:25.118156 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:25.117691    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbb6v" event={"ID":"41ef7f50-2193-4a50-87ac-67156b096874","Type":"ContainerStarted","Data":"cef1530d4649f0006c204220fb0c2d21c20c0b428b653e663da697830f8545a9"}
Jul 28 17:18:25.118156 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:25.117756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbb6v" event={"ID":"41ef7f50-2193-4a50-87ac-67156b096874","Type":"ContainerStarted","Data":"34f509b1a8c982c3812afe5a17844a4f44b0b54de1de56e603e8153f9bf88a43"}
Jul 28 17:18:25.176122 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:25.176060    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mbb6v" podStartSLOduration=9.185786204 podStartE2EDuration="13.176036286s" totalImagesPullingTime="3.871971137s" totalInitContainerRuntime="118.278945ms" isStatefulPod=true podCreationTimestamp="2026-07-28 17:18:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:25.174840855 +0000 UTC m=+82.007072104" watchObservedRunningTime="2026-07-28 17:18:25.176036286 +0000 UTC m=+82.008267534"
Jul 28 17:18:25.176925 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:25.176887    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l" podStartSLOduration=4.646253351 podStartE2EDuration="10.176872155s" totalImagesPullingTime="5.530618804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:25.152316044 +0000 UTC m=+81.984547318" watchObservedRunningTime="2026-07-28 17:18:25.176872155 +0000 UTC m=+82.009103420"
Jul 28 17:18:25.957804 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:25.957760    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5497fb74fb-qg822"
Jul 28 17:18:26.119573 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.119534    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:26.221154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.221066    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:26.442744 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.442701    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58fd98bfcc-5qcc6"]
Jul 28 17:18:26.446374 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.446350    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.450324 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.450297    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:26.455316 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.455295    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 17:18:26.460286 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.460268    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58fd98bfcc-5qcc6"]
Jul 28 17:18:26.518697 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.518664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:26.589085 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.589047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84f375c2-e690-4f3a-9698-5d3a94543467-console-oauth-config\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.589226 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.589109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-service-ca\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.589226 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.589177    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84f375c2-e690-4f3a-9698-5d3a94543467-console-serving-cert\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.589226 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.589206    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-oauth-serving-cert\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.589364 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.589231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcnt4\" (UniqueName: \"kubernetes.io/projected/84f375c2-e690-4f3a-9698-5d3a94543467-kube-api-access-dcnt4\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.589364 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.589279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-console-config\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.589364 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.589353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-trusted-ca-bundle\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.690658 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.690619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-service-ca\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.690849 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.690669    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84f375c2-e690-4f3a-9698-5d3a94543467-console-serving-cert\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.690849 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.690697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-oauth-serving-cert\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.690849 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.690721    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcnt4\" (UniqueName: \"kubernetes.io/projected/84f375c2-e690-4f3a-9698-5d3a94543467-kube-api-access-dcnt4\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.691169 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.691137    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-console-config\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.691303 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.691206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-trusted-ca-bundle\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.691303 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.691274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84f375c2-e690-4f3a-9698-5d3a94543467-console-oauth-config\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.691518 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.691493    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-service-ca\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.692215 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.692191    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-oauth-serving-cert\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.692369 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.692345    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-console-config\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.692554 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.692536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-trusted-ca-bundle\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.693890 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.693855    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84f375c2-e690-4f3a-9698-5d3a94543467-console-serving-cert\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.694164 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.694147    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84f375c2-e690-4f3a-9698-5d3a94543467-console-oauth-config\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.699471 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.699443    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcnt4\" (UniqueName: \"kubernetes.io/projected/84f375c2-e690-4f3a-9698-5d3a94543467-kube-api-access-dcnt4\") pod \"console-58fd98bfcc-5qcc6\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") " pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.758099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.758062    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:26.836182 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.836100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:26.937735 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:26.937699    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:27.173372 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:27.173284    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:27.437482 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:27.437398    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:28.018120 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:28.018088    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58fd98bfcc-5qcc6"]
Jul 28 17:18:28.021663 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:18:28.021636    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84f375c2_e690_4f3a_9698_5d3a94543467.slice/crio-b52b3094d72197397f31805d41b65d6327565c803cda48cbd7bcc26dcfb1ac01 WatchSource:0}: Error finding container b52b3094d72197397f31805d41b65d6327565c803cda48cbd7bcc26dcfb1ac01: Status 404 returned error can't find the container with id b52b3094d72197397f31805d41b65d6327565c803cda48cbd7bcc26dcfb1ac01
Jul 28 17:18:28.133379 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:28.133292    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b46ff5c5-nnkgj" event={"ID":"6defdd60-86c8-4c60-ba49-75c424a2c5cb","Type":"ContainerStarted","Data":"e28668ed1d747e19984433132033a1f2cb3dc2abbb5f661957e689aae49850ee"}
Jul 28 17:18:28.135291 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:28.135256    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58fd98bfcc-5qcc6" event={"ID":"84f375c2-e690-4f3a-9698-5d3a94543467","Type":"ContainerStarted","Data":"8cee5a0cea6183c30fc8d54ede267d2b945b81edddc5f57abc2a08025f35fda7"}
Jul 28 17:18:28.135460 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:28.135306    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58fd98bfcc-5qcc6" event={"ID":"84f375c2-e690-4f3a-9698-5d3a94543467","Type":"ContainerStarted","Data":"b52b3094d72197397f31805d41b65d6327565c803cda48cbd7bcc26dcfb1ac01"}
Jul 28 17:18:28.137526 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:28.137495    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hjqct" event={"ID":"654aefc2-49e8-4014-85bf-c9ab3f564acb","Type":"ContainerStarted","Data":"67dcfe8c790d716dfee05dae3e3b30f6847dc9de78713d39aacf7d29e5b47add"}
Jul 28 17:18:28.156533 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:28.156488    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54b46ff5c5-nnkgj" podStartSLOduration=2.288340625 podStartE2EDuration="7.156471491s" totalImagesPullingTime="4.868130866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:28.155226969 +0000 UTC m=+84.987458218" watchObservedRunningTime="2026-07-28 17:18:28.156471491 +0000 UTC m=+84.988702739"
Jul 28 17:18:28.178463 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:28.178415    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hjqct" podStartSLOduration=33.374626674 podStartE2EDuration="50.17839828s" totalImagesPullingTime="16.803771606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:17:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:28.177247135 +0000 UTC m=+85.009478387" watchObservedRunningTime="2026-07-28 17:18:28.17839828 +0000 UTC m=+85.010629540"
Jul 28 17:18:30.640140 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:30.640103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:30.701395 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:30.701367    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:30.960163 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:30.960083    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:31.027103 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:31.027041    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:31.127812 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:31.127758    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-dc7467688-kwc9l"
Jul 28 17:18:31.159095 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:31.159040    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58fd98bfcc-5qcc6" podStartSLOduration=5.159022979 podStartE2EDuration="5.159022979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:28.202964934 +0000 UTC m=+85.035196181" watchObservedRunningTime="2026-07-28 17:18:31.159022979 +0000 UTC m=+87.991254228"
Jul 28 17:18:31.978036 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:31.978000    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:31.978438 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:31.978062    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:31.982840 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:31.982814    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:32.156269 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:32.156245    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:18:35.244510 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:35.244479    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:35.344683 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:35.344645    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:36.759012 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:36.758973    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:36.759384 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:36.759075    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:36.763620 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:36.763598    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:37.174443 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:37.174374    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:18:37.231214 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:37.231177    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b46ff5c5-nnkgj"]
Jul 28 17:18:39.857940 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:39.857903    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:39.958169 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:39.958134    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:40.342310 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:40.342281    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:40.479033 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:40.478987    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:40.576727 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:40.576700    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:42.437646 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:42.437613    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:42.540021 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:42.539973    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:45.946305 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:45.946276    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:46.039411 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:46.039377    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:46.921279 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:46.921246    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:47.002469 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:47.002442    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:51.059077 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:51.059044    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-64z5r"
Jul 28 17:18:51.517109 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:51.517081    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:53.164548 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:53.164510    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:53.236356 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:18:53.236324    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:01.913672 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:01.913636    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:01.977974 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:01.977941    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:02.251174 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:02.251089    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54b46ff5c5-nnkgj" podUID="6defdd60-86c8-4c60-ba49-75c424a2c5cb" containerName="console" containerID="cri-o://e28668ed1d747e19984433132033a1f2cb3dc2abbb5f661957e689aae49850ee" gracePeriod=15
Jul 28 17:19:02.983755 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:02.983727    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:19:03.081735 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.081698    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-oauth-config\") pod \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") "
Jul 28 17:19:03.081951 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.081771    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-config\") pod \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") "
Jul 28 17:19:03.081951 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.081814    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-oauth-serving-cert\") pod \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") "
Jul 28 17:19:03.081951 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.081848    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-serving-cert\") pod \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") "
Jul 28 17:19:03.081951 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.081873    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-service-ca\") pod \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") "
Jul 28 17:19:03.081951 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.081906    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-744g5\" (UniqueName: \"kubernetes.io/projected/6defdd60-86c8-4c60-ba49-75c424a2c5cb-kube-api-access-744g5\") pod \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\" (UID: \"6defdd60-86c8-4c60-ba49-75c424a2c5cb\") "
Jul 28 17:19:03.082245 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.082216    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-service-ca" (OuterVolumeSpecName: "service-ca") pod "6defdd60-86c8-4c60-ba49-75c424a2c5cb" (UID: "6defdd60-86c8-4c60-ba49-75c424a2c5cb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:19:03.082310 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.082251    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-config" (OuterVolumeSpecName: "console-config") pod "6defdd60-86c8-4c60-ba49-75c424a2c5cb" (UID: "6defdd60-86c8-4c60-ba49-75c424a2c5cb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:19:03.082310 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.082259    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6defdd60-86c8-4c60-ba49-75c424a2c5cb" (UID: "6defdd60-86c8-4c60-ba49-75c424a2c5cb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:19:03.084286 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.084254    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6defdd60-86c8-4c60-ba49-75c424a2c5cb" (UID: "6defdd60-86c8-4c60-ba49-75c424a2c5cb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:19:03.084452 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.084428    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6defdd60-86c8-4c60-ba49-75c424a2c5cb-kube-api-access-744g5" (OuterVolumeSpecName: "kube-api-access-744g5") pod "6defdd60-86c8-4c60-ba49-75c424a2c5cb" (UID: "6defdd60-86c8-4c60-ba49-75c424a2c5cb"). InnerVolumeSpecName "kube-api-access-744g5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:19:03.084517 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.084433    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6defdd60-86c8-4c60-ba49-75c424a2c5cb" (UID: "6defdd60-86c8-4c60-ba49-75c424a2c5cb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:19:03.182820 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.182735    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-serving-cert\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:19:03.182820 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.182758    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-service-ca\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:19:03.182820 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.182768    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-744g5\" (UniqueName: \"kubernetes.io/projected/6defdd60-86c8-4c60-ba49-75c424a2c5cb-kube-api-access-744g5\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:19:03.182820 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.182776    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-oauth-config\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:19:03.182820 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.182786    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-console-config\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:19:03.182820 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.182812    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6defdd60-86c8-4c60-ba49-75c424a2c5cb-oauth-serving-cert\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:19:03.268041 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.268002    2563 generic.go:356] "Generic (PLEG): container finished" podID="6defdd60-86c8-4c60-ba49-75c424a2c5cb" containerID="e28668ed1d747e19984433132033a1f2cb3dc2abbb5f661957e689aae49850ee" exitCode=0
Jul 28 17:19:03.268209 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.268054    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b46ff5c5-nnkgj" event={"ID":"6defdd60-86c8-4c60-ba49-75c424a2c5cb","Type":"ContainerDied","Data":"e28668ed1d747e19984433132033a1f2cb3dc2abbb5f661957e689aae49850ee"}
Jul 28 17:19:03.268209 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.268066    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54b46ff5c5-nnkgj"
Jul 28 17:19:03.268209 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.268107    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54b46ff5c5-nnkgj" event={"ID":"6defdd60-86c8-4c60-ba49-75c424a2c5cb","Type":"ContainerDied","Data":"c6954099eb5bcbbfd1b08a167b4b30135e705332544cbb1944eed0dcaf76485c"}
Jul 28 17:19:03.268209 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.268133    2563 scope.go:117] "RemoveContainer" containerID="e28668ed1d747e19984433132033a1f2cb3dc2abbb5f661957e689aae49850ee"
Jul 28 17:19:03.276975 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.276774    2563 scope.go:117] "RemoveContainer" containerID="e28668ed1d747e19984433132033a1f2cb3dc2abbb5f661957e689aae49850ee"
Jul 28 17:19:03.277157 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:19:03.277136    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e28668ed1d747e19984433132033a1f2cb3dc2abbb5f661957e689aae49850ee\": container with ID starting with e28668ed1d747e19984433132033a1f2cb3dc2abbb5f661957e689aae49850ee not found: ID does not exist" containerID="e28668ed1d747e19984433132033a1f2cb3dc2abbb5f661957e689aae49850ee"
Jul 28 17:19:03.277230 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.277170    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e28668ed1d747e19984433132033a1f2cb3dc2abbb5f661957e689aae49850ee"} err="failed to get container status \"e28668ed1d747e19984433132033a1f2cb3dc2abbb5f661957e689aae49850ee\": rpc error: code = NotFound desc = could not find container \"e28668ed1d747e19984433132033a1f2cb3dc2abbb5f661957e689aae49850ee\": container with ID starting with e28668ed1d747e19984433132033a1f2cb3dc2abbb5f661957e689aae49850ee not found: ID does not exist"
Jul 28 17:19:03.287487 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.287456    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54b46ff5c5-nnkgj"]
Jul 28 17:19:03.292226 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.292203    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54b46ff5c5-nnkgj"]
Jul 28 17:19:03.689706 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:03.689672    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6defdd60-86c8-4c60-ba49-75c424a2c5cb" path="/var/lib/kubelet/pods/6defdd60-86c8-4c60-ba49-75c424a2c5cb/volumes"
Jul 28 17:19:31.703043 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:31.703006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:31.801357 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:31.801322    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:37.951378 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:37.951343    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:40.214520 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.214487    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5668fc7c6b-686nl"]
Jul 28 17:19:40.214945 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.214778    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6defdd60-86c8-4c60-ba49-75c424a2c5cb" containerName="console"
Jul 28 17:19:40.214945 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.214807    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6defdd60-86c8-4c60-ba49-75c424a2c5cb" containerName="console"
Jul 28 17:19:40.214945 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.214881    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6defdd60-86c8-4c60-ba49-75c424a2c5cb" containerName="console"
Jul 28 17:19:40.217275 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.217258    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.229405 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.229382    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5668fc7c6b-686nl"]
Jul 28 17:19:40.272235 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.272204    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:40.338785 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.338758    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:40.381982 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.381952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-oauth-serving-cert\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.382094 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.382000    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34df3c89-aed3-4224-8ba8-dd8c78046650-console-serving-cert\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.382094 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.382023    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-service-ca\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.382094 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.382045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-trusted-ca-bundle\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.382094 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.382069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-console-config\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.382094 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.382086    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34df3c89-aed3-4224-8ba8-dd8c78046650-console-oauth-config\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.382250 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.382118    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlnqr\" (UniqueName: \"kubernetes.io/projected/34df3c89-aed3-4224-8ba8-dd8c78046650-kube-api-access-qlnqr\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.411420 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.411388    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:40.483502 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.483435    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34df3c89-aed3-4224-8ba8-dd8c78046650-console-serving-cert\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.483502 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.483466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-service-ca\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.483502 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.483494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-trusted-ca-bundle\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.483672 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.483515    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-console-config\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.483672 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.483542    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34df3c89-aed3-4224-8ba8-dd8c78046650-console-oauth-config\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.483771 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.483747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlnqr\" (UniqueName: \"kubernetes.io/projected/34df3c89-aed3-4224-8ba8-dd8c78046650-kube-api-access-qlnqr\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.483922 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.483903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-oauth-serving-cert\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.484358 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.484335    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-console-config\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.484512 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.484489    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-service-ca\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.484571 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.484500    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-oauth-serving-cert\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.484701 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.484680    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-trusted-ca-bundle\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.486175 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.486160    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34df3c89-aed3-4224-8ba8-dd8c78046650-console-serving-cert\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.486233 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.486178    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34df3c89-aed3-4224-8ba8-dd8c78046650-console-oauth-config\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.493173 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.493154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlnqr\" (UniqueName: \"kubernetes.io/projected/34df3c89-aed3-4224-8ba8-dd8c78046650-kube-api-access-qlnqr\") pod \"console-5668fc7c6b-686nl\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") " pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.527094 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.527070    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:40.536980 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.536946    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:40.654101 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:40.654006    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5668fc7c6b-686nl"]
Jul 28 17:19:40.656853 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:19:40.656825    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34df3c89_aed3_4224_8ba8_dd8c78046650.slice/crio-baea6a63b4f56fb82ecc714b9f015840d4e8e49509d55e5ff1cb60f1c46e4de1 WatchSource:0}: Error finding container baea6a63b4f56fb82ecc714b9f015840d4e8e49509d55e5ff1cb60f1c46e4de1: Status 404 returned error can't find the container with id baea6a63b4f56fb82ecc714b9f015840d4e8e49509d55e5ff1cb60f1c46e4de1
Jul 28 17:19:41.006520 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:41.006488    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:41.401054 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:41.400959    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5668fc7c6b-686nl" event={"ID":"34df3c89-aed3-4224-8ba8-dd8c78046650","Type":"ContainerStarted","Data":"ef00dd2b1de91ee315c1cd8531430983e685c6d823907529b6fb708ab7bb9b19"}
Jul 28 17:19:41.401054 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:41.401017    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5668fc7c6b-686nl" event={"ID":"34df3c89-aed3-4224-8ba8-dd8c78046650","Type":"ContainerStarted","Data":"baea6a63b4f56fb82ecc714b9f015840d4e8e49509d55e5ff1cb60f1c46e4de1"}
Jul 28 17:19:41.420644 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:41.420597    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5668fc7c6b-686nl" podStartSLOduration=1.420581255 podStartE2EDuration="1.420581255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:19:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:19:41.419406695 +0000 UTC m=+158.251637955" watchObservedRunningTime="2026-07-28 17:19:41.420581255 +0000 UTC m=+158.252812503"
Jul 28 17:19:50.527423 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:50.527369    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:50.527877 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:50.527456    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:50.532541 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:50.532518    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:51.441975 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:51.441949    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:19:51.494989 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:51.494951    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58fd98bfcc-5qcc6"]
Jul 28 17:19:51.635289 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:51.635257    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:51.732862 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:51.732776    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:51.801091 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:19:51.801065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:16.514710 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.514601    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58fd98bfcc-5qcc6" podUID="84f375c2-e690-4f3a-9698-5d3a94543467" containerName="console" containerID="cri-o://8cee5a0cea6183c30fc8d54ede267d2b945b81edddc5f57abc2a08025f35fda7" gracePeriod=15
Jul 28 17:20:16.756424 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.756400    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:20:16.872633 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.872554    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-service-ca\") pod \"84f375c2-e690-4f3a-9698-5d3a94543467\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") "
Jul 28 17:20:16.872633 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.872611    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-trusted-ca-bundle\") pod \"84f375c2-e690-4f3a-9698-5d3a94543467\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") "
Jul 28 17:20:16.872633 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.872634    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84f375c2-e690-4f3a-9698-5d3a94543467-console-serving-cert\") pod \"84f375c2-e690-4f3a-9698-5d3a94543467\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") "
Jul 28 17:20:16.872936 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.872663    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcnt4\" (UniqueName: \"kubernetes.io/projected/84f375c2-e690-4f3a-9698-5d3a94543467-kube-api-access-dcnt4\") pod \"84f375c2-e690-4f3a-9698-5d3a94543467\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") "
Jul 28 17:20:16.872936 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.872694    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-console-config\") pod \"84f375c2-e690-4f3a-9698-5d3a94543467\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") "
Jul 28 17:20:16.872936 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.872780    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84f375c2-e690-4f3a-9698-5d3a94543467-console-oauth-config\") pod \"84f375c2-e690-4f3a-9698-5d3a94543467\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") "
Jul 28 17:20:16.872936 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.872844    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-oauth-serving-cert\") pod \"84f375c2-e690-4f3a-9698-5d3a94543467\" (UID: \"84f375c2-e690-4f3a-9698-5d3a94543467\") "
Jul 28 17:20:16.873132 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.872995    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-service-ca" (OuterVolumeSpecName: "service-ca") pod "84f375c2-e690-4f3a-9698-5d3a94543467" (UID: "84f375c2-e690-4f3a-9698-5d3a94543467"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:20:16.873132 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.873092    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "84f375c2-e690-4f3a-9698-5d3a94543467" (UID: "84f375c2-e690-4f3a-9698-5d3a94543467"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:20:16.873274 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.873249    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-service-ca\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:20:16.873274 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.873264    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-console-config" (OuterVolumeSpecName: "console-config") pod "84f375c2-e690-4f3a-9698-5d3a94543467" (UID: "84f375c2-e690-4f3a-9698-5d3a94543467"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:20:16.873435 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.873299    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "84f375c2-e690-4f3a-9698-5d3a94543467" (UID: "84f375c2-e690-4f3a-9698-5d3a94543467"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:20:16.875015 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.874985    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84f375c2-e690-4f3a-9698-5d3a94543467-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "84f375c2-e690-4f3a-9698-5d3a94543467" (UID: "84f375c2-e690-4f3a-9698-5d3a94543467"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:20:16.875108 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.875061    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84f375c2-e690-4f3a-9698-5d3a94543467-kube-api-access-dcnt4" (OuterVolumeSpecName: "kube-api-access-dcnt4") pod "84f375c2-e690-4f3a-9698-5d3a94543467" (UID: "84f375c2-e690-4f3a-9698-5d3a94543467"). InnerVolumeSpecName "kube-api-access-dcnt4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:20:16.875108 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.875090    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84f375c2-e690-4f3a-9698-5d3a94543467-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "84f375c2-e690-4f3a-9698-5d3a94543467" (UID: "84f375c2-e690-4f3a-9698-5d3a94543467"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:20:16.974125 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.974083    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcnt4\" (UniqueName: \"kubernetes.io/projected/84f375c2-e690-4f3a-9698-5d3a94543467-kube-api-access-dcnt4\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:20:16.974125 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.974121    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-console-config\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:20:16.974125 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.974132    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84f375c2-e690-4f3a-9698-5d3a94543467-console-oauth-config\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:20:16.974125 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.974141    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-oauth-serving-cert\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:20:16.974367 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.974150    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84f375c2-e690-4f3a-9698-5d3a94543467-trusted-ca-bundle\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:20:16.974367 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:16.974159    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84f375c2-e690-4f3a-9698-5d3a94543467-console-serving-cert\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:20:17.536986 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:17.536944    2563 generic.go:356] "Generic (PLEG): container finished" podID="84f375c2-e690-4f3a-9698-5d3a94543467" containerID="8cee5a0cea6183c30fc8d54ede267d2b945b81edddc5f57abc2a08025f35fda7" exitCode=0
Jul 28 17:20:17.537407 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:17.536996    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58fd98bfcc-5qcc6"
Jul 28 17:20:17.537407 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:17.537015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58fd98bfcc-5qcc6" event={"ID":"84f375c2-e690-4f3a-9698-5d3a94543467","Type":"ContainerDied","Data":"8cee5a0cea6183c30fc8d54ede267d2b945b81edddc5f57abc2a08025f35fda7"}
Jul 28 17:20:17.537407 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:17.537066    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58fd98bfcc-5qcc6" event={"ID":"84f375c2-e690-4f3a-9698-5d3a94543467","Type":"ContainerDied","Data":"b52b3094d72197397f31805d41b65d6327565c803cda48cbd7bcc26dcfb1ac01"}
Jul 28 17:20:17.537407 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:17.537094    2563 scope.go:117] "RemoveContainer" containerID="8cee5a0cea6183c30fc8d54ede267d2b945b81edddc5f57abc2a08025f35fda7"
Jul 28 17:20:17.545681 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:17.545666    2563 scope.go:117] "RemoveContainer" containerID="8cee5a0cea6183c30fc8d54ede267d2b945b81edddc5f57abc2a08025f35fda7"
Jul 28 17:20:17.545949 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:20:17.545933    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cee5a0cea6183c30fc8d54ede267d2b945b81edddc5f57abc2a08025f35fda7\": container with ID starting with 8cee5a0cea6183c30fc8d54ede267d2b945b81edddc5f57abc2a08025f35fda7 not found: ID does not exist" containerID="8cee5a0cea6183c30fc8d54ede267d2b945b81edddc5f57abc2a08025f35fda7"
Jul 28 17:20:17.546001 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:17.545957    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cee5a0cea6183c30fc8d54ede267d2b945b81edddc5f57abc2a08025f35fda7"} err="failed to get container status \"8cee5a0cea6183c30fc8d54ede267d2b945b81edddc5f57abc2a08025f35fda7\": rpc error: code = NotFound desc = could not find container \"8cee5a0cea6183c30fc8d54ede267d2b945b81edddc5f57abc2a08025f35fda7\": container with ID starting with 8cee5a0cea6183c30fc8d54ede267d2b945b81edddc5f57abc2a08025f35fda7 not found: ID does not exist"
Jul 28 17:20:17.559631 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:17.559606    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58fd98bfcc-5qcc6"]
Jul 28 17:20:17.561813 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:17.561779    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58fd98bfcc-5qcc6"]
Jul 28 17:20:17.689684 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:17.689655    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84f375c2-e690-4f3a-9698-5d3a94543467" path="/var/lib/kubelet/pods/84f375c2-e690-4f3a-9698-5d3a94543467/volumes"
Jul 28 17:20:46.984158 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:46.984121    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:47.086038 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.085996    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:47.561081 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.561051    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c8bdc5846-lhgcf"]
Jul 28 17:20:47.561367 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.561354    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84f375c2-e690-4f3a-9698-5d3a94543467" containerName="console"
Jul 28 17:20:47.561409 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.561369    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="84f375c2-e690-4f3a-9698-5d3a94543467" containerName="console"
Jul 28 17:20:47.561442 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.561410    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="84f375c2-e690-4f3a-9698-5d3a94543467" containerName="console"
Jul 28 17:20:47.563482 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.563468    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.580621 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.580593    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8bdc5846-lhgcf"]
Jul 28 17:20:47.612914 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.612886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:47.615990 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.615973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgjkw\" (UniqueName: \"kubernetes.io/projected/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-kube-api-access-wgjkw\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.616060 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.616008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-config\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.616060 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.616045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-serving-cert\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.616123 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.616066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-trusted-ca-bundle\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.616123 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.616082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-oauth-config\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.616189 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.616130    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-service-ca\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.616189 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.616159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-oauth-serving-cert\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.679829 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.679780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:47.716768 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.716739    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-config\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.716952 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.716895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-serving-cert\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.717155 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.717128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-trusted-ca-bundle\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.717291 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.717162    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-oauth-config\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.717291 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.717218    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-service-ca\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.717291 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.717261    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-oauth-serving-cert\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.717445 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.717409    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgjkw\" (UniqueName: \"kubernetes.io/projected/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-kube-api-access-wgjkw\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.717500 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.717472    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-config\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.718090 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.718068    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-oauth-serving-cert\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.718163 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.718072    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-service-ca\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.718288 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.718270    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-trusted-ca-bundle\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.719618 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.719597    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-oauth-config\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.719708 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.719688    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-serving-cert\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.726233 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.726212    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgjkw\" (UniqueName: \"kubernetes.io/projected/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-kube-api-access-wgjkw\") pod \"console-5c8bdc5846-lhgcf\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") " pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:47.759909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.759867    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:47.829931 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.829838    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:47.872853 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:47.872823    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:48.002243 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:48.002214    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8bdc5846-lhgcf"]
Jul 28 17:20:48.005100 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:20:48.005060    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf6e706a_96d1_40eb_aa14_d29d0f77ad38.slice/crio-83cf2263716e0f729ef568e58264dc7b6f14b0d4a04b4b675be9700e744e6e59 WatchSource:0}: Error finding container 83cf2263716e0f729ef568e58264dc7b6f14b0d4a04b4b675be9700e744e6e59: Status 404 returned error can't find the container with id 83cf2263716e0f729ef568e58264dc7b6f14b0d4a04b4b675be9700e744e6e59
Jul 28 17:20:48.416980 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:48.416947    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:48.517042 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:48.517005    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:48.650759 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:48.650725    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8bdc5846-lhgcf" event={"ID":"cf6e706a-96d1-40eb-aa14-d29d0f77ad38","Type":"ContainerStarted","Data":"c746fb9ae065a5146995e393d2ae1fdb1c33370e823b8aea5915d40858a282a4"}
Jul 28 17:20:48.650975 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:48.650775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8bdc5846-lhgcf" event={"ID":"cf6e706a-96d1-40eb-aa14-d29d0f77ad38","Type":"ContainerStarted","Data":"83cf2263716e0f729ef568e58264dc7b6f14b0d4a04b4b675be9700e744e6e59"}
Jul 28 17:20:48.672377 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:48.672279    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c8bdc5846-lhgcf" podStartSLOduration=1.6722598309999999 podStartE2EDuration="1.672259831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:20:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:20:48.671881428 +0000 UTC m=+225.504112675" watchObservedRunningTime="2026-07-28 17:20:48.672259831 +0000 UTC m=+225.504491080"
Jul 28 17:20:57.873278 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:57.873245    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:57.873711 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:57.873317    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:57.877888 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:57.877865    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:58.694251 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:58.694219    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:20:58.757200 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:58.757169    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5668fc7c6b-686nl"]
Jul 28 17:20:58.867700 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:58.867667    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:58.968413 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:58.968337    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:59.028562 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:20:59.028531    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:01.930800 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:01.930756    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:02.031481 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:02.031449    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:23.401043 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:23.400994    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:23.776674 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:23.776618    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5668fc7c6b-686nl" podUID="34df3c89-aed3-4224-8ba8-dd8c78046650" containerName="console" containerID="cri-o://ef00dd2b1de91ee315c1cd8531430983e685c6d823907529b6fb708ab7bb9b19" gracePeriod=15
Jul 28 17:21:24.019717 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.019692    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:21:24.119749 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.119661    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-console-config\") pod \"34df3c89-aed3-4224-8ba8-dd8c78046650\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") "
Jul 28 17:21:24.119749 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.119715    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34df3c89-aed3-4224-8ba8-dd8c78046650-console-oauth-config\") pod \"34df3c89-aed3-4224-8ba8-dd8c78046650\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") "
Jul 28 17:21:24.119749 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.119752    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-oauth-serving-cert\") pod \"34df3c89-aed3-4224-8ba8-dd8c78046650\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") "
Jul 28 17:21:24.120060 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.119779    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-trusted-ca-bundle\") pod \"34df3c89-aed3-4224-8ba8-dd8c78046650\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") "
Jul 28 17:21:24.120060 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.119816    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-service-ca\") pod \"34df3c89-aed3-4224-8ba8-dd8c78046650\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") "
Jul 28 17:21:24.120060 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.119912    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34df3c89-aed3-4224-8ba8-dd8c78046650-console-serving-cert\") pod \"34df3c89-aed3-4224-8ba8-dd8c78046650\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") "
Jul 28 17:21:24.120060 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.119951    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlnqr\" (UniqueName: \"kubernetes.io/projected/34df3c89-aed3-4224-8ba8-dd8c78046650-kube-api-access-qlnqr\") pod \"34df3c89-aed3-4224-8ba8-dd8c78046650\" (UID: \"34df3c89-aed3-4224-8ba8-dd8c78046650\") "
Jul 28 17:21:24.120254 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.120145    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-console-config" (OuterVolumeSpecName: "console-config") pod "34df3c89-aed3-4224-8ba8-dd8c78046650" (UID: "34df3c89-aed3-4224-8ba8-dd8c78046650"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:21:24.120254 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.120229    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-service-ca" (OuterVolumeSpecName: "service-ca") pod "34df3c89-aed3-4224-8ba8-dd8c78046650" (UID: "34df3c89-aed3-4224-8ba8-dd8c78046650"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:21:24.120254 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.120239    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "34df3c89-aed3-4224-8ba8-dd8c78046650" (UID: "34df3c89-aed3-4224-8ba8-dd8c78046650"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:21:24.120362 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.120248    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "34df3c89-aed3-4224-8ba8-dd8c78046650" (UID: "34df3c89-aed3-4224-8ba8-dd8c78046650"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:21:24.122101 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.122071    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34df3c89-aed3-4224-8ba8-dd8c78046650-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "34df3c89-aed3-4224-8ba8-dd8c78046650" (UID: "34df3c89-aed3-4224-8ba8-dd8c78046650"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:21:24.122199 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.122133    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34df3c89-aed3-4224-8ba8-dd8c78046650-kube-api-access-qlnqr" (OuterVolumeSpecName: "kube-api-access-qlnqr") pod "34df3c89-aed3-4224-8ba8-dd8c78046650" (UID: "34df3c89-aed3-4224-8ba8-dd8c78046650"). InnerVolumeSpecName "kube-api-access-qlnqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:21:24.122249 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.122223    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34df3c89-aed3-4224-8ba8-dd8c78046650-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "34df3c89-aed3-4224-8ba8-dd8c78046650" (UID: "34df3c89-aed3-4224-8ba8-dd8c78046650"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:21:24.220971 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.220928    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34df3c89-aed3-4224-8ba8-dd8c78046650-console-oauth-config\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:21:24.220971 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.220964    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-oauth-serving-cert\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:21:24.220971 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.220973    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-trusted-ca-bundle\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:21:24.220971 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.220982    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-service-ca\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:21:24.221212 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.220991    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34df3c89-aed3-4224-8ba8-dd8c78046650-console-serving-cert\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:21:24.221212 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.221001    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlnqr\" (UniqueName: \"kubernetes.io/projected/34df3c89-aed3-4224-8ba8-dd8c78046650-kube-api-access-qlnqr\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:21:24.221212 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.221009    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34df3c89-aed3-4224-8ba8-dd8c78046650-console-config\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:21:24.780511 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.780472    2563 generic.go:356] "Generic (PLEG): container finished" podID="34df3c89-aed3-4224-8ba8-dd8c78046650" containerID="ef00dd2b1de91ee315c1cd8531430983e685c6d823907529b6fb708ab7bb9b19" exitCode=0
Jul 28 17:21:24.780961 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.780522    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5668fc7c6b-686nl"
Jul 28 17:21:24.780961 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.780542    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5668fc7c6b-686nl" event={"ID":"34df3c89-aed3-4224-8ba8-dd8c78046650","Type":"ContainerDied","Data":"ef00dd2b1de91ee315c1cd8531430983e685c6d823907529b6fb708ab7bb9b19"}
Jul 28 17:21:24.780961 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.780592    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5668fc7c6b-686nl" event={"ID":"34df3c89-aed3-4224-8ba8-dd8c78046650","Type":"ContainerDied","Data":"baea6a63b4f56fb82ecc714b9f015840d4e8e49509d55e5ff1cb60f1c46e4de1"}
Jul 28 17:21:24.780961 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.780621    2563 scope.go:117] "RemoveContainer" containerID="ef00dd2b1de91ee315c1cd8531430983e685c6d823907529b6fb708ab7bb9b19"
Jul 28 17:21:24.788945 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.788927    2563 scope.go:117] "RemoveContainer" containerID="ef00dd2b1de91ee315c1cd8531430983e685c6d823907529b6fb708ab7bb9b19"
Jul 28 17:21:24.789220 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:21:24.789201    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef00dd2b1de91ee315c1cd8531430983e685c6d823907529b6fb708ab7bb9b19\": container with ID starting with ef00dd2b1de91ee315c1cd8531430983e685c6d823907529b6fb708ab7bb9b19 not found: ID does not exist" containerID="ef00dd2b1de91ee315c1cd8531430983e685c6d823907529b6fb708ab7bb9b19"
Jul 28 17:21:24.789282 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.789232    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef00dd2b1de91ee315c1cd8531430983e685c6d823907529b6fb708ab7bb9b19"} err="failed to get container status \"ef00dd2b1de91ee315c1cd8531430983e685c6d823907529b6fb708ab7bb9b19\": rpc error: code = NotFound desc = could not find container \"ef00dd2b1de91ee315c1cd8531430983e685c6d823907529b6fb708ab7bb9b19\": container with ID starting with ef00dd2b1de91ee315c1cd8531430983e685c6d823907529b6fb708ab7bb9b19 not found: ID does not exist"
Jul 28 17:21:24.805688 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.805665    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5668fc7c6b-686nl"]
Jul 28 17:21:24.811103 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:24.811085    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5668fc7c6b-686nl"]
Jul 28 17:21:25.689769 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:25.689740    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34df3c89-aed3-4224-8ba8-dd8c78046650" path="/var/lib/kubelet/pods/34df3c89-aed3-4224-8ba8-dd8c78046650/volumes"
Jul 28 17:21:55.991012 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:55.990976    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:56.087454 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:56.087403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:56.365462 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:56.365429    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:56.427036 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:56.427010    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:56.487986 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:56.487947    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:57.402933 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.402896    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg"]
Jul 28 17:21:57.403318 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.403218    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34df3c89-aed3-4224-8ba8-dd8c78046650" containerName="console"
Jul 28 17:21:57.403318 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.403229    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="34df3c89-aed3-4224-8ba8-dd8c78046650" containerName="console"
Jul 28 17:21:57.403318 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.403301    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="34df3c89-aed3-4224-8ba8-dd8c78046650" containerName="console"
Jul 28 17:21:57.405420 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.405400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg"
Jul 28 17:21:57.408049 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.408033    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 17:21:57.408161 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.408115    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p2z2b\""
Jul 28 17:21:57.408223 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.408160    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 17:21:57.415571 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.415547    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg"]
Jul 28 17:21:57.462999 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.462961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1504930-4e3b-4c65-9a43-558ea56af455-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg\" (UID: \"c1504930-4e3b-4c65-9a43-558ea56af455\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg"
Jul 28 17:21:57.463163 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.463019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkgt2\" (UniqueName: \"kubernetes.io/projected/c1504930-4e3b-4c65-9a43-558ea56af455-kube-api-access-jkgt2\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg\" (UID: \"c1504930-4e3b-4c65-9a43-558ea56af455\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg"
Jul 28 17:21:57.463163 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.463100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1504930-4e3b-4c65-9a43-558ea56af455-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg\" (UID: \"c1504930-4e3b-4c65-9a43-558ea56af455\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg"
Jul 28 17:21:57.563662 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.563623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkgt2\" (UniqueName: \"kubernetes.io/projected/c1504930-4e3b-4c65-9a43-558ea56af455-kube-api-access-jkgt2\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg\" (UID: \"c1504930-4e3b-4c65-9a43-558ea56af455\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg"
Jul 28 17:21:57.563857 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.563677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1504930-4e3b-4c65-9a43-558ea56af455-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg\" (UID: \"c1504930-4e3b-4c65-9a43-558ea56af455\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg"
Jul 28 17:21:57.563857 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.563734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1504930-4e3b-4c65-9a43-558ea56af455-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg\" (UID: \"c1504930-4e3b-4c65-9a43-558ea56af455\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg"
Jul 28 17:21:57.564169 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.564152    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1504930-4e3b-4c65-9a43-558ea56af455-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg\" (UID: \"c1504930-4e3b-4c65-9a43-558ea56af455\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg"
Jul 28 17:21:57.564205 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.564173    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1504930-4e3b-4c65-9a43-558ea56af455-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg\" (UID: \"c1504930-4e3b-4c65-9a43-558ea56af455\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg"
Jul 28 17:21:57.572492 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.572473    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkgt2\" (UniqueName: \"kubernetes.io/projected/c1504930-4e3b-4c65-9a43-558ea56af455-kube-api-access-jkgt2\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg\" (UID: \"c1504930-4e3b-4c65-9a43-558ea56af455\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg"
Jul 28 17:21:57.714157 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.714065    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg"
Jul 28 17:21:57.844858 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.844835    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg"]
Jul 28 17:21:57.847313 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:21:57.847286    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1504930_4e3b_4c65_9a43_558ea56af455.slice/crio-99ad135b4050b2f3ddf236c56bd61cc63ff0ee41f1576b6a712f0adf90bd3ed1 WatchSource:0}: Error finding container 99ad135b4050b2f3ddf236c56bd61cc63ff0ee41f1576b6a712f0adf90bd3ed1: Status 404 returned error can't find the container with id 99ad135b4050b2f3ddf236c56bd61cc63ff0ee41f1576b6a712f0adf90bd3ed1
Jul 28 17:21:57.895862 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:21:57.895823    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg" event={"ID":"c1504930-4e3b-4c65-9a43-558ea56af455","Type":"ContainerStarted","Data":"99ad135b4050b2f3ddf236c56bd61cc63ff0ee41f1576b6a712f0adf90bd3ed1"}
Jul 28 17:22:04.011418 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:04.011395    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 17:22:04.924894 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:04.924864    2563 generic.go:356] "Generic (PLEG): container finished" podID="c1504930-4e3b-4c65-9a43-558ea56af455" containerID="99e84ee27cb3e527d26f3bfeb719d8b0c28768b127e7ef17ad2fa464c254642d" exitCode=0
Jul 28 17:22:04.925071 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:04.924932    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg" event={"ID":"c1504930-4e3b-4c65-9a43-558ea56af455","Type":"ContainerDied","Data":"99e84ee27cb3e527d26f3bfeb719d8b0c28768b127e7ef17ad2fa464c254642d"}
Jul 28 17:22:04.925868 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:04.925852    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:22:06.935271 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:06.935179    2563 generic.go:356] "Generic (PLEG): container finished" podID="c1504930-4e3b-4c65-9a43-558ea56af455" containerID="d5d2a2ca168739dbada9a85db5ae1c8bb35046781ec908b1b9b6fbce9689bdf8" exitCode=0
Jul 28 17:22:06.935271 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:06.935230    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg" event={"ID":"c1504930-4e3b-4c65-9a43-558ea56af455","Type":"ContainerDied","Data":"d5d2a2ca168739dbada9a85db5ae1c8bb35046781ec908b1b9b6fbce9689bdf8"}
Jul 28 17:22:13.965530 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:13.965496    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg" event={"ID":"c1504930-4e3b-4c65-9a43-558ea56af455","Type":"ContainerStarted","Data":"87de735683ff90fd7ca1357b87c234a3ae6c1f5c01ee29ef6ebe25cf3da9588e"}
Jul 28 17:22:13.983845 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:13.983777    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg" podStartSLOduration=2.232996933 podStartE2EDuration="16.983759422s" totalImagesPullingTime="14.750762489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:21:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:13.983275665 +0000 UTC m=+310.815506912" watchObservedRunningTime="2026-07-28 17:22:13.983759422 +0000 UTC m=+310.815990671"
Jul 28 17:22:14.971486 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:14.971452    2563 generic.go:356] "Generic (PLEG): container finished" podID="c1504930-4e3b-4c65-9a43-558ea56af455" containerID="87de735683ff90fd7ca1357b87c234a3ae6c1f5c01ee29ef6ebe25cf3da9588e" exitCode=0
Jul 28 17:22:14.971916 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:14.971534    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg" event={"ID":"c1504930-4e3b-4c65-9a43-558ea56af455","Type":"ContainerDied","Data":"87de735683ff90fd7ca1357b87c234a3ae6c1f5c01ee29ef6ebe25cf3da9588e"}
Jul 28 17:22:16.102168 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:16.102142    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg"
Jul 28 17:22:16.227604 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:16.227530    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkgt2\" (UniqueName: \"kubernetes.io/projected/c1504930-4e3b-4c65-9a43-558ea56af455-kube-api-access-jkgt2\") pod \"c1504930-4e3b-4c65-9a43-558ea56af455\" (UID: \"c1504930-4e3b-4c65-9a43-558ea56af455\") "
Jul 28 17:22:16.227749 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:16.227617    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1504930-4e3b-4c65-9a43-558ea56af455-bundle\") pod \"c1504930-4e3b-4c65-9a43-558ea56af455\" (UID: \"c1504930-4e3b-4c65-9a43-558ea56af455\") "
Jul 28 17:22:16.227749 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:16.227648    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1504930-4e3b-4c65-9a43-558ea56af455-util\") pod \"c1504930-4e3b-4c65-9a43-558ea56af455\" (UID: \"c1504930-4e3b-4c65-9a43-558ea56af455\") "
Jul 28 17:22:16.228334 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:16.228249    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1504930-4e3b-4c65-9a43-558ea56af455-bundle" (OuterVolumeSpecName: "bundle") pod "c1504930-4e3b-4c65-9a43-558ea56af455" (UID: "c1504930-4e3b-4c65-9a43-558ea56af455"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:22:16.229890 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:16.229862    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1504930-4e3b-4c65-9a43-558ea56af455-kube-api-access-jkgt2" (OuterVolumeSpecName: "kube-api-access-jkgt2") pod "c1504930-4e3b-4c65-9a43-558ea56af455" (UID: "c1504930-4e3b-4c65-9a43-558ea56af455"). InnerVolumeSpecName "kube-api-access-jkgt2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:22:16.231994 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:16.231967    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1504930-4e3b-4c65-9a43-558ea56af455-util" (OuterVolumeSpecName: "util") pod "c1504930-4e3b-4c65-9a43-558ea56af455" (UID: "c1504930-4e3b-4c65-9a43-558ea56af455"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:22:16.328324 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:16.328290    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1504930-4e3b-4c65-9a43-558ea56af455-util\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:22:16.328324 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:16.328318    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkgt2\" (UniqueName: \"kubernetes.io/projected/c1504930-4e3b-4c65-9a43-558ea56af455-kube-api-access-jkgt2\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:22:16.328324 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:16.328329    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1504930-4e3b-4c65-9a43-558ea56af455-bundle\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:22:16.980699 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:16.980672    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg"
Jul 28 17:22:16.980897 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:16.980701    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b568hvg" event={"ID":"c1504930-4e3b-4c65-9a43-558ea56af455","Type":"ContainerDied","Data":"99ad135b4050b2f3ddf236c56bd61cc63ff0ee41f1576b6a712f0adf90bd3ed1"}
Jul 28 17:22:16.980897 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:16.980750    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99ad135b4050b2f3ddf236c56bd61cc63ff0ee41f1576b6a712f0adf90bd3ed1"
Jul 28 17:22:19.029995 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:19.029960    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:22:20.310135 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.310101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:22:20.410146 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.410113    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg"]
Jul 28 17:22:20.410402 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.410391    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1504930-4e3b-4c65-9a43-558ea56af455" containerName="pull"
Jul 28 17:22:20.410446 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.410404    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1504930-4e3b-4c65-9a43-558ea56af455" containerName="pull"
Jul 28 17:22:20.410446 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.410417    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1504930-4e3b-4c65-9a43-558ea56af455" containerName="extract"
Jul 28 17:22:20.410446 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.410423    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1504930-4e3b-4c65-9a43-558ea56af455" containerName="extract"
Jul 28 17:22:20.410446 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.410436    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1504930-4e3b-4c65-9a43-558ea56af455" containerName="util"
Jul 28 17:22:20.410446 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.410441    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1504930-4e3b-4c65-9a43-558ea56af455" containerName="util"
Jul 28 17:22:20.410589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.410482    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1504930-4e3b-4c65-9a43-558ea56af455" containerName="extract"
Jul 28 17:22:20.415352 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.415333    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg"
Jul 28 17:22:20.417916 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.417891    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 28 17:22:20.418004 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.417956    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-tcdft\""
Jul 28 17:22:20.418004 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.417967    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 28 17:22:20.418199 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.418187    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 28 17:22:20.432741 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.432722    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg"]
Jul 28 17:22:20.562841 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.562707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znvls\" (UniqueName: \"kubernetes.io/projected/4e0eb3fc-9daa-40c0-bf92-f244826720d4-kube-api-access-znvls\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg\" (UID: \"4e0eb3fc-9daa-40c0-bf92-f244826720d4\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg"
Jul 28 17:22:20.562996 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.562866    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/4e0eb3fc-9daa-40c0-bf92-f244826720d4-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg\" (UID: \"4e0eb3fc-9daa-40c0-bf92-f244826720d4\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg"
Jul 28 17:22:20.663568 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.663534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/4e0eb3fc-9daa-40c0-bf92-f244826720d4-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg\" (UID: \"4e0eb3fc-9daa-40c0-bf92-f244826720d4\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg"
Jul 28 17:22:20.663718 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.663577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znvls\" (UniqueName: \"kubernetes.io/projected/4e0eb3fc-9daa-40c0-bf92-f244826720d4-kube-api-access-znvls\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg\" (UID: \"4e0eb3fc-9daa-40c0-bf92-f244826720d4\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg"
Jul 28 17:22:20.666082 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.666052    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/4e0eb3fc-9daa-40c0-bf92-f244826720d4-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg\" (UID: \"4e0eb3fc-9daa-40c0-bf92-f244826720d4\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg"
Jul 28 17:22:20.672479 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.672456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znvls\" (UniqueName: \"kubernetes.io/projected/4e0eb3fc-9daa-40c0-bf92-f244826720d4-kube-api-access-znvls\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg\" (UID: \"4e0eb3fc-9daa-40c0-bf92-f244826720d4\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg"
Jul 28 17:22:20.724865 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.724832    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg"
Jul 28 17:22:20.861763 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.861684    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg"]
Jul 28 17:22:20.865711 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:22:20.865681    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e0eb3fc_9daa_40c0_bf92_f244826720d4.slice/crio-ed7c705aee48293787ccaa810ff229832997ecaedf45d4f5606fcab1b8eef8e1 WatchSource:0}: Error finding container ed7c705aee48293787ccaa810ff229832997ecaedf45d4f5606fcab1b8eef8e1: Status 404 returned error can't find the container with id ed7c705aee48293787ccaa810ff229832997ecaedf45d4f5606fcab1b8eef8e1
Jul 28 17:22:20.998316 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:20.998281    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg" event={"ID":"4e0eb3fc-9daa-40c0-bf92-f244826720d4","Type":"ContainerStarted","Data":"ed7c705aee48293787ccaa810ff229832997ecaedf45d4f5606fcab1b8eef8e1"}
Jul 28 17:22:23.907382 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:23.907342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:22:24.012984 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.012954    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg" event={"ID":"4e0eb3fc-9daa-40c0-bf92-f244826720d4","Type":"ContainerStarted","Data":"684af8aa3568f3d3553f2aab057dc58a352cfbd4b3ea4aebd2bd8e96fb2d18b4"}
Jul 28 17:22:24.013153 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.013061    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg"
Jul 28 17:22:24.052959 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.052911    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg" podStartSLOduration=1.558412666 podStartE2EDuration="4.052896482s" totalImagesPullingTime="2.494483816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:24.051014943 +0000 UTC m=+320.883246189" watchObservedRunningTime="2026-07-28 17:22:24.052896482 +0000 UTC m=+320.885127729"
Jul 28 17:22:24.283000 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.282967    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:22:24.286596 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.286572    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-46x6m"]
Jul 28 17:22:24.288997 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.288980    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-46x6m"
Jul 28 17:22:24.291716 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.291691    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 28 17:22:24.291829 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.291814    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 28 17:22:24.292077 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.292064    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-pgkgb\""
Jul 28 17:22:24.306587 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.306564    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-46x6m"]
Jul 28 17:22:24.398432 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.398388    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27l5b\" (UniqueName: \"kubernetes.io/projected/8d2804b5-b4a9-4b13-9383-1e796595f06c-kube-api-access-27l5b\") pod \"keda-operator-77f648d694-46x6m\" (UID: \"8d2804b5-b4a9-4b13-9383-1e796595f06c\") " pod="openshift-keda/keda-operator-77f648d694-46x6m"
Jul 28 17:22:24.398432 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.398440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/8d2804b5-b4a9-4b13-9383-1e796595f06c-cabundle0\") pod \"keda-operator-77f648d694-46x6m\" (UID: \"8d2804b5-b4a9-4b13-9383-1e796595f06c\") " pod="openshift-keda/keda-operator-77f648d694-46x6m"
Jul 28 17:22:24.398641 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.398463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8d2804b5-b4a9-4b13-9383-1e796595f06c-certificates\") pod \"keda-operator-77f648d694-46x6m\" (UID: \"8d2804b5-b4a9-4b13-9383-1e796595f06c\") " pod="openshift-keda/keda-operator-77f648d694-46x6m"
Jul 28 17:22:24.499894 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.499856    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/8d2804b5-b4a9-4b13-9383-1e796595f06c-cabundle0\") pod \"keda-operator-77f648d694-46x6m\" (UID: \"8d2804b5-b4a9-4b13-9383-1e796595f06c\") " pod="openshift-keda/keda-operator-77f648d694-46x6m"
Jul 28 17:22:24.499894 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.499891    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8d2804b5-b4a9-4b13-9383-1e796595f06c-certificates\") pod \"keda-operator-77f648d694-46x6m\" (UID: \"8d2804b5-b4a9-4b13-9383-1e796595f06c\") " pod="openshift-keda/keda-operator-77f648d694-46x6m"
Jul 28 17:22:24.500114 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.499988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27l5b\" (UniqueName: \"kubernetes.io/projected/8d2804b5-b4a9-4b13-9383-1e796595f06c-kube-api-access-27l5b\") pod \"keda-operator-77f648d694-46x6m\" (UID: \"8d2804b5-b4a9-4b13-9383-1e796595f06c\") " pod="openshift-keda/keda-operator-77f648d694-46x6m"
Jul 28 17:22:24.500114 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:22:24.500090    2563 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Jul 28 17:22:24.500114 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:22:24.500111    2563 secret.go:281] references non-existent secret key: ca.crt
Jul 28 17:22:24.500114 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:22:24.500118    2563 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 28 17:22:24.500253 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:22:24.500130    2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-46x6m: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 28 17:22:24.500253 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:22:24.500191    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d2804b5-b4a9-4b13-9383-1e796595f06c-certificates podName:8d2804b5-b4a9-4b13-9383-1e796595f06c nodeName:}" failed. No retries permitted until 2026-07-28 17:22:25.00016543 +0000 UTC m=+321.832396656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/8d2804b5-b4a9-4b13-9383-1e796595f06c-certificates") pod "keda-operator-77f648d694-46x6m" (UID: "8d2804b5-b4a9-4b13-9383-1e796595f06c") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 28 17:22:24.500564 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.500546    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/8d2804b5-b4a9-4b13-9383-1e796595f06c-cabundle0\") pod \"keda-operator-77f648d694-46x6m\" (UID: \"8d2804b5-b4a9-4b13-9383-1e796595f06c\") " pod="openshift-keda/keda-operator-77f648d694-46x6m"
Jul 28 17:22:24.511729 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.511699    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27l5b\" (UniqueName: \"kubernetes.io/projected/8d2804b5-b4a9-4b13-9383-1e796595f06c-kube-api-access-27l5b\") pod \"keda-operator-77f648d694-46x6m\" (UID: \"8d2804b5-b4a9-4b13-9383-1e796595f06c\") " pod="openshift-keda/keda-operator-77f648d694-46x6m"
Jul 28 17:22:24.566382 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:24.566293    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:22:25.004419 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.004341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8d2804b5-b4a9-4b13-9383-1e796595f06c-certificates\") pod \"keda-operator-77f648d694-46x6m\" (UID: \"8d2804b5-b4a9-4b13-9383-1e796595f06c\") " pod="openshift-keda/keda-operator-77f648d694-46x6m"
Jul 28 17:22:25.004756 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:22:25.004483    2563 secret.go:281] references non-existent secret key: ca.crt
Jul 28 17:22:25.004756 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:22:25.004504    2563 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 28 17:22:25.004756 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:22:25.004513    2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-46x6m: references non-existent secret key: ca.crt
Jul 28 17:22:25.004756 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:22:25.004563    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d2804b5-b4a9-4b13-9383-1e796595f06c-certificates podName:8d2804b5-b4a9-4b13-9383-1e796595f06c nodeName:}" failed. No retries permitted until 2026-07-28 17:22:26.004549603 +0000 UTC m=+322.836780829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/8d2804b5-b4a9-4b13-9383-1e796595f06c-certificates") pod "keda-operator-77f648d694-46x6m" (UID: "8d2804b5-b4a9-4b13-9383-1e796595f06c") : references non-existent secret key: ca.crt
Jul 28 17:22:25.069443 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.069397    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:22:25.132316 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.132281    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t"]
Jul 28 17:22:25.134695 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.134675    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t"
Jul 28 17:22:25.137565 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.137537    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 28 17:22:25.150371 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.150351    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t"]
Jul 28 17:22:25.291562 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.291518    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:22:25.307814 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.307767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrdr8\" (UniqueName: \"kubernetes.io/projected/a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652-kube-api-access-lrdr8\") pod \"keda-metrics-apiserver-55557df8c-hvv4t\" (UID: \"a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t"
Jul 28 17:22:25.307971 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.307867    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-hvv4t\" (UID: \"a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t"
Jul 28 17:22:25.307971 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.307906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652-certificates\") pod \"keda-metrics-apiserver-55557df8c-hvv4t\" (UID: \"a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t"
Jul 28 17:22:25.399059 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.399025    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:22:25.399668 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.399641    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-cds6s"]
Jul 28 17:22:25.402327 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.402308    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-cds6s"
Jul 28 17:22:25.407193 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.407171    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 28 17:22:25.408553 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.408376    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrdr8\" (UniqueName: \"kubernetes.io/projected/a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652-kube-api-access-lrdr8\") pod \"keda-metrics-apiserver-55557df8c-hvv4t\" (UID: \"a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t"
Jul 28 17:22:25.408875 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.408848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-hvv4t\" (UID: \"a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t"
Jul 28 17:22:25.408991 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.408939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652-certificates\") pod \"keda-metrics-apiserver-55557df8c-hvv4t\" (UID: \"a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t"
Jul 28 17:22:25.409136 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.409115    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-hvv4t\" (UID: \"a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t"
Jul 28 17:22:25.411802 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.411765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652-certificates\") pod \"keda-metrics-apiserver-55557df8c-hvv4t\" (UID: \"a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t"
Jul 28 17:22:25.441384 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.441355    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrdr8\" (UniqueName: \"kubernetes.io/projected/a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652-kube-api-access-lrdr8\") pod \"keda-metrics-apiserver-55557df8c-hvv4t\" (UID: \"a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t"
Jul 28 17:22:25.444151 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.444120    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-cds6s"]
Jul 28 17:22:25.448127 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.448099    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t"
Jul 28 17:22:25.482601 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.482564    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:22:25.510063 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.510031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6962943c-7543-4d74-a328-c3aca03270a5-certificates\") pod \"keda-admission-56f9798bb4-cds6s\" (UID: \"6962943c-7543-4d74-a328-c3aca03270a5\") " pod="openshift-keda/keda-admission-56f9798bb4-cds6s"
Jul 28 17:22:25.510216 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.510162    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5qk9\" (UniqueName: \"kubernetes.io/projected/6962943c-7543-4d74-a328-c3aca03270a5-kube-api-access-x5qk9\") pod \"keda-admission-56f9798bb4-cds6s\" (UID: \"6962943c-7543-4d74-a328-c3aca03270a5\") " pod="openshift-keda/keda-admission-56f9798bb4-cds6s"
Jul 28 17:22:25.585629 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.585490    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t"]
Jul 28 17:22:25.588689 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:22:25.588620    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3a5cd92_f5ab_4e76_8fdf_1f3ad6f7e652.slice/crio-0fe105adeed6e9c0de1ec6f79270b441dd8ce5497c732a04343edba2a24c5a0c WatchSource:0}: Error finding container 0fe105adeed6e9c0de1ec6f79270b441dd8ce5497c732a04343edba2a24c5a0c: Status 404 returned error can't find the container with id 0fe105adeed6e9c0de1ec6f79270b441dd8ce5497c732a04343edba2a24c5a0c
Jul 28 17:22:25.611051 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.611021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6962943c-7543-4d74-a328-c3aca03270a5-certificates\") pod \"keda-admission-56f9798bb4-cds6s\" (UID: \"6962943c-7543-4d74-a328-c3aca03270a5\") " pod="openshift-keda/keda-admission-56f9798bb4-cds6s"
Jul 28 17:22:25.611160 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.611142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5qk9\" (UniqueName: \"kubernetes.io/projected/6962943c-7543-4d74-a328-c3aca03270a5-kube-api-access-x5qk9\") pod \"keda-admission-56f9798bb4-cds6s\" (UID: \"6962943c-7543-4d74-a328-c3aca03270a5\") " pod="openshift-keda/keda-admission-56f9798bb4-cds6s"
Jul 28 17:22:25.611211 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:22:25.611148    2563 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
Jul 28 17:22:25.611211 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:22:25.611200    2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-56f9798bb4-cds6s: secret "keda-admission-webhooks-certs" not found
Jul 28 17:22:25.611275 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:22:25.611260    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6962943c-7543-4d74-a328-c3aca03270a5-certificates podName:6962943c-7543-4d74-a328-c3aca03270a5 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:26.111240289 +0000 UTC m=+322.943471516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/6962943c-7543-4d74-a328-c3aca03270a5-certificates") pod "keda-admission-56f9798bb4-cds6s" (UID: "6962943c-7543-4d74-a328-c3aca03270a5") : secret "keda-admission-webhooks-certs" not found
Jul 28 17:22:25.622571 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.622539    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5qk9\" (UniqueName: \"kubernetes.io/projected/6962943c-7543-4d74-a328-c3aca03270a5-kube-api-access-x5qk9\") pod \"keda-admission-56f9798bb4-cds6s\" (UID: \"6962943c-7543-4d74-a328-c3aca03270a5\") " pod="openshift-keda/keda-admission-56f9798bb4-cds6s"
Jul 28 17:22:25.861320 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.861231    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:22:25.964392 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:25.964355    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:22:26.015449 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:26.015419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8d2804b5-b4a9-4b13-9383-1e796595f06c-certificates\") pod \"keda-operator-77f648d694-46x6m\" (UID: \"8d2804b5-b4a9-4b13-9383-1e796595f06c\") " pod="openshift-keda/keda-operator-77f648d694-46x6m"
Jul 28 17:22:26.018032 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:26.018004    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8d2804b5-b4a9-4b13-9383-1e796595f06c-certificates\") pod \"keda-operator-77f648d694-46x6m\" (UID: \"8d2804b5-b4a9-4b13-9383-1e796595f06c\") " pod="openshift-keda/keda-operator-77f648d694-46x6m"
Jul 28 17:22:26.022352 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:26.022320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t" event={"ID":"a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652","Type":"ContainerStarted","Data":"0fe105adeed6e9c0de1ec6f79270b441dd8ce5497c732a04343edba2a24c5a0c"}
Jul 28 17:22:26.088287 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:26.088249    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:22:26.099221 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:26.099204    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-46x6m"
Jul 28 17:22:26.116475 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:26.116419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6962943c-7543-4d74-a328-c3aca03270a5-certificates\") pod \"keda-admission-56f9798bb4-cds6s\" (UID: \"6962943c-7543-4d74-a328-c3aca03270a5\") " pod="openshift-keda/keda-admission-56f9798bb4-cds6s"
Jul 28 17:22:26.119243 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:26.119219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6962943c-7543-4d74-a328-c3aca03270a5-certificates\") pod \"keda-admission-56f9798bb4-cds6s\" (UID: \"6962943c-7543-4d74-a328-c3aca03270a5\") " pod="openshift-keda/keda-admission-56f9798bb4-cds6s"
Jul 28 17:22:26.193661 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:26.193624    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:22:26.268988 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:26.268965    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-46x6m"]
Jul 28 17:22:26.272074 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:22:26.272044    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d2804b5_b4a9_4b13_9383_1e796595f06c.slice/crio-d459cc4220f083beee92761a018b81e3de1d94d0f25c0ca07f768d51ad201243 WatchSource:0}: Error finding container d459cc4220f083beee92761a018b81e3de1d94d0f25c0ca07f768d51ad201243: Status 404 returned error can't find the container with id d459cc4220f083beee92761a018b81e3de1d94d0f25c0ca07f768d51ad201243
Jul 28 17:22:26.274951 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:26.274921    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:22:26.312632 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:26.312599    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-cds6s"
Jul 28 17:22:26.470603 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:26.470570    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-cds6s"]
Jul 28 17:22:26.472740 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:22:26.472699    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6962943c_7543_4d74_a328_c3aca03270a5.slice/crio-93cb252a8c90d843dc6f9c99567bee6133327ce8b2d2c8c9d44b24413fc131bf WatchSource:0}: Error finding container 93cb252a8c90d843dc6f9c99567bee6133327ce8b2d2c8c9d44b24413fc131bf: Status 404 returned error can't find the container with id 93cb252a8c90d843dc6f9c99567bee6133327ce8b2d2c8c9d44b24413fc131bf
Jul 28 17:22:27.033329 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:27.033286    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-46x6m" event={"ID":"8d2804b5-b4a9-4b13-9383-1e796595f06c","Type":"ContainerStarted","Data":"d459cc4220f083beee92761a018b81e3de1d94d0f25c0ca07f768d51ad201243"}
Jul 28 17:22:27.034723 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:27.034692    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-cds6s" event={"ID":"6962943c-7543-4d74-a328-c3aca03270a5","Type":"ContainerStarted","Data":"93cb252a8c90d843dc6f9c99567bee6133327ce8b2d2c8c9d44b24413fc131bf"}
Jul 28 17:22:29.045377 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:29.045339    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-cds6s" event={"ID":"6962943c-7543-4d74-a328-c3aca03270a5","Type":"ContainerStarted","Data":"b3ca372455f7ada308ae29cdd67303ca9c5b468e7876ec6936e8b02c49fcdb5c"}
Jul 28 17:22:29.045869 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:29.045452    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-cds6s"
Jul 28 17:22:29.046916 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:29.046893    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t" event={"ID":"a3a5cd92-f5ab-4e76-8fdf-1f3ad6f7e652","Type":"ContainerStarted","Data":"214b3f8f21a8bdb351a6e28f505616d26b648b04bd2375fbe0a8fede35212d24"}
Jul 28 17:22:29.047034 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:29.047022    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t"
Jul 28 17:22:29.064742 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:29.064682    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-cds6s" podStartSLOduration=2.159150271 podStartE2EDuration="4.064664592s" totalImagesPullingTime="1.905514321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:29.063431931 +0000 UTC m=+325.895663180" watchObservedRunningTime="2026-07-28 17:22:29.064664592 +0000 UTC m=+325.896895841"
Jul 28 17:22:29.083247 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:29.083199    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t" podStartSLOduration=1.289077903 podStartE2EDuration="4.083181736s" totalImagesPullingTime="2.794103833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:29.081691025 +0000 UTC m=+325.913922274" watchObservedRunningTime="2026-07-28 17:22:29.083181736 +0000 UTC m=+325.915412986"
Jul 28 17:22:31.058999 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:31.058963    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-46x6m" event={"ID":"8d2804b5-b4a9-4b13-9383-1e796595f06c","Type":"ContainerStarted","Data":"5f7e5ac112f6c18307e33f632e5daf264b9651914eeb152f974c7e97ff2d9f28"}
Jul 28 17:22:31.059389 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:31.059036    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-46x6m"
Jul 28 17:22:31.077282 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:31.077241    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-46x6m" podStartSLOduration=2.6852915619999997 podStartE2EDuration="7.07722765s" totalImagesPullingTime="4.391936088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:31.076740219 +0000 UTC m=+327.908971466" watchObservedRunningTime="2026-07-28 17:22:31.07722765 +0000 UTC m=+327.909458898"
Jul 28 17:22:40.058393 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:40.058366    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-hvv4t"
Jul 28 17:22:45.019949 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:45.019920    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-fn4pg"
Jul 28 17:22:50.055924 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:50.055895    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-cds6s"
Jul 28 17:22:52.067410 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:22:52.067380    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-46x6m"
Jul 28 17:23:31.652020 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:31.651982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:31.749708 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:31.749676    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:41.252511 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:41.252478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:42.703494 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.703463    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:42.762671 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.762640    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"]
Jul 28 17:23:42.765099 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.765080    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"
Jul 28 17:23:42.768300 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.768267    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 28 17:23:42.768300 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.768285    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Jul 28 17:23:42.768300 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.768291    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-9kfhh\""
Jul 28 17:23:42.768513 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.768308    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 28 17:23:42.772971 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.772949    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-9289r"]
Jul 28 17:23:42.775901 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.775880    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84fc959947-9289r"
Jul 28 17:23:42.776712 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.776686    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"]
Jul 28 17:23:42.778506 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.778217    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jul 28 17:23:42.778506 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.778442    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-lgnm2\""
Jul 28 17:23:42.779872 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.779848    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:42.789185 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.789162    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-9289r"]
Jul 28 17:23:42.829829 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.829801    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vvfq\" (UniqueName: \"kubernetes.io/projected/39868e76-710b-4f50-8e8e-81c84a4c678a-kube-api-access-7vvfq\") pod \"kserve-controller-manager-85d8b8ddfc-s5t7f\" (UID: \"39868e76-710b-4f50-8e8e-81c84a4c678a\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"
Jul 28 17:23:42.829829 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.829829    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f2c4\" (UniqueName: \"kubernetes.io/projected/83adef5b-3b04-4b8a-87ca-f964b7cf0af9-kube-api-access-2f2c4\") pod \"llmisvc-controller-manager-84fc959947-9289r\" (UID: \"83adef5b-3b04-4b8a-87ca-f964b7cf0af9\") " pod="kserve/llmisvc-controller-manager-84fc959947-9289r"
Jul 28 17:23:42.830011 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.829886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83adef5b-3b04-4b8a-87ca-f964b7cf0af9-cert\") pod \"llmisvc-controller-manager-84fc959947-9289r\" (UID: \"83adef5b-3b04-4b8a-87ca-f964b7cf0af9\") " pod="kserve/llmisvc-controller-manager-84fc959947-9289r"
Jul 28 17:23:42.830011 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.829930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39868e76-710b-4f50-8e8e-81c84a4c678a-cert\") pod \"kserve-controller-manager-85d8b8ddfc-s5t7f\" (UID: \"39868e76-710b-4f50-8e8e-81c84a4c678a\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"
Jul 28 17:23:42.859102 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.859078    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:42.930268 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.930236    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39868e76-710b-4f50-8e8e-81c84a4c678a-cert\") pod \"kserve-controller-manager-85d8b8ddfc-s5t7f\" (UID: \"39868e76-710b-4f50-8e8e-81c84a4c678a\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"
Jul 28 17:23:42.930268 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.930274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vvfq\" (UniqueName: \"kubernetes.io/projected/39868e76-710b-4f50-8e8e-81c84a4c678a-kube-api-access-7vvfq\") pod \"kserve-controller-manager-85d8b8ddfc-s5t7f\" (UID: \"39868e76-710b-4f50-8e8e-81c84a4c678a\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"
Jul 28 17:23:42.930495 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.930292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f2c4\" (UniqueName: \"kubernetes.io/projected/83adef5b-3b04-4b8a-87ca-f964b7cf0af9-kube-api-access-2f2c4\") pod \"llmisvc-controller-manager-84fc959947-9289r\" (UID: \"83adef5b-3b04-4b8a-87ca-f964b7cf0af9\") " pod="kserve/llmisvc-controller-manager-84fc959947-9289r"
Jul 28 17:23:42.930495 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.930343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83adef5b-3b04-4b8a-87ca-f964b7cf0af9-cert\") pod \"llmisvc-controller-manager-84fc959947-9289r\" (UID: \"83adef5b-3b04-4b8a-87ca-f964b7cf0af9\") " pod="kserve/llmisvc-controller-manager-84fc959947-9289r"
Jul 28 17:23:42.930495 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:23:42.930433    2563 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 28 17:23:42.930495 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:23:42.930499    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83adef5b-3b04-4b8a-87ca-f964b7cf0af9-cert podName:83adef5b-3b04-4b8a-87ca-f964b7cf0af9 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:43.43048125 +0000 UTC m=+400.262712476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/83adef5b-3b04-4b8a-87ca-f964b7cf0af9-cert") pod "llmisvc-controller-manager-84fc959947-9289r" (UID: "83adef5b-3b04-4b8a-87ca-f964b7cf0af9") : secret "llmisvc-webhook-server-cert" not found
Jul 28 17:23:42.932782 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.932753    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39868e76-710b-4f50-8e8e-81c84a4c678a-cert\") pod \"kserve-controller-manager-85d8b8ddfc-s5t7f\" (UID: \"39868e76-710b-4f50-8e8e-81c84a4c678a\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"
Jul 28 17:23:42.940104 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.940081    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vvfq\" (UniqueName: \"kubernetes.io/projected/39868e76-710b-4f50-8e8e-81c84a4c678a-kube-api-access-7vvfq\") pod \"kserve-controller-manager-85d8b8ddfc-s5t7f\" (UID: \"39868e76-710b-4f50-8e8e-81c84a4c678a\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"
Jul 28 17:23:42.946250 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.946231    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f2c4\" (UniqueName: \"kubernetes.io/projected/83adef5b-3b04-4b8a-87ca-f964b7cf0af9-kube-api-access-2f2c4\") pod \"llmisvc-controller-manager-84fc959947-9289r\" (UID: \"83adef5b-3b04-4b8a-87ca-f964b7cf0af9\") " pod="kserve/llmisvc-controller-manager-84fc959947-9289r"
Jul 28 17:23:42.961809 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:42.961731    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:43.059537 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:43.059508    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:43.076384 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:43.076359    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"
Jul 28 17:23:43.204185 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:43.204161    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"]
Jul 28 17:23:43.206621 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:23:43.206597    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39868e76_710b_4f50_8e8e_81c84a4c678a.slice/crio-2fece57ab485bcfc3f50ccaf473abfc08d5569cd963d2ecfa96f411f3427d762 WatchSource:0}: Error finding container 2fece57ab485bcfc3f50ccaf473abfc08d5569cd963d2ecfa96f411f3427d762: Status 404 returned error can't find the container with id 2fece57ab485bcfc3f50ccaf473abfc08d5569cd963d2ecfa96f411f3427d762
Jul 28 17:23:43.308228 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:43.308189    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:43.363527 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:43.363498    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f" event={"ID":"39868e76-710b-4f50-8e8e-81c84a4c678a","Type":"ContainerStarted","Data":"2fece57ab485bcfc3f50ccaf473abfc08d5569cd963d2ecfa96f411f3427d762"}
Jul 28 17:23:43.405709 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:43.405683    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:43.434974 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:43.434945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83adef5b-3b04-4b8a-87ca-f964b7cf0af9-cert\") pod \"llmisvc-controller-manager-84fc959947-9289r\" (UID: \"83adef5b-3b04-4b8a-87ca-f964b7cf0af9\") " pod="kserve/llmisvc-controller-manager-84fc959947-9289r"
Jul 28 17:23:43.437451 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:43.437435    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83adef5b-3b04-4b8a-87ca-f964b7cf0af9-cert\") pod \"llmisvc-controller-manager-84fc959947-9289r\" (UID: \"83adef5b-3b04-4b8a-87ca-f964b7cf0af9\") " pod="kserve/llmisvc-controller-manager-84fc959947-9289r"
Jul 28 17:23:43.687821 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:43.687718    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84fc959947-9289r"
Jul 28 17:23:43.854556 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:43.854529    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-9289r"]
Jul 28 17:23:43.857163 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:23:43.857136    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod83adef5b_3b04_4b8a_87ca_f964b7cf0af9.slice/crio-da37e01eb4a2e794f9551c7a88928f8f5baf467b1e71ecf5ba3ee3ce35866d23 WatchSource:0}: Error finding container da37e01eb4a2e794f9551c7a88928f8f5baf467b1e71ecf5ba3ee3ce35866d23: Status 404 returned error can't find the container with id da37e01eb4a2e794f9551c7a88928f8f5baf467b1e71ecf5ba3ee3ce35866d23
Jul 28 17:23:44.369594 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:44.369554    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84fc959947-9289r" event={"ID":"83adef5b-3b04-4b8a-87ca-f964b7cf0af9","Type":"ContainerStarted","Data":"da37e01eb4a2e794f9551c7a88928f8f5baf467b1e71ecf5ba3ee3ce35866d23"}
Jul 28 17:23:46.383513 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:46.383474    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f" event={"ID":"39868e76-710b-4f50-8e8e-81c84a4c678a","Type":"ContainerStarted","Data":"bb6da3e3f9cd57bb216e276a7ba3bbb4317c0686b947e1717af00ed198cc4393"}
Jul 28 17:23:46.384241 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:46.383566    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"
Jul 28 17:23:46.404348 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:46.404298    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f" podStartSLOduration=1.873196074 podStartE2EDuration="4.404280741s" totalImagesPullingTime="2.531084667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:46.402990411 +0000 UTC m=+403.235221659" watchObservedRunningTime="2026-07-28 17:23:46.404280741 +0000 UTC m=+403.236511992"
Jul 28 17:23:48.394670 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:48.394634    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84fc959947-9289r" event={"ID":"83adef5b-3b04-4b8a-87ca-f964b7cf0af9","Type":"ContainerStarted","Data":"a786f7542dd623674086a327ea0dd57ae3f431f382245ebd83967c384bb43eef"}
Jul 28 17:23:48.395065 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:48.394705    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-84fc959947-9289r"
Jul 28 17:23:48.411637 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:23:48.411592    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-84fc959947-9289r" podStartSLOduration=2.861082321 podStartE2EDuration="6.411577909s" totalImagesPullingTime="3.550495588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:48.410419045 +0000 UTC m=+405.242650294" watchObservedRunningTime="2026-07-28 17:23:48.411577909 +0000 UTC m=+405.243809167"
Jul 28 17:24:17.393187 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:17.393157    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"
Jul 28 17:24:19.401622 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:19.401594    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-84fc959947-9289r"
Jul 28 17:24:27.543069 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.543029    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"]
Jul 28 17:24:27.543522 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.543281    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f" podUID="39868e76-710b-4f50-8e8e-81c84a4c678a" containerName="manager" containerID="cri-o://bb6da3e3f9cd57bb216e276a7ba3bbb4317c0686b947e1717af00ed198cc4393" gracePeriod=10
Jul 28 17:24:27.566329 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.566305    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-85d8b8ddfc-pt46g"]
Jul 28 17:24:27.569050 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.569034    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-85d8b8ddfc-pt46g"
Jul 28 17:24:27.579635 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.579614    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-85d8b8ddfc-pt46g"]
Jul 28 17:24:27.603090 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.603065    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f6fd9fa-24d2-45bf-92a8-af7e334af205-cert\") pod \"kserve-controller-manager-85d8b8ddfc-pt46g\" (UID: \"0f6fd9fa-24d2-45bf-92a8-af7e334af205\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-pt46g"
Jul 28 17:24:27.603226 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.603126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf57z\" (UniqueName: \"kubernetes.io/projected/0f6fd9fa-24d2-45bf-92a8-af7e334af205-kube-api-access-mf57z\") pod \"kserve-controller-manager-85d8b8ddfc-pt46g\" (UID: \"0f6fd9fa-24d2-45bf-92a8-af7e334af205\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-pt46g"
Jul 28 17:24:27.704146 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.704104    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f6fd9fa-24d2-45bf-92a8-af7e334af205-cert\") pod \"kserve-controller-manager-85d8b8ddfc-pt46g\" (UID: \"0f6fd9fa-24d2-45bf-92a8-af7e334af205\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-pt46g"
Jul 28 17:24:27.704311 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.704186    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf57z\" (UniqueName: \"kubernetes.io/projected/0f6fd9fa-24d2-45bf-92a8-af7e334af205-kube-api-access-mf57z\") pod \"kserve-controller-manager-85d8b8ddfc-pt46g\" (UID: \"0f6fd9fa-24d2-45bf-92a8-af7e334af205\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-pt46g"
Jul 28 17:24:27.707008 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.706606    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f6fd9fa-24d2-45bf-92a8-af7e334af205-cert\") pod \"kserve-controller-manager-85d8b8ddfc-pt46g\" (UID: \"0f6fd9fa-24d2-45bf-92a8-af7e334af205\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-pt46g"
Jul 28 17:24:27.715067 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.715034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf57z\" (UniqueName: \"kubernetes.io/projected/0f6fd9fa-24d2-45bf-92a8-af7e334af205-kube-api-access-mf57z\") pod \"kserve-controller-manager-85d8b8ddfc-pt46g\" (UID: \"0f6fd9fa-24d2-45bf-92a8-af7e334af205\") " pod="kserve/kserve-controller-manager-85d8b8ddfc-pt46g"
Jul 28 17:24:27.775892 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.775871    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"
Jul 28 17:24:27.805304 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.805233    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vvfq\" (UniqueName: \"kubernetes.io/projected/39868e76-710b-4f50-8e8e-81c84a4c678a-kube-api-access-7vvfq\") pod \"39868e76-710b-4f50-8e8e-81c84a4c678a\" (UID: \"39868e76-710b-4f50-8e8e-81c84a4c678a\") "
Jul 28 17:24:27.805304 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.805292    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39868e76-710b-4f50-8e8e-81c84a4c678a-cert\") pod \"39868e76-710b-4f50-8e8e-81c84a4c678a\" (UID: \"39868e76-710b-4f50-8e8e-81c84a4c678a\") "
Jul 28 17:24:27.807565 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.807536    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39868e76-710b-4f50-8e8e-81c84a4c678a-kube-api-access-7vvfq" (OuterVolumeSpecName: "kube-api-access-7vvfq") pod "39868e76-710b-4f50-8e8e-81c84a4c678a" (UID: "39868e76-710b-4f50-8e8e-81c84a4c678a"). InnerVolumeSpecName "kube-api-access-7vvfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:24:27.807873 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.807857    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39868e76-710b-4f50-8e8e-81c84a4c678a-cert" (OuterVolumeSpecName: "cert") pod "39868e76-710b-4f50-8e8e-81c84a4c678a" (UID: "39868e76-710b-4f50-8e8e-81c84a4c678a"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:24:27.906064 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.906034    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vvfq\" (UniqueName: \"kubernetes.io/projected/39868e76-710b-4f50-8e8e-81c84a4c678a-kube-api-access-7vvfq\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:24:27.906064 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.906059    2563 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39868e76-710b-4f50-8e8e-81c84a4c678a-cert\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:24:27.922427 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:27.922405    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-85d8b8ddfc-pt46g"
Jul 28 17:24:28.051018 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:28.050992    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-85d8b8ddfc-pt46g"]
Jul 28 17:24:28.053425 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:24:28.053391    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f6fd9fa_24d2_45bf_92a8_af7e334af205.slice/crio-689e03ceeb9c74842c86e836ca6c6dd3a0958d260b01a23b5a25847b28c776f6 WatchSource:0}: Error finding container 689e03ceeb9c74842c86e836ca6c6dd3a0958d260b01a23b5a25847b28c776f6: Status 404 returned error can't find the container with id 689e03ceeb9c74842c86e836ca6c6dd3a0958d260b01a23b5a25847b28c776f6
Jul 28 17:24:28.567037 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:28.567001    2563 generic.go:356] "Generic (PLEG): container finished" podID="39868e76-710b-4f50-8e8e-81c84a4c678a" containerID="bb6da3e3f9cd57bb216e276a7ba3bbb4317c0686b947e1717af00ed198cc4393" exitCode=0
Jul 28 17:24:28.567384 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:28.567057    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"
Jul 28 17:24:28.567384 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:28.567089    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f" event={"ID":"39868e76-710b-4f50-8e8e-81c84a4c678a","Type":"ContainerDied","Data":"bb6da3e3f9cd57bb216e276a7ba3bbb4317c0686b947e1717af00ed198cc4393"}
Jul 28 17:24:28.567384 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:28.567175    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-85d8b8ddfc-s5t7f" event={"ID":"39868e76-710b-4f50-8e8e-81c84a4c678a","Type":"ContainerDied","Data":"2fece57ab485bcfc3f50ccaf473abfc08d5569cd963d2ecfa96f411f3427d762"}
Jul 28 17:24:28.567384 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:28.567206    2563 scope.go:117] "RemoveContainer" containerID="bb6da3e3f9cd57bb216e276a7ba3bbb4317c0686b947e1717af00ed198cc4393"
Jul 28 17:24:28.568727 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:28.568708    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-85d8b8ddfc-pt46g" event={"ID":"0f6fd9fa-24d2-45bf-92a8-af7e334af205","Type":"ContainerStarted","Data":"9862af1a24387587e107b899d821f2135f76c6cf6705e29d21c7105400f62c79"}
Jul 28 17:24:28.568837 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:28.568750    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-85d8b8ddfc-pt46g" event={"ID":"0f6fd9fa-24d2-45bf-92a8-af7e334af205","Type":"ContainerStarted","Data":"689e03ceeb9c74842c86e836ca6c6dd3a0958d260b01a23b5a25847b28c776f6"}
Jul 28 17:24:28.568950 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:28.568932    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-85d8b8ddfc-pt46g"
Jul 28 17:24:28.576589 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:28.576549    2563 scope.go:117] "RemoveContainer" containerID="bb6da3e3f9cd57bb216e276a7ba3bbb4317c0686b947e1717af00ed198cc4393"
Jul 28 17:24:28.576903 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:24:28.576884    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb6da3e3f9cd57bb216e276a7ba3bbb4317c0686b947e1717af00ed198cc4393\": container with ID starting with bb6da3e3f9cd57bb216e276a7ba3bbb4317c0686b947e1717af00ed198cc4393 not found: ID does not exist" containerID="bb6da3e3f9cd57bb216e276a7ba3bbb4317c0686b947e1717af00ed198cc4393"
Jul 28 17:24:28.576981 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:28.576910    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb6da3e3f9cd57bb216e276a7ba3bbb4317c0686b947e1717af00ed198cc4393"} err="failed to get container status \"bb6da3e3f9cd57bb216e276a7ba3bbb4317c0686b947e1717af00ed198cc4393\": rpc error: code = NotFound desc = could not find container \"bb6da3e3f9cd57bb216e276a7ba3bbb4317c0686b947e1717af00ed198cc4393\": container with ID starting with bb6da3e3f9cd57bb216e276a7ba3bbb4317c0686b947e1717af00ed198cc4393 not found: ID does not exist"
Jul 28 17:24:28.588324 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:28.588285    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-85d8b8ddfc-pt46g" podStartSLOduration=1.16229523 podStartE2EDuration="1.588273181s" totalImagesPullingTime="425.977951ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:28.586252625 +0000 UTC m=+445.418483875" watchObservedRunningTime="2026-07-28 17:24:28.588273181 +0000 UTC m=+445.420504429"
Jul 28 17:24:28.601153 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:28.601131    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"]
Jul 28 17:24:28.606896 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:28.606878    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-85d8b8ddfc-s5t7f"]
Jul 28 17:24:29.690740 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:29.690708    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39868e76-710b-4f50-8e8e-81c84a4c678a" path="/var/lib/kubelet/pods/39868e76-710b-4f50-8e8e-81c84a4c678a/volumes"
Jul 28 17:24:43.770582 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.770549    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c654d48b5-h7w87"]
Jul 28 17:24:43.770977 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.770881    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39868e76-710b-4f50-8e8e-81c84a4c678a" containerName="manager"
Jul 28 17:24:43.770977 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.770892    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="39868e76-710b-4f50-8e8e-81c84a4c678a" containerName="manager"
Jul 28 17:24:43.771045 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.770981    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="39868e76-710b-4f50-8e8e-81c84a4c678a" containerName="manager"
Jul 28 17:24:43.773622 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.773603    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.785658 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.785633    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c654d48b5-h7w87"]
Jul 28 17:24:43.834196 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.834160    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:43.845368 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.845343    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-console-config\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.845467 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.845374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-console-serving-cert\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.845467 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.845455    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-service-ca\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.845579 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.845480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8zck\" (UniqueName: \"kubernetes.io/projected/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-kube-api-access-l8zck\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.845579 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.845500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-oauth-serving-cert\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.845579 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.845518    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-console-oauth-config\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.845579 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.845535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-trusted-ca-bundle\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.946641 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.946606    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-console-config\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.946641 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.946637    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-console-serving-cert\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.946940 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.946690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-service-ca\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.946940 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.946709    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8zck\" (UniqueName: \"kubernetes.io/projected/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-kube-api-access-l8zck\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.946940 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.946728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-oauth-serving-cert\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.946940 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.946744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-console-oauth-config\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.946940 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.946760    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-trusted-ca-bundle\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.947573 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.947517    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-oauth-serving-cert\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.947698 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.947544    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-console-config\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.947750 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.947598    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-service-ca\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.947750 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.947614    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-trusted-ca-bundle\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.949413 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.949388    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-console-oauth-config\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.949510 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.949479    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-console-serving-cert\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:43.955195 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:43.955174    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8zck\" (UniqueName: \"kubernetes.io/projected/3b0c7ec6-7000-4ffa-9090-e22982e80cbb-kube-api-access-l8zck\") pod \"console-6c654d48b5-h7w87\" (UID: \"3b0c7ec6-7000-4ffa-9090-e22982e80cbb\") " pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:44.082866 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:44.082778    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:44.091827 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:44.091779    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:44.192155 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:44.192122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:44.216162 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:44.216127    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c654d48b5-h7w87"]
Jul 28 17:24:44.218720 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:24:44.218690    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b0c7ec6_7000_4ffa_9090_e22982e80cbb.slice/crio-10b42cb62fc10d4d9a2d8b4eac5125ad8d12a9f300ac03267379f483056b441c WatchSource:0}: Error finding container 10b42cb62fc10d4d9a2d8b4eac5125ad8d12a9f300ac03267379f483056b441c: Status 404 returned error can't find the container with id 10b42cb62fc10d4d9a2d8b4eac5125ad8d12a9f300ac03267379f483056b441c
Jul 28 17:24:44.571510 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:44.571478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:44.639497 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:44.639472    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c654d48b5-h7w87" event={"ID":"3b0c7ec6-7000-4ffa-9090-e22982e80cbb","Type":"ContainerStarted","Data":"0e4a5405e0df1bbe56336a3096d956c04db80b79d7456ec3b03a605fa298078d"}
Jul 28 17:24:44.639638 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:44.639521    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c654d48b5-h7w87" event={"ID":"3b0c7ec6-7000-4ffa-9090-e22982e80cbb","Type":"ContainerStarted","Data":"10b42cb62fc10d4d9a2d8b4eac5125ad8d12a9f300ac03267379f483056b441c"}
Jul 28 17:24:44.649837 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:44.649783    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:44.659875 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:44.659831    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c654d48b5-h7w87" podStartSLOduration=1.659817439 podStartE2EDuration="1.659817439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:24:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:44.658160507 +0000 UTC m=+461.490391759" watchObservedRunningTime="2026-07-28 17:24:44.659817439 +0000 UTC m=+461.492048687"
Jul 28 17:24:47.429334 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:47.429302    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:54.083616 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:54.083572    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:54.084240 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:54.083646    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:54.089223 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:54.089201    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:54.686141 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:54.686112    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c654d48b5-h7w87"
Jul 28 17:24:54.736972 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:54.736944    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8bdc5846-lhgcf"]
Jul 28 17:24:54.897158 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:54.897123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:55.024909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:55.024873    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:55.101477 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:55.101451    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:59.578455 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:24:59.578424    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-85d8b8ddfc-pt46g"
Jul 28 17:25:00.581732 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:00.581676    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:00.649891 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:00.649857    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-lk9sx"]
Jul 28 17:25:00.652630 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:00.652613    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-lk9sx"
Jul 28 17:25:00.655349 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:00.655332    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Jul 28 17:25:00.656368 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:00.656354    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-mt5fh\""
Jul 28 17:25:00.668770 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:00.668737    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-lk9sx"]
Jul 28 17:25:00.679854 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:00.679831    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:00.792450 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:00.792418    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g59t\" (UniqueName: \"kubernetes.io/projected/4ea431ab-b7ad-4382-b910-1b7d43223c6a-kube-api-access-6g59t\") pod \"odh-model-controller-75d9cdbddf-lk9sx\" (UID: \"4ea431ab-b7ad-4382-b910-1b7d43223c6a\") " pod="kserve/odh-model-controller-75d9cdbddf-lk9sx"
Jul 28 17:25:00.792645 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:00.792466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ea431ab-b7ad-4382-b910-1b7d43223c6a-cert\") pod \"odh-model-controller-75d9cdbddf-lk9sx\" (UID: \"4ea431ab-b7ad-4382-b910-1b7d43223c6a\") " pod="kserve/odh-model-controller-75d9cdbddf-lk9sx"
Jul 28 17:25:00.893727 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:00.893650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g59t\" (UniqueName: \"kubernetes.io/projected/4ea431ab-b7ad-4382-b910-1b7d43223c6a-kube-api-access-6g59t\") pod \"odh-model-controller-75d9cdbddf-lk9sx\" (UID: \"4ea431ab-b7ad-4382-b910-1b7d43223c6a\") " pod="kserve/odh-model-controller-75d9cdbddf-lk9sx"
Jul 28 17:25:00.893727 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:00.893716    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ea431ab-b7ad-4382-b910-1b7d43223c6a-cert\") pod \"odh-model-controller-75d9cdbddf-lk9sx\" (UID: \"4ea431ab-b7ad-4382-b910-1b7d43223c6a\") " pod="kserve/odh-model-controller-75d9cdbddf-lk9sx"
Jul 28 17:25:00.893913 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:25:00.893880    2563 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 28 17:25:00.893950 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:25:00.893943    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ea431ab-b7ad-4382-b910-1b7d43223c6a-cert podName:4ea431ab-b7ad-4382-b910-1b7d43223c6a nodeName:}" failed. No retries permitted until 2026-07-28 17:25:01.39392717 +0000 UTC m=+478.226158400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4ea431ab-b7ad-4382-b910-1b7d43223c6a-cert") pod "odh-model-controller-75d9cdbddf-lk9sx" (UID: "4ea431ab-b7ad-4382-b910-1b7d43223c6a") : secret "odh-model-controller-webhook-cert" not found
Jul 28 17:25:00.907457 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:00.907429    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g59t\" (UniqueName: \"kubernetes.io/projected/4ea431ab-b7ad-4382-b910-1b7d43223c6a-kube-api-access-6g59t\") pod \"odh-model-controller-75d9cdbddf-lk9sx\" (UID: \"4ea431ab-b7ad-4382-b910-1b7d43223c6a\") " pod="kserve/odh-model-controller-75d9cdbddf-lk9sx"
Jul 28 17:25:00.950927 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:00.950895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:01.050401 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:01.050367    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:01.397932 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:01.397882    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ea431ab-b7ad-4382-b910-1b7d43223c6a-cert\") pod \"odh-model-controller-75d9cdbddf-lk9sx\" (UID: \"4ea431ab-b7ad-4382-b910-1b7d43223c6a\") " pod="kserve/odh-model-controller-75d9cdbddf-lk9sx"
Jul 28 17:25:01.400404 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:01.400383    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ea431ab-b7ad-4382-b910-1b7d43223c6a-cert\") pod \"odh-model-controller-75d9cdbddf-lk9sx\" (UID: \"4ea431ab-b7ad-4382-b910-1b7d43223c6a\") " pod="kserve/odh-model-controller-75d9cdbddf-lk9sx"
Jul 28 17:25:01.461623 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:01.461590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:01.526364 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:01.526331    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:01.563541 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:01.563517    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-75d9cdbddf-lk9sx"
Jul 28 17:25:01.697161 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:01.697142    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-75d9cdbddf-lk9sx"]
Jul 28 17:25:01.699889 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:25:01.699862    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea431ab_b7ad_4382_b910_1b7d43223c6a.slice/crio-5911a0b7ac0bf13fd4d2a6a266cee0c3c635e247704a2cfe920a756e17fcbde5 WatchSource:0}: Error finding container 5911a0b7ac0bf13fd4d2a6a266cee0c3c635e247704a2cfe920a756e17fcbde5: Status 404 returned error can't find the container with id 5911a0b7ac0bf13fd4d2a6a266cee0c3c635e247704a2cfe920a756e17fcbde5
Jul 28 17:25:01.714256 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:01.714230    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-lk9sx" event={"ID":"4ea431ab-b7ad-4382-b910-1b7d43223c6a","Type":"ContainerStarted","Data":"5911a0b7ac0bf13fd4d2a6a266cee0c3c635e247704a2cfe920a756e17fcbde5"}
Jul 28 17:25:05.734122 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:05.734091    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-75d9cdbddf-lk9sx" event={"ID":"4ea431ab-b7ad-4382-b910-1b7d43223c6a","Type":"ContainerStarted","Data":"300a41e5dbbac37b038ba819e206aef9d7e6d4d84b824376a7491d881484e626"}
Jul 28 17:25:05.734531 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:05.734211    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-75d9cdbddf-lk9sx"
Jul 28 17:25:05.754484 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:05.754437    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-75d9cdbddf-lk9sx" podStartSLOduration=2.448176707 podStartE2EDuration="5.754421291s" totalImagesPullingTime="3.306244584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:25:05.75298073 +0000 UTC m=+482.585211990" watchObservedRunningTime="2026-07-28 17:25:05.754421291 +0000 UTC m=+482.586652539"
Jul 28 17:25:16.741519 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:16.741486    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-75d9cdbddf-lk9sx"
Jul 28 17:25:19.757709 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:19.757653    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c8bdc5846-lhgcf" podUID="cf6e706a-96d1-40eb-aa14-d29d0f77ad38" containerName="console" containerID="cri-o://c746fb9ae065a5146995e393d2ae1fdb1c33370e823b8aea5915d40858a282a4" gracePeriod=15
Jul 28 17:25:19.999767 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:19.999742    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:25:20.050643 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.050573    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-serving-cert\") pod \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") "
Jul 28 17:25:20.050818 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.050664    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-trusted-ca-bundle\") pod \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") "
Jul 28 17:25:20.050818 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.050709    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-service-ca\") pod \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") "
Jul 28 17:25:20.050818 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.050745    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-oauth-config\") pod \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") "
Jul 28 17:25:20.050818 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.050780    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-oauth-serving-cert\") pod \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") "
Jul 28 17:25:20.051038 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.050833    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-config\") pod \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") "
Jul 28 17:25:20.051216 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.051182    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cf6e706a-96d1-40eb-aa14-d29d0f77ad38" (UID: "cf6e706a-96d1-40eb-aa14-d29d0f77ad38"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:25:20.051216 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.051203    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-config" (OuterVolumeSpecName: "console-config") pod "cf6e706a-96d1-40eb-aa14-d29d0f77ad38" (UID: "cf6e706a-96d1-40eb-aa14-d29d0f77ad38"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:25:20.051216 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.051214    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-service-ca" (OuterVolumeSpecName: "service-ca") pod "cf6e706a-96d1-40eb-aa14-d29d0f77ad38" (UID: "cf6e706a-96d1-40eb-aa14-d29d0f77ad38"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:25:20.051409 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.051221    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cf6e706a-96d1-40eb-aa14-d29d0f77ad38" (UID: "cf6e706a-96d1-40eb-aa14-d29d0f77ad38"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:25:20.053055 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.053032    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cf6e706a-96d1-40eb-aa14-d29d0f77ad38" (UID: "cf6e706a-96d1-40eb-aa14-d29d0f77ad38"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:25:20.053146 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.053108    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cf6e706a-96d1-40eb-aa14-d29d0f77ad38" (UID: "cf6e706a-96d1-40eb-aa14-d29d0f77ad38"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:25:20.151497 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.151468    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgjkw\" (UniqueName: \"kubernetes.io/projected/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-kube-api-access-wgjkw\") pod \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\" (UID: \"cf6e706a-96d1-40eb-aa14-d29d0f77ad38\") "
Jul 28 17:25:20.151668 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.151656    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-oauth-config\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:25:20.151734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.151671    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-oauth-serving-cert\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:25:20.151734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.151681    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-config\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:25:20.151734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.151691    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-console-serving-cert\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:25:20.151734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.151700    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-trusted-ca-bundle\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:25:20.151734 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.151709    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-service-ca\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:25:20.153576 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.153552    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-kube-api-access-wgjkw" (OuterVolumeSpecName: "kube-api-access-wgjkw") pod "cf6e706a-96d1-40eb-aa14-d29d0f77ad38" (UID: "cf6e706a-96d1-40eb-aa14-d29d0f77ad38"). InnerVolumeSpecName "kube-api-access-wgjkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:25:20.252513 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.252486    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgjkw\" (UniqueName: \"kubernetes.io/projected/cf6e706a-96d1-40eb-aa14-d29d0f77ad38-kube-api-access-wgjkw\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:25:20.799633 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.799595    2563 generic.go:356] "Generic (PLEG): container finished" podID="cf6e706a-96d1-40eb-aa14-d29d0f77ad38" containerID="c746fb9ae065a5146995e393d2ae1fdb1c33370e823b8aea5915d40858a282a4" exitCode=0
Jul 28 17:25:20.800036 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.799641    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8bdc5846-lhgcf" event={"ID":"cf6e706a-96d1-40eb-aa14-d29d0f77ad38","Type":"ContainerDied","Data":"c746fb9ae065a5146995e393d2ae1fdb1c33370e823b8aea5915d40858a282a4"}
Jul 28 17:25:20.800036 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.799720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8bdc5846-lhgcf" event={"ID":"cf6e706a-96d1-40eb-aa14-d29d0f77ad38","Type":"ContainerDied","Data":"83cf2263716e0f729ef568e58264dc7b6f14b0d4a04b4b675be9700e744e6e59"}
Jul 28 17:25:20.800036 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.799663    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8bdc5846-lhgcf"
Jul 28 17:25:20.800036 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.799750    2563 scope.go:117] "RemoveContainer" containerID="c746fb9ae065a5146995e393d2ae1fdb1c33370e823b8aea5915d40858a282a4"
Jul 28 17:25:20.808145 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.808130    2563 scope.go:117] "RemoveContainer" containerID="c746fb9ae065a5146995e393d2ae1fdb1c33370e823b8aea5915d40858a282a4"
Jul 28 17:25:20.808420 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:25:20.808397    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c746fb9ae065a5146995e393d2ae1fdb1c33370e823b8aea5915d40858a282a4\": container with ID starting with c746fb9ae065a5146995e393d2ae1fdb1c33370e823b8aea5915d40858a282a4 not found: ID does not exist" containerID="c746fb9ae065a5146995e393d2ae1fdb1c33370e823b8aea5915d40858a282a4"
Jul 28 17:25:20.808517 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.808430    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c746fb9ae065a5146995e393d2ae1fdb1c33370e823b8aea5915d40858a282a4"} err="failed to get container status \"c746fb9ae065a5146995e393d2ae1fdb1c33370e823b8aea5915d40858a282a4\": rpc error: code = NotFound desc = could not find container \"c746fb9ae065a5146995e393d2ae1fdb1c33370e823b8aea5915d40858a282a4\": container with ID starting with c746fb9ae065a5146995e393d2ae1fdb1c33370e823b8aea5915d40858a282a4 not found: ID does not exist"
Jul 28 17:25:20.831160 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.831139    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8bdc5846-lhgcf"]
Jul 28 17:25:20.839043 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:20.839023    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c8bdc5846-lhgcf"]
Jul 28 17:25:21.690377 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:25:21.690347    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf6e706a-96d1-40eb-aa14-d29d0f77ad38" path="/var/lib/kubelet/pods/cf6e706a-96d1-40eb-aa14-d29d0f77ad38/volumes"
Jul 28 17:26:24.937673 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:26:24.937622    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:41.294290 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:26:41.294248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:41.392010 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:26:41.391953    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:51.927487 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:26:51.927447    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:51.997722 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:26:51.997674    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:52.686451 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:26:52.686417    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:53.170933 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:26:53.170900    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:42.223395 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:27:42.223350    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:48.009089 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:27:48.009053    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:48.108985 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:27:48.108950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:56.054308 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:27:56.054272    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:56.155427 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:27:56.155393    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:04.951267 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:28:04.951229    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:05.023147 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:28:05.023122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:14.023206 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:28:14.023166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:14.124864 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:28:14.124827    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:37.943720 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:28:37.943672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:38.036700 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:28:38.036658    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:38.134092 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:28:38.134050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:38.201725 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:28:38.201622    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:38.516129 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:28:38.516101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:17.994467 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:17.994426    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"]
Jul 28 17:30:17.994998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:17.994983    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6e706a-96d1-40eb-aa14-d29d0f77ad38" containerName="console"
Jul 28 17:30:17.995049 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:17.995002    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6e706a-96d1-40eb-aa14-d29d0f77ad38" containerName="console"
Jul 28 17:30:17.995090 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:17.995082    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6e706a-96d1-40eb-aa14-d29d0f77ad38" containerName="console"
Jul 28 17:30:17.997511 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:17.997491    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"
Jul 28 17:30:18.000287 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:18.000264    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 17:30:18.000388 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:18.000323    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-04101-kube-rbac-proxy-sar-config\""
Jul 28 17:30:18.000439 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:18.000402    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-jwrfk\""
Jul 28 17:30:18.001217 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:18.001171    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-04101-serving-cert\""
Jul 28 17:30:18.006345 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:18.006321    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"]
Jul 28 17:30:18.033693 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:18.033650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:18.087811 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:18.087762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/501317ed-2a59-404f-84ff-6cd37facd8b8-openshift-service-ca-bundle\") pod \"model-chainer-raw-04101-68d8d6678c-qf9d8\" (UID: \"501317ed-2a59-404f-84ff-6cd37facd8b8\") " pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"
Jul 28 17:30:18.087811 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:18.087811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/501317ed-2a59-404f-84ff-6cd37facd8b8-proxy-tls\") pod \"model-chainer-raw-04101-68d8d6678c-qf9d8\" (UID: \"501317ed-2a59-404f-84ff-6cd37facd8b8\") " pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"
Jul 28 17:30:18.161353 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:18.161301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:18.188767 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:18.188738    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/501317ed-2a59-404f-84ff-6cd37facd8b8-openshift-service-ca-bundle\") pod \"model-chainer-raw-04101-68d8d6678c-qf9d8\" (UID: \"501317ed-2a59-404f-84ff-6cd37facd8b8\") " pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"
Jul 28 17:30:18.188927 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:18.188771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/501317ed-2a59-404f-84ff-6cd37facd8b8-proxy-tls\") pod \"model-chainer-raw-04101-68d8d6678c-qf9d8\" (UID: \"501317ed-2a59-404f-84ff-6cd37facd8b8\") " pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"
Jul 28 17:30:18.189355 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:18.189338    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/501317ed-2a59-404f-84ff-6cd37facd8b8-openshift-service-ca-bundle\") pod \"model-chainer-raw-04101-68d8d6678c-qf9d8\" (UID: \"501317ed-2a59-404f-84ff-6cd37facd8b8\") " pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"
Jul 28 17:30:18.191403 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:18.191383    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/501317ed-2a59-404f-84ff-6cd37facd8b8-proxy-tls\") pod \"model-chainer-raw-04101-68d8d6678c-qf9d8\" (UID: \"501317ed-2a59-404f-84ff-6cd37facd8b8\") " pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"
Jul 28 17:30:18.309062 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:18.309030    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"
Jul 28 17:30:18.441627 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:18.441489    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"]
Jul 28 17:30:18.444406 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:30:18.444379    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501317ed_2a59_404f_84ff_6cd37facd8b8.slice/crio-2f0ccebc7a905890aaad7cfeb7a489d466f0e9555423940e3611df3aa254b560 WatchSource:0}: Error finding container 2f0ccebc7a905890aaad7cfeb7a489d466f0e9555423940e3611df3aa254b560: Status 404 returned error can't find the container with id 2f0ccebc7a905890aaad7cfeb7a489d466f0e9555423940e3611df3aa254b560
Jul 28 17:30:18.446209 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:18.446188    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:30:19.067005 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:19.066965    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8" event={"ID":"501317ed-2a59-404f-84ff-6cd37facd8b8","Type":"ContainerStarted","Data":"2f0ccebc7a905890aaad7cfeb7a489d466f0e9555423940e3611df3aa254b560"}
Jul 28 17:30:21.077166 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:21.077133    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8" event={"ID":"501317ed-2a59-404f-84ff-6cd37facd8b8","Type":"ContainerStarted","Data":"d83fc565ed3445672580dcc44ba28489b824cf0d2f65f7822dab9bac06daefdd"}
Jul 28 17:30:21.077538 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:21.077244    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"
Jul 28 17:30:21.100036 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:21.099991    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8" podStartSLOduration=1.675220414 podStartE2EDuration="4.099975115s" totalImagesPullingTime="2.424754701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:30:21.099019228 +0000 UTC m=+797.931250478" watchObservedRunningTime="2026-07-28 17:30:21.099975115 +0000 UTC m=+797.932206403"
Jul 28 17:30:27.087237 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:27.087205    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"
Jul 28 17:30:28.028902 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:28.028867    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"]
Jul 28 17:30:28.029119 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:28.029095    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8" podUID="501317ed-2a59-404f-84ff-6cd37facd8b8" containerName="model-chainer-raw-04101" containerID="cri-o://d83fc565ed3445672580dcc44ba28489b824cf0d2f65f7822dab9bac06daefdd" gracePeriod=30
Jul 28 17:30:28.049307 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:28.049273    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:28.214077 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:28.214037    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:28.301743 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:28.301666    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:28.372042 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:28.372005    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:28.473354 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:28.473311    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:28.564308 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:28.564227    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:32.085718 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:32.085679    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8" podUID="501317ed-2a59-404f-84ff-6cd37facd8b8" containerName="model-chainer-raw-04101" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 17:30:37.085715 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:37.085679    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8" podUID="501317ed-2a59-404f-84ff-6cd37facd8b8" containerName="model-chainer-raw-04101" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 17:30:42.086214 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:42.086168    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8" podUID="501317ed-2a59-404f-84ff-6cd37facd8b8" containerName="model-chainer-raw-04101" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 17:30:42.086815 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:42.086276    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"
Jul 28 17:30:47.085483 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:47.085445    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8" podUID="501317ed-2a59-404f-84ff-6cd37facd8b8" containerName="model-chainer-raw-04101" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 17:30:52.084705 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:52.084669    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8" podUID="501317ed-2a59-404f-84ff-6cd37facd8b8" containerName="model-chainer-raw-04101" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 17:30:57.085018 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:57.084975    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8" podUID="501317ed-2a59-404f-84ff-6cd37facd8b8" containerName="model-chainer-raw-04101" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 17:30:58.177804 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:58.177776    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"
Jul 28 17:30:58.235998 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:58.235968    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/501317ed-2a59-404f-84ff-6cd37facd8b8-proxy-tls\") pod \"501317ed-2a59-404f-84ff-6cd37facd8b8\" (UID: \"501317ed-2a59-404f-84ff-6cd37facd8b8\") "
Jul 28 17:30:58.236163 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:58.236003    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/501317ed-2a59-404f-84ff-6cd37facd8b8-openshift-service-ca-bundle\") pod \"501317ed-2a59-404f-84ff-6cd37facd8b8\" (UID: \"501317ed-2a59-404f-84ff-6cd37facd8b8\") "
Jul 28 17:30:58.236437 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:58.236403    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/501317ed-2a59-404f-84ff-6cd37facd8b8-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "501317ed-2a59-404f-84ff-6cd37facd8b8" (UID: "501317ed-2a59-404f-84ff-6cd37facd8b8"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:30:58.237200 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:58.237172    2563 generic.go:356] "Generic (PLEG): container finished" podID="501317ed-2a59-404f-84ff-6cd37facd8b8" containerID="d83fc565ed3445672580dcc44ba28489b824cf0d2f65f7822dab9bac06daefdd" exitCode=0
Jul 28 17:30:58.237359 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:58.237215    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"
Jul 28 17:30:58.237359 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:58.237252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8" event={"ID":"501317ed-2a59-404f-84ff-6cd37facd8b8","Type":"ContainerDied","Data":"d83fc565ed3445672580dcc44ba28489b824cf0d2f65f7822dab9bac06daefdd"}
Jul 28 17:30:58.237359 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:58.237314    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8" event={"ID":"501317ed-2a59-404f-84ff-6cd37facd8b8","Type":"ContainerDied","Data":"2f0ccebc7a905890aaad7cfeb7a489d466f0e9555423940e3611df3aa254b560"}
Jul 28 17:30:58.238068 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:58.237827    2563 scope.go:117] "RemoveContainer" containerID="d83fc565ed3445672580dcc44ba28489b824cf0d2f65f7822dab9bac06daefdd"
Jul 28 17:30:58.244226 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:58.244191    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/501317ed-2a59-404f-84ff-6cd37facd8b8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "501317ed-2a59-404f-84ff-6cd37facd8b8" (UID: "501317ed-2a59-404f-84ff-6cd37facd8b8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:30:58.253863 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:58.253836    2563 scope.go:117] "RemoveContainer" containerID="d83fc565ed3445672580dcc44ba28489b824cf0d2f65f7822dab9bac06daefdd"
Jul 28 17:30:58.254163 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:30:58.254144    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d83fc565ed3445672580dcc44ba28489b824cf0d2f65f7822dab9bac06daefdd\": container with ID starting with d83fc565ed3445672580dcc44ba28489b824cf0d2f65f7822dab9bac06daefdd not found: ID does not exist" containerID="d83fc565ed3445672580dcc44ba28489b824cf0d2f65f7822dab9bac06daefdd"
Jul 28 17:30:58.254220 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:58.254171    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d83fc565ed3445672580dcc44ba28489b824cf0d2f65f7822dab9bac06daefdd"} err="failed to get container status \"d83fc565ed3445672580dcc44ba28489b824cf0d2f65f7822dab9bac06daefdd\": rpc error: code = NotFound desc = could not find container \"d83fc565ed3445672580dcc44ba28489b824cf0d2f65f7822dab9bac06daefdd\": container with ID starting with d83fc565ed3445672580dcc44ba28489b824cf0d2f65f7822dab9bac06daefdd not found: ID does not exist"
Jul 28 17:30:58.336951 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:58.336869    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/501317ed-2a59-404f-84ff-6cd37facd8b8-proxy-tls\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:30:58.336951 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:58.336900    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/501317ed-2a59-404f-84ff-6cd37facd8b8-openshift-service-ca-bundle\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:30:58.557707 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:58.557681    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"]
Jul 28 17:30:58.561387 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:58.561363    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-04101-68d8d6678c-qf9d8"]
Jul 28 17:30:59.691441 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:30:59.691409    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="501317ed-2a59-404f-84ff-6cd37facd8b8" path="/var/lib/kubelet/pods/501317ed-2a59-404f-84ff-6cd37facd8b8/volumes"
Jul 28 17:32:08.287987 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.287953    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"]
Jul 28 17:32:08.288376 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.288297    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="501317ed-2a59-404f-84ff-6cd37facd8b8" containerName="model-chainer-raw-04101"
Jul 28 17:32:08.288376 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.288307    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="501317ed-2a59-404f-84ff-6cd37facd8b8" containerName="model-chainer-raw-04101"
Jul 28 17:32:08.288376 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.288356    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="501317ed-2a59-404f-84ff-6cd37facd8b8" containerName="model-chainer-raw-04101"
Jul 28 17:32:08.291111 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.291091    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"
Jul 28 17:32:08.293925 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.293898    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-83c93-kube-rbac-proxy-sar-config\""
Jul 28 17:32:08.294047 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.293951    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-83c93-serving-cert\""
Jul 28 17:32:08.294047 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.293987    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 17:32:08.294159 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.294056    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-jwrfk\""
Jul 28 17:32:08.299942 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.299896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97a7784e-0ada-44b7-b49b-766b87895f45-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls\" (UID: \"97a7784e-0ada-44b7-b49b-766b87895f45\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"
Jul 28 17:32:08.300044 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.299946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/97a7784e-0ada-44b7-b49b-766b87895f45-proxy-tls\") pod \"model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls\" (UID: \"97a7784e-0ada-44b7-b49b-766b87895f45\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"
Jul 28 17:32:08.300179 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.300163    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"]
Jul 28 17:32:08.321153 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.321128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:08.400489 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.400451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97a7784e-0ada-44b7-b49b-766b87895f45-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls\" (UID: \"97a7784e-0ada-44b7-b49b-766b87895f45\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"
Jul 28 17:32:08.400666 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.400495    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/97a7784e-0ada-44b7-b49b-766b87895f45-proxy-tls\") pod \"model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls\" (UID: \"97a7784e-0ada-44b7-b49b-766b87895f45\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"
Jul 28 17:32:08.401441 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.401417    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97a7784e-0ada-44b7-b49b-766b87895f45-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls\" (UID: \"97a7784e-0ada-44b7-b49b-766b87895f45\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"
Jul 28 17:32:08.403130 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.403090    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/97a7784e-0ada-44b7-b49b-766b87895f45-proxy-tls\") pod \"model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls\" (UID: \"97a7784e-0ada-44b7-b49b-766b87895f45\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"
Jul 28 17:32:08.408213 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.408184    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:08.602781 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.602752    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"
Jul 28 17:32:08.736228 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:08.736189    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"]
Jul 28 17:32:08.740333 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:32:08.740306    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a7784e_0ada_44b7_b49b_766b87895f45.slice/crio-26ac930d1a61fec8c7f12494a63e1f911c44a6daf61a628778932851337f09bf WatchSource:0}: Error finding container 26ac930d1a61fec8c7f12494a63e1f911c44a6daf61a628778932851337f09bf: Status 404 returned error can't find the container with id 26ac930d1a61fec8c7f12494a63e1f911c44a6daf61a628778932851337f09bf
Jul 28 17:32:09.538123 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:09.538088    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls" event={"ID":"97a7784e-0ada-44b7-b49b-766b87895f45","Type":"ContainerStarted","Data":"a61f1a0e6add976807791079648d3e21f04b585004df9636c9e8fb51c61731f6"}
Jul 28 17:32:09.538579 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:09.538175    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls" event={"ID":"97a7784e-0ada-44b7-b49b-766b87895f45","Type":"ContainerStarted","Data":"26ac930d1a61fec8c7f12494a63e1f911c44a6daf61a628778932851337f09bf"}
Jul 28 17:32:09.538579 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:09.538201    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"
Jul 28 17:32:09.553860 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:09.553809    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls" podStartSLOduration=1.553772798 podStartE2EDuration="1.553772798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:32:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:32:09.553063626 +0000 UTC m=+906.385294903" watchObservedRunningTime="2026-07-28 17:32:09.553772798 +0000 UTC m=+906.386004048"
Jul 28 17:32:15.549253 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:15.549227    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"
Jul 28 17:32:18.336417 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:18.336382    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"]
Jul 28 17:32:18.336829 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:18.336600    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls" podUID="97a7784e-0ada-44b7-b49b-766b87895f45" containerName="model-chainer-raw-hpa-83c93" containerID="cri-o://a61f1a0e6add976807791079648d3e21f04b585004df9636c9e8fb51c61731f6" gracePeriod=30
Jul 28 17:32:18.362363 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:18.362315    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:18.510868 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:18.510830    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:18.611274 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:18.611192    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:18.712380 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:18.712349    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:18.914005 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:18.913928    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:20.548137 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:20.548103    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls" podUID="97a7784e-0ada-44b7-b49b-766b87895f45" containerName="model-chainer-raw-hpa-83c93" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 17:32:25.547579 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:25.547537    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls" podUID="97a7784e-0ada-44b7-b49b-766b87895f45" containerName="model-chainer-raw-hpa-83c93" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 17:32:29.898445 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:29.898405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:30.548317 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:30.548278    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls" podUID="97a7784e-0ada-44b7-b49b-766b87895f45" containerName="model-chainer-raw-hpa-83c93" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 17:32:30.548524 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:30.548386    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"
Jul 28 17:32:35.547121 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:35.547084    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls" podUID="97a7784e-0ada-44b7-b49b-766b87895f45" containerName="model-chainer-raw-hpa-83c93" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 17:32:38.554187 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:38.554154    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:39.010909 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:39.010877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:40.547883 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:40.547840    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls" podUID="97a7784e-0ada-44b7-b49b-766b87895f45" containerName="model-chainer-raw-hpa-83c93" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 17:32:45.547364 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:45.547317    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls" podUID="97a7784e-0ada-44b7-b49b-766b87895f45" containerName="model-chainer-raw-hpa-83c93" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 17:32:46.522247 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:46.522211    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:48.482246 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:48.482218    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"
Jul 28 17:32:48.613433 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:48.613337    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/97a7784e-0ada-44b7-b49b-766b87895f45-proxy-tls\") pod \"97a7784e-0ada-44b7-b49b-766b87895f45\" (UID: \"97a7784e-0ada-44b7-b49b-766b87895f45\") "
Jul 28 17:32:48.613433 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:48.613399    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97a7784e-0ada-44b7-b49b-766b87895f45-openshift-service-ca-bundle\") pod \"97a7784e-0ada-44b7-b49b-766b87895f45\" (UID: \"97a7784e-0ada-44b7-b49b-766b87895f45\") "
Jul 28 17:32:48.613770 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:48.613733    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97a7784e-0ada-44b7-b49b-766b87895f45-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "97a7784e-0ada-44b7-b49b-766b87895f45" (UID: "97a7784e-0ada-44b7-b49b-766b87895f45"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:32:48.615558 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:48.615534    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97a7784e-0ada-44b7-b49b-766b87895f45-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "97a7784e-0ada-44b7-b49b-766b87895f45" (UID: "97a7784e-0ada-44b7-b49b-766b87895f45"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:32:48.711896 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:48.711846    2563 generic.go:356] "Generic (PLEG): container finished" podID="97a7784e-0ada-44b7-b49b-766b87895f45" containerID="a61f1a0e6add976807791079648d3e21f04b585004df9636c9e8fb51c61731f6" exitCode=0
Jul 28 17:32:48.711896 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:48.711897    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"
Jul 28 17:32:48.712107 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:48.711902    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls" event={"ID":"97a7784e-0ada-44b7-b49b-766b87895f45","Type":"ContainerDied","Data":"a61f1a0e6add976807791079648d3e21f04b585004df9636c9e8fb51c61731f6"}
Jul 28 17:32:48.712107 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:48.711949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls" event={"ID":"97a7784e-0ada-44b7-b49b-766b87895f45","Type":"ContainerDied","Data":"26ac930d1a61fec8c7f12494a63e1f911c44a6daf61a628778932851337f09bf"}
Jul 28 17:32:48.712107 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:48.711974    2563 scope.go:117] "RemoveContainer" containerID="a61f1a0e6add976807791079648d3e21f04b585004df9636c9e8fb51c61731f6"
Jul 28 17:32:48.713976 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:48.713957    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/97a7784e-0ada-44b7-b49b-766b87895f45-proxy-tls\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:32:48.714069 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:48.713981    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97a7784e-0ada-44b7-b49b-766b87895f45-openshift-service-ca-bundle\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:32:48.720647 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:48.720630    2563 scope.go:117] "RemoveContainer" containerID="a61f1a0e6add976807791079648d3e21f04b585004df9636c9e8fb51c61731f6"
Jul 28 17:32:48.720912 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:32:48.720893    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a61f1a0e6add976807791079648d3e21f04b585004df9636c9e8fb51c61731f6\": container with ID starting with a61f1a0e6add976807791079648d3e21f04b585004df9636c9e8fb51c61731f6 not found: ID does not exist" containerID="a61f1a0e6add976807791079648d3e21f04b585004df9636c9e8fb51c61731f6"
Jul 28 17:32:48.720991 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:48.720921    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a61f1a0e6add976807791079648d3e21f04b585004df9636c9e8fb51c61731f6"} err="failed to get container status \"a61f1a0e6add976807791079648d3e21f04b585004df9636c9e8fb51c61731f6\": rpc error: code = NotFound desc = could not find container \"a61f1a0e6add976807791079648d3e21f04b585004df9636c9e8fb51c61731f6\": container with ID starting with a61f1a0e6add976807791079648d3e21f04b585004df9636c9e8fb51c61731f6 not found: ID does not exist"
Jul 28 17:32:48.732165 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:48.732144    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"]
Jul 28 17:32:48.735570 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:48.735551    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-83c93-7f75bd67ff-7dhls"]
Jul 28 17:32:49.691122 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:32:49.691091    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97a7784e-0ada-44b7-b49b-766b87895f45" path="/var/lib/kubelet/pods/97a7784e-0ada-44b7-b49b-766b87895f45/volumes"
Jul 28 17:34:13.838746 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:34:13.838691    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:34:13.908031 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:34:13.907994    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:34:14.013451 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:34:14.013409    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:34:18.744403 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:34:18.744368    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:36:27.850428 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:36:27.850379    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:36:54.062201 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:36:54.062165    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:36:59.148983 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:36:59.148931    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:36:59.215465 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:36:59.215427    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:36:59.386230 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:36:59.386199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:36:59.487759 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:36:59.487681    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:38:29.327312 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:38:29.327274    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:38:30.726992 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:38:30.726963    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:38:34.399659 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:38:34.399619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:38:34.480772 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:38:34.480731    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:38:34.632337 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:38:34.632307    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:38:34.894059 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:38:34.894021    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:39:59.507098 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.507061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:39:59.518609 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.518574    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"]
Jul 28 17:39:59.518933 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.518920    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97a7784e-0ada-44b7-b49b-766b87895f45" containerName="model-chainer-raw-hpa-83c93"
Jul 28 17:39:59.518986 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.518935    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="97a7784e-0ada-44b7-b49b-766b87895f45" containerName="model-chainer-raw-hpa-83c93"
Jul 28 17:39:59.519019 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.518994    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="97a7784e-0ada-44b7-b49b-766b87895f45" containerName="model-chainer-raw-hpa-83c93"
Jul 28 17:39:59.522140 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.522123    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.524682 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.524644    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 28 17:39:59.525378 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.525355    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 28 17:39:59.525505 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.525385    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 28 17:39:59.525505 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.525420    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-v2-predictor-serving-cert\""
Jul 28 17:39:59.525505 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.525362    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 17:39:59.525505 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.525355    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\""
Jul 28 17:39:59.525505 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.525392    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-jwrfk\""
Jul 28 17:39:59.533012 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.532993    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"]
Jul 28 17:39:59.643684 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.643640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d2b276dc-7be4-418d-9216-3ae116187202-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pnmcw\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.643684 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.643692    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d2b276dc-7be4-418d-9216-3ae116187202-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pnmcw\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.643977 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.643731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d2b276dc-7be4-418d-9216-3ae116187202-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pnmcw\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.643977 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.643777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbrkf\" (UniqueName: \"kubernetes.io/projected/d2b276dc-7be4-418d-9216-3ae116187202-kube-api-access-nbrkf\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pnmcw\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.643977 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.643867    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d2b276dc-7be4-418d-9216-3ae116187202-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pnmcw\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.744621 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.744569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d2b276dc-7be4-418d-9216-3ae116187202-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pnmcw\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.744621 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.744629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbrkf\" (UniqueName: \"kubernetes.io/projected/d2b276dc-7be4-418d-9216-3ae116187202-kube-api-access-nbrkf\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pnmcw\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.744904 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.744701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d2b276dc-7be4-418d-9216-3ae116187202-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pnmcw\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.744904 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.744745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d2b276dc-7be4-418d-9216-3ae116187202-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pnmcw\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.744904 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.744775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d2b276dc-7be4-418d-9216-3ae116187202-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pnmcw\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.745390 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.745354    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d2b276dc-7be4-418d-9216-3ae116187202-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pnmcw\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.745685 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.745464    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d2b276dc-7be4-418d-9216-3ae116187202-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pnmcw\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.745685 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.745463    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d2b276dc-7be4-418d-9216-3ae116187202-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pnmcw\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.747332 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.747312    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d2b276dc-7be4-418d-9216-3ae116187202-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pnmcw\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.752630 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.752609    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbrkf\" (UniqueName: \"kubernetes.io/projected/d2b276dc-7be4-418d-9216-3ae116187202-kube-api-access-nbrkf\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pnmcw\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.833416 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.833330    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:39:59.964068 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.963890    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"]
Jul 28 17:39:59.966731 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:39:59.966698    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b276dc_7be4_418d_9216_3ae116187202.slice/crio-7ca6f39641339e4f947687b81b72453a8609a028d5565983b7074b6f3282555b WatchSource:0}: Error finding container 7ca6f39641339e4f947687b81b72453a8609a028d5565983b7074b6f3282555b: Status 404 returned error can't find the container with id 7ca6f39641339e4f947687b81b72453a8609a028d5565983b7074b6f3282555b
Jul 28 17:39:59.968771 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:39:59.968757    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:40:00.550172 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:00.550131    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" event={"ID":"d2b276dc-7be4-418d-9216-3ae116187202","Type":"ContainerStarted","Data":"7ca6f39641339e4f947687b81b72453a8609a028d5565983b7074b6f3282555b"}
Jul 28 17:40:03.744750 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:03.744725    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 28 17:40:04.572869 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:04.572832    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" event={"ID":"d2b276dc-7be4-418d-9216-3ae116187202","Type":"ContainerStarted","Data":"135fa10bb9f9d6a4480fdcc0a0f9994fae030ee2cd06fcd990495f9758d37d19"}
Jul 28 17:40:07.587971 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:07.587937    2563 generic.go:356] "Generic (PLEG): container finished" podID="d2b276dc-7be4-418d-9216-3ae116187202" containerID="135fa10bb9f9d6a4480fdcc0a0f9994fae030ee2cd06fcd990495f9758d37d19" exitCode=0
Jul 28 17:40:07.588439 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:07.588014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" event={"ID":"d2b276dc-7be4-418d-9216-3ae116187202","Type":"ContainerDied","Data":"135fa10bb9f9d6a4480fdcc0a0f9994fae030ee2cd06fcd990495f9758d37d19"}
Jul 28 17:40:20.660097 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:20.660008    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" event={"ID":"d2b276dc-7be4-418d-9216-3ae116187202","Type":"ContainerStarted","Data":"c738d105eadfcd7cfbfbc1401ec5fd2c8254ebc781e18d4c8cb8b32356b12492"}
Jul 28 17:40:22.672986 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:22.672950    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" event={"ID":"d2b276dc-7be4-418d-9216-3ae116187202","Type":"ContainerStarted","Data":"a26439949bdb9f37deb0c04d4cc2d99bb84e4ca05b13a0829e97743686e5aa24"}
Jul 28 17:40:22.673385 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:22.673126    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:40:23.677601 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:23.677575    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:40:23.679092 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:23.679066    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 28 17:40:24.681421 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:24.681368    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 28 17:40:29.690429 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:29.690402    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:40:29.690986 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:29.690960    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 28 17:40:29.710256 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:29.710203    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" podStartSLOduration=8.392473862 podStartE2EDuration="30.71018775s" totalImagesPullingTime="18.716041025s" totalInitContainerRuntime="3.601672863s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:39:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:40:22.694926271 +0000 UTC m=+1399.527157520" watchObservedRunningTime="2026-07-28 17:40:29.71018775 +0000 UTC m=+1406.542419008"
Jul 28 17:40:39.691557 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:39.691524    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 28 17:40:49.691770 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:49.691733    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 28 17:40:59.691029 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:40:59.690950    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 28 17:41:09.691536 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:09.691500    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 28 17:41:19.691637 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:19.691602    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 28 17:41:29.692392 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:29.692261    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 28 17:41:39.692477 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:39.692450    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:41:49.732011 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:49.731961    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"]
Jul 28 17:41:49.732404 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:49.732202    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kserve-container" containerID="cri-o://c738d105eadfcd7cfbfbc1401ec5fd2c8254ebc781e18d4c8cb8b32356b12492" gracePeriod=30
Jul 28 17:41:49.732404 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:49.732262    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kube-rbac-proxy" containerID="cri-o://a26439949bdb9f37deb0c04d4cc2d99bb84e4ca05b13a0829e97743686e5aa24" gracePeriod=30
Jul 28 17:41:50.047960 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:50.047931    2563 generic.go:356] "Generic (PLEG): container finished" podID="d2b276dc-7be4-418d-9216-3ae116187202" containerID="a26439949bdb9f37deb0c04d4cc2d99bb84e4ca05b13a0829e97743686e5aa24" exitCode=2
Jul 28 17:41:50.048134 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:50.047976    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" event={"ID":"d2b276dc-7be4-418d-9216-3ae116187202","Type":"ContainerDied","Data":"a26439949bdb9f37deb0c04d4cc2d99bb84e4ca05b13a0829e97743686e5aa24"}
Jul 28 17:41:50.402724 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:50.402638    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:41:54.474634 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.474609    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:41:54.624487 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.624394    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d2b276dc-7be4-418d-9216-3ae116187202-cabundle-cert\") pod \"d2b276dc-7be4-418d-9216-3ae116187202\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") "
Jul 28 17:41:54.624487 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.624461    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d2b276dc-7be4-418d-9216-3ae116187202-proxy-tls\") pod \"d2b276dc-7be4-418d-9216-3ae116187202\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") "
Jul 28 17:41:54.624487 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.624488    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d2b276dc-7be4-418d-9216-3ae116187202-kube-rbac-proxy-sar-config\") pod \"d2b276dc-7be4-418d-9216-3ae116187202\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") "
Jul 28 17:41:54.624771 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.624508    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbrkf\" (UniqueName: \"kubernetes.io/projected/d2b276dc-7be4-418d-9216-3ae116187202-kube-api-access-nbrkf\") pod \"d2b276dc-7be4-418d-9216-3ae116187202\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") "
Jul 28 17:41:54.624771 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.624591    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d2b276dc-7be4-418d-9216-3ae116187202-kserve-provision-location\") pod \"d2b276dc-7be4-418d-9216-3ae116187202\" (UID: \"d2b276dc-7be4-418d-9216-3ae116187202\") "
Jul 28 17:41:54.624771 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.624757    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b276dc-7be4-418d-9216-3ae116187202-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "d2b276dc-7be4-418d-9216-3ae116187202" (UID: "d2b276dc-7be4-418d-9216-3ae116187202"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:41:54.625022 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.624997    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2b276dc-7be4-418d-9216-3ae116187202-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "d2b276dc-7be4-418d-9216-3ae116187202" (UID: "d2b276dc-7be4-418d-9216-3ae116187202"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:41:54.625022 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.625002    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b276dc-7be4-418d-9216-3ae116187202-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d2b276dc-7be4-418d-9216-3ae116187202" (UID: "d2b276dc-7be4-418d-9216-3ae116187202"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:41:54.626752 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.626720    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2b276dc-7be4-418d-9216-3ae116187202-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d2b276dc-7be4-418d-9216-3ae116187202" (UID: "d2b276dc-7be4-418d-9216-3ae116187202"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:41:54.626940 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.626921    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2b276dc-7be4-418d-9216-3ae116187202-kube-api-access-nbrkf" (OuterVolumeSpecName: "kube-api-access-nbrkf") pod "d2b276dc-7be4-418d-9216-3ae116187202" (UID: "d2b276dc-7be4-418d-9216-3ae116187202"). InnerVolumeSpecName "kube-api-access-nbrkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:41:54.725271 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.725242    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d2b276dc-7be4-418d-9216-3ae116187202-proxy-tls\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:41:54.725271 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.725268    2563 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d2b276dc-7be4-418d-9216-3ae116187202-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:41:54.725271 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.725279    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbrkf\" (UniqueName: \"kubernetes.io/projected/d2b276dc-7be4-418d-9216-3ae116187202-kube-api-access-nbrkf\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:41:54.725504 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.725288    2563 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d2b276dc-7be4-418d-9216-3ae116187202-kserve-provision-location\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:41:54.725504 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.725298    2563 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d2b276dc-7be4-418d-9216-3ae116187202-cabundle-cert\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:41:54.826611 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.826549    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:41:54.893578 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:54.893484    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:41:55.072424 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.072379    2563 generic.go:356] "Generic (PLEG): container finished" podID="d2b276dc-7be4-418d-9216-3ae116187202" containerID="c738d105eadfcd7cfbfbc1401ec5fd2c8254ebc781e18d4c8cb8b32356b12492" exitCode=0
Jul 28 17:41:55.072608 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.072444    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"
Jul 28 17:41:55.072608 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.072465    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" event={"ID":"d2b276dc-7be4-418d-9216-3ae116187202","Type":"ContainerDied","Data":"c738d105eadfcd7cfbfbc1401ec5fd2c8254ebc781e18d4c8cb8b32356b12492"}
Jul 28 17:41:55.072608 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.072533    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw" event={"ID":"d2b276dc-7be4-418d-9216-3ae116187202","Type":"ContainerDied","Data":"7ca6f39641339e4f947687b81b72453a8609a028d5565983b7074b6f3282555b"}
Jul 28 17:41:55.072608 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.072564    2563 scope.go:117] "RemoveContainer" containerID="a26439949bdb9f37deb0c04d4cc2d99bb84e4ca05b13a0829e97743686e5aa24"
Jul 28 17:41:55.084892 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.084868    2563 scope.go:117] "RemoveContainer" containerID="c738d105eadfcd7cfbfbc1401ec5fd2c8254ebc781e18d4c8cb8b32356b12492"
Jul 28 17:41:55.095366 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.094856    2563 scope.go:117] "RemoveContainer" containerID="135fa10bb9f9d6a4480fdcc0a0f9994fae030ee2cd06fcd990495f9758d37d19"
Jul 28 17:41:55.097034 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.097009    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"]
Jul 28 17:41:55.103126 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.103096    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pnmcw"]
Jul 28 17:41:55.106178 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.106158    2563 scope.go:117] "RemoveContainer" containerID="a26439949bdb9f37deb0c04d4cc2d99bb84e4ca05b13a0829e97743686e5aa24"
Jul 28 17:41:55.106478 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:41:55.106460    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a26439949bdb9f37deb0c04d4cc2d99bb84e4ca05b13a0829e97743686e5aa24\": container with ID starting with a26439949bdb9f37deb0c04d4cc2d99bb84e4ca05b13a0829e97743686e5aa24 not found: ID does not exist" containerID="a26439949bdb9f37deb0c04d4cc2d99bb84e4ca05b13a0829e97743686e5aa24"
Jul 28 17:41:55.106539 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.106487    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a26439949bdb9f37deb0c04d4cc2d99bb84e4ca05b13a0829e97743686e5aa24"} err="failed to get container status \"a26439949bdb9f37deb0c04d4cc2d99bb84e4ca05b13a0829e97743686e5aa24\": rpc error: code = NotFound desc = could not find container \"a26439949bdb9f37deb0c04d4cc2d99bb84e4ca05b13a0829e97743686e5aa24\": container with ID starting with a26439949bdb9f37deb0c04d4cc2d99bb84e4ca05b13a0829e97743686e5aa24 not found: ID does not exist"
Jul 28 17:41:55.106539 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.106505    2563 scope.go:117] "RemoveContainer" containerID="c738d105eadfcd7cfbfbc1401ec5fd2c8254ebc781e18d4c8cb8b32356b12492"
Jul 28 17:41:55.106761 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:41:55.106747    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c738d105eadfcd7cfbfbc1401ec5fd2c8254ebc781e18d4c8cb8b32356b12492\": container with ID starting with c738d105eadfcd7cfbfbc1401ec5fd2c8254ebc781e18d4c8cb8b32356b12492 not found: ID does not exist" containerID="c738d105eadfcd7cfbfbc1401ec5fd2c8254ebc781e18d4c8cb8b32356b12492"
Jul 28 17:41:55.106832 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.106764    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c738d105eadfcd7cfbfbc1401ec5fd2c8254ebc781e18d4c8cb8b32356b12492"} err="failed to get container status \"c738d105eadfcd7cfbfbc1401ec5fd2c8254ebc781e18d4c8cb8b32356b12492\": rpc error: code = NotFound desc = could not find container \"c738d105eadfcd7cfbfbc1401ec5fd2c8254ebc781e18d4c8cb8b32356b12492\": container with ID starting with c738d105eadfcd7cfbfbc1401ec5fd2c8254ebc781e18d4c8cb8b32356b12492 not found: ID does not exist"
Jul 28 17:41:55.106832 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.106779    2563 scope.go:117] "RemoveContainer" containerID="135fa10bb9f9d6a4480fdcc0a0f9994fae030ee2cd06fcd990495f9758d37d19"
Jul 28 17:41:55.107025 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:41:55.107011    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"135fa10bb9f9d6a4480fdcc0a0f9994fae030ee2cd06fcd990495f9758d37d19\": container with ID starting with 135fa10bb9f9d6a4480fdcc0a0f9994fae030ee2cd06fcd990495f9758d37d19 not found: ID does not exist" containerID="135fa10bb9f9d6a4480fdcc0a0f9994fae030ee2cd06fcd990495f9758d37d19"
Jul 28 17:41:55.107064 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.107028    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"135fa10bb9f9d6a4480fdcc0a0f9994fae030ee2cd06fcd990495f9758d37d19"} err="failed to get container status \"135fa10bb9f9d6a4480fdcc0a0f9994fae030ee2cd06fcd990495f9758d37d19\": rpc error: code = NotFound desc = could not find container \"135fa10bb9f9d6a4480fdcc0a0f9994fae030ee2cd06fcd990495f9758d37d19\": container with ID starting with 135fa10bb9f9d6a4480fdcc0a0f9994fae030ee2cd06fcd990495f9758d37d19 not found: ID does not exist"
Jul 28 17:41:55.144344 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.144245    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:41:55.379424 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.379382    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:41:55.696353 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:41:55.696320    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2b276dc-7be4-418d-9216-3ae116187202" path="/var/lib/kubelet/pods/d2b276dc-7be4-418d-9216-3ae116187202/volumes"
Jul 28 17:42:03.718852 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:42:03.718816    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:42:43.045456 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:42:43.045410    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:43:19.922887 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.922852    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:43:19.936494 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.936459    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"]
Jul 28 17:43:19.936852 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.936837    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="storage-initializer"
Jul 28 17:43:19.936852 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.936852    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="storage-initializer"
Jul 28 17:43:19.936992 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.936867    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kube-rbac-proxy"
Jul 28 17:43:19.936992 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.936873    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kube-rbac-proxy"
Jul 28 17:43:19.936992 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.936884    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kserve-container"
Jul 28 17:43:19.936992 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.936890    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kserve-container"
Jul 28 17:43:19.936992 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.936951    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kserve-container"
Jul 28 17:43:19.936992 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.936959    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2b276dc-7be4-418d-9216-3ae116187202" containerName="kube-rbac-proxy"
Jul 28 17:43:19.939042 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.939026    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:19.941466 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.941444    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 28 17:43:19.941580 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.941495    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-jwrfk\""
Jul 28 17:43:19.941580 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.941528    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 17:43:19.941580 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.941540    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\""
Jul 28 17:43:19.941721 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.941621    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-predictor-serving-cert\""
Jul 28 17:43:19.942444 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.942428    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 28 17:43:19.942444 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.942439    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 28 17:43:19.949980 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:19.949964    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"]
Jul 28 17:43:20.030067 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.030037    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/703b2083-5569-4c66-80ff-db3e01de8193-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:20.030266 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.030075    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/703b2083-5569-4c66-80ff-db3e01de8193-proxy-tls\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:20.030266 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.030093    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpxns\" (UniqueName: \"kubernetes.io/projected/703b2083-5569-4c66-80ff-db3e01de8193-kube-api-access-rpxns\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:20.030266 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.030116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/703b2083-5569-4c66-80ff-db3e01de8193-cabundle-cert\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:20.030266 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.030138    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/703b2083-5569-4c66-80ff-db3e01de8193-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:20.131103 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.131067    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/703b2083-5569-4c66-80ff-db3e01de8193-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:20.131260 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.131111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/703b2083-5569-4c66-80ff-db3e01de8193-proxy-tls\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:20.131260 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.131130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpxns\" (UniqueName: \"kubernetes.io/projected/703b2083-5569-4c66-80ff-db3e01de8193-kube-api-access-rpxns\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:20.131362 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.131336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/703b2083-5569-4c66-80ff-db3e01de8193-cabundle-cert\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:20.131428 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.131383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/703b2083-5569-4c66-80ff-db3e01de8193-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:20.131804 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.131747    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/703b2083-5569-4c66-80ff-db3e01de8193-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:20.132062 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.131885    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/703b2083-5569-4c66-80ff-db3e01de8193-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:20.132062 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.131899    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/703b2083-5569-4c66-80ff-db3e01de8193-cabundle-cert\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:20.133676 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.133655    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/703b2083-5569-4c66-80ff-db3e01de8193-proxy-tls\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:20.139775 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.139756    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpxns\" (UniqueName: \"kubernetes.io/projected/703b2083-5569-4c66-80ff-db3e01de8193-kube-api-access-rpxns\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:20.251503 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.251433    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:20.385516 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.385492    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"]
Jul 28 17:43:20.387656 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:43:20.387627    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod703b2083_5569_4c66_80ff_db3e01de8193.slice/crio-1bcfcff063b1edb62eb47448e55aca6d2d3707cde4d259d67d063c204c45761a WatchSource:0}: Error finding container 1bcfcff063b1edb62eb47448e55aca6d2d3707cde4d259d67d063c204c45761a: Status 404 returned error can't find the container with id 1bcfcff063b1edb62eb47448e55aca6d2d3707cde4d259d67d063c204c45761a
Jul 28 17:43:20.438870 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:20.438842    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" event={"ID":"703b2083-5569-4c66-80ff-db3e01de8193","Type":"ContainerStarted","Data":"1bcfcff063b1edb62eb47448e55aca6d2d3707cde4d259d67d063c204c45761a"}
Jul 28 17:43:21.445756 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:21.445717    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" event={"ID":"703b2083-5569-4c66-80ff-db3e01de8193","Type":"ContainerStarted","Data":"7fc053298221ff87d47f4af608230247b9fb0d6d940b8ceb90090d65cbf63bb8"}
Jul 28 17:43:24.461713 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:24.461631    2563 generic.go:356] "Generic (PLEG): container finished" podID="703b2083-5569-4c66-80ff-db3e01de8193" containerID="7fc053298221ff87d47f4af608230247b9fb0d6d940b8ceb90090d65cbf63bb8" exitCode=0
Jul 28 17:43:24.461713 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:24.461665    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" event={"ID":"703b2083-5569-4c66-80ff-db3e01de8193","Type":"ContainerDied","Data":"7fc053298221ff87d47f4af608230247b9fb0d6d940b8ceb90090d65cbf63bb8"}
Jul 28 17:43:25.469488 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:25.469451    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" event={"ID":"703b2083-5569-4c66-80ff-db3e01de8193","Type":"ContainerStarted","Data":"55f0a83c4e73f0c970b9d096fca889519b424f7dcf0174d742ee70f612d32a20"}
Jul 28 17:43:25.469959 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:25.469538    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" event={"ID":"703b2083-5569-4c66-80ff-db3e01de8193","Type":"ContainerStarted","Data":"4ca0c83f4dc9d69a369e8ef90399b39c9b63fa5774e9480432d27839db9c26dc"}
Jul 28 17:43:25.469959 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:25.469884    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:25.470065 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:25.470022    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:25.471414 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:25.471389    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 28 17:43:25.490811 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:25.490751    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" podStartSLOduration=2.924509988 podStartE2EDuration="6.490734516s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.566224528s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:43:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:43:25.489186261 +0000 UTC m=+1582.321417516" watchObservedRunningTime="2026-07-28 17:43:25.490734516 +0000 UTC m=+1582.322965765"
Jul 28 17:43:26.475222 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:26.475180    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 28 17:43:31.480170 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:31.480135    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:43:31.481578 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:31.480704    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 28 17:43:41.481279 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:41.481241    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 28 17:43:51.481154 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:43:51.481110    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 28 17:44:01.481072 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:01.480980    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 28 17:44:11.481536 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:11.481497    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 28 17:44:21.481029 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:21.480981    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 28 17:44:31.481029 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:31.480984    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 28 17:44:36.686972 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:36.686937    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:44:39.999495 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:39.999452    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"]
Jul 28 17:44:39.999880 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:39.999735    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kserve-container" containerID="cri-o://4ca0c83f4dc9d69a369e8ef90399b39c9b63fa5774e9480432d27839db9c26dc" gracePeriod=30
Jul 28 17:44:39.999880 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:39.999768    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kube-rbac-proxy" containerID="cri-o://55f0a83c4e73f0c970b9d096fca889519b424f7dcf0174d742ee70f612d32a20" gracePeriod=30
Jul 28 17:44:40.025515 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:40.025485    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:40.808720 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:40.808681    2563 generic.go:356] "Generic (PLEG): container finished" podID="703b2083-5569-4c66-80ff-db3e01de8193" containerID="55f0a83c4e73f0c970b9d096fca889519b424f7dcf0174d742ee70f612d32a20" exitCode=2
Jul 28 17:44:40.808937 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:40.808744    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" event={"ID":"703b2083-5569-4c66-80ff-db3e01de8193","Type":"ContainerDied","Data":"55f0a83c4e73f0c970b9d096fca889519b424f7dcf0174d742ee70f612d32a20"}
Jul 28 17:44:41.475337 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:41.475297    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.34:8643/healthz\": dial tcp 10.134.0.34:8643: connect: connection refused"
Jul 28 17:44:44.652890 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.652868    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:44:44.747078 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.747001    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/703b2083-5569-4c66-80ff-db3e01de8193-kube-rbac-proxy-sar-config\") pod \"703b2083-5569-4c66-80ff-db3e01de8193\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") "
Jul 28 17:44:44.747078 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.747036    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/703b2083-5569-4c66-80ff-db3e01de8193-kserve-provision-location\") pod \"703b2083-5569-4c66-80ff-db3e01de8193\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") "
Jul 28 17:44:44.747298 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.747106    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/703b2083-5569-4c66-80ff-db3e01de8193-proxy-tls\") pod \"703b2083-5569-4c66-80ff-db3e01de8193\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") "
Jul 28 17:44:44.747298 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.747144    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpxns\" (UniqueName: \"kubernetes.io/projected/703b2083-5569-4c66-80ff-db3e01de8193-kube-api-access-rpxns\") pod \"703b2083-5569-4c66-80ff-db3e01de8193\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") "
Jul 28 17:44:44.747298 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.747179    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/703b2083-5569-4c66-80ff-db3e01de8193-cabundle-cert\") pod \"703b2083-5569-4c66-80ff-db3e01de8193\" (UID: \"703b2083-5569-4c66-80ff-db3e01de8193\") "
Jul 28 17:44:44.747453 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.747398    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/703b2083-5569-4c66-80ff-db3e01de8193-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "703b2083-5569-4c66-80ff-db3e01de8193" (UID: "703b2083-5569-4c66-80ff-db3e01de8193"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:44:44.747453 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.747422    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/703b2083-5569-4c66-80ff-db3e01de8193-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "703b2083-5569-4c66-80ff-db3e01de8193" (UID: "703b2083-5569-4c66-80ff-db3e01de8193"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:44:44.747602 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.747583    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/703b2083-5569-4c66-80ff-db3e01de8193-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "703b2083-5569-4c66-80ff-db3e01de8193" (UID: "703b2083-5569-4c66-80ff-db3e01de8193"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:44:44.749374 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.749353    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/703b2083-5569-4c66-80ff-db3e01de8193-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "703b2083-5569-4c66-80ff-db3e01de8193" (UID: "703b2083-5569-4c66-80ff-db3e01de8193"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:44:44.749492 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.749467    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/703b2083-5569-4c66-80ff-db3e01de8193-kube-api-access-rpxns" (OuterVolumeSpecName: "kube-api-access-rpxns") pod "703b2083-5569-4c66-80ff-db3e01de8193" (UID: "703b2083-5569-4c66-80ff-db3e01de8193"). InnerVolumeSpecName "kube-api-access-rpxns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:44:44.828807 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.828760    2563 generic.go:356] "Generic (PLEG): container finished" podID="703b2083-5569-4c66-80ff-db3e01de8193" containerID="4ca0c83f4dc9d69a369e8ef90399b39c9b63fa5774e9480432d27839db9c26dc" exitCode=0
Jul 28 17:44:44.828995 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.828827    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"
Jul 28 17:44:44.828995 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.828826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" event={"ID":"703b2083-5569-4c66-80ff-db3e01de8193","Type":"ContainerDied","Data":"4ca0c83f4dc9d69a369e8ef90399b39c9b63fa5774e9480432d27839db9c26dc"}
Jul 28 17:44:44.828995 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.828895    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc" event={"ID":"703b2083-5569-4c66-80ff-db3e01de8193","Type":"ContainerDied","Data":"1bcfcff063b1edb62eb47448e55aca6d2d3707cde4d259d67d063c204c45761a"}
Jul 28 17:44:44.828995 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.828934    2563 scope.go:117] "RemoveContainer" containerID="55f0a83c4e73f0c970b9d096fca889519b424f7dcf0174d742ee70f612d32a20"
Jul 28 17:44:44.838463 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.838381    2563 scope.go:117] "RemoveContainer" containerID="4ca0c83f4dc9d69a369e8ef90399b39c9b63fa5774e9480432d27839db9c26dc"
Jul 28 17:44:44.846404 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.846386    2563 scope.go:117] "RemoveContainer" containerID="7fc053298221ff87d47f4af608230247b9fb0d6d940b8ceb90090d65cbf63bb8"
Jul 28 17:44:44.849119 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.848869    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/703b2083-5569-4c66-80ff-db3e01de8193-proxy-tls\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:44:44.849119 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.849043    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpxns\" (UniqueName: \"kubernetes.io/projected/703b2083-5569-4c66-80ff-db3e01de8193-kube-api-access-rpxns\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:44:44.849119 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.849067    2563 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/703b2083-5569-4c66-80ff-db3e01de8193-cabundle-cert\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:44:44.849119 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.849083    2563 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/703b2083-5569-4c66-80ff-db3e01de8193-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:44:44.849119 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.849097    2563 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/703b2083-5569-4c66-80ff-db3e01de8193-kserve-provision-location\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:44:44.853515 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.853487    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"]
Jul 28 17:44:44.859276 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.859253    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-4wdmc"]
Jul 28 17:44:44.861295 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.861272    2563 scope.go:117] "RemoveContainer" containerID="55f0a83c4e73f0c970b9d096fca889519b424f7dcf0174d742ee70f612d32a20"
Jul 28 17:44:44.861620 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:44:44.861599    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55f0a83c4e73f0c970b9d096fca889519b424f7dcf0174d742ee70f612d32a20\": container with ID starting with 55f0a83c4e73f0c970b9d096fca889519b424f7dcf0174d742ee70f612d32a20 not found: ID does not exist" containerID="55f0a83c4e73f0c970b9d096fca889519b424f7dcf0174d742ee70f612d32a20"
Jul 28 17:44:44.861694 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.861633    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55f0a83c4e73f0c970b9d096fca889519b424f7dcf0174d742ee70f612d32a20"} err="failed to get container status \"55f0a83c4e73f0c970b9d096fca889519b424f7dcf0174d742ee70f612d32a20\": rpc error: code = NotFound desc = could not find container \"55f0a83c4e73f0c970b9d096fca889519b424f7dcf0174d742ee70f612d32a20\": container with ID starting with 55f0a83c4e73f0c970b9d096fca889519b424f7dcf0174d742ee70f612d32a20 not found: ID does not exist"
Jul 28 17:44:44.861694 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.861661    2563 scope.go:117] "RemoveContainer" containerID="4ca0c83f4dc9d69a369e8ef90399b39c9b63fa5774e9480432d27839db9c26dc"
Jul 28 17:44:44.861968 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:44:44.861950    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ca0c83f4dc9d69a369e8ef90399b39c9b63fa5774e9480432d27839db9c26dc\": container with ID starting with 4ca0c83f4dc9d69a369e8ef90399b39c9b63fa5774e9480432d27839db9c26dc not found: ID does not exist" containerID="4ca0c83f4dc9d69a369e8ef90399b39c9b63fa5774e9480432d27839db9c26dc"
Jul 28 17:44:44.862038 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.861975    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ca0c83f4dc9d69a369e8ef90399b39c9b63fa5774e9480432d27839db9c26dc"} err="failed to get container status \"4ca0c83f4dc9d69a369e8ef90399b39c9b63fa5774e9480432d27839db9c26dc\": rpc error: code = NotFound desc = could not find container \"4ca0c83f4dc9d69a369e8ef90399b39c9b63fa5774e9480432d27839db9c26dc\": container with ID starting with 4ca0c83f4dc9d69a369e8ef90399b39c9b63fa5774e9480432d27839db9c26dc not found: ID does not exist"
Jul 28 17:44:44.862038 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.861989    2563 scope.go:117] "RemoveContainer" containerID="7fc053298221ff87d47f4af608230247b9fb0d6d940b8ceb90090d65cbf63bb8"
Jul 28 17:44:44.862234 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:44:44.862212    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fc053298221ff87d47f4af608230247b9fb0d6d940b8ceb90090d65cbf63bb8\": container with ID starting with 7fc053298221ff87d47f4af608230247b9fb0d6d940b8ceb90090d65cbf63bb8 not found: ID does not exist" containerID="7fc053298221ff87d47f4af608230247b9fb0d6d940b8ceb90090d65cbf63bb8"
Jul 28 17:44:44.862291 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:44.862236    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fc053298221ff87d47f4af608230247b9fb0d6d940b8ceb90090d65cbf63bb8"} err="failed to get container status \"7fc053298221ff87d47f4af608230247b9fb0d6d940b8ceb90090d65cbf63bb8\": rpc error: code = NotFound desc = could not find container \"7fc053298221ff87d47f4af608230247b9fb0d6d940b8ceb90090d65cbf63bb8\": container with ID starting with 7fc053298221ff87d47f4af608230247b9fb0d6d940b8ceb90090d65cbf63bb8 not found: ID does not exist"
Jul 28 17:44:45.147197 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.147156    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:45.211966 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.211930    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"]
Jul 28 17:44:45.212322 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.212310    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="storage-initializer"
Jul 28 17:44:45.212365 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.212324    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="storage-initializer"
Jul 28 17:44:45.212365 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.212331    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kserve-container"
Jul 28 17:44:45.212365 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.212337    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kserve-container"
Jul 28 17:44:45.212365 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.212356    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kube-rbac-proxy"
Jul 28 17:44:45.212365 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.212361    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kube-rbac-proxy"
Jul 28 17:44:45.212511 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.212411    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kube-rbac-proxy"
Jul 28 17:44:45.212511 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.212423    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="703b2083-5569-4c66-80ff-db3e01de8193" containerName="kserve-container"
Jul 28 17:44:45.215302 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.215286    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.217488 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.217469    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-stop-v2-predictor-serving-cert\""
Jul 28 17:44:45.218010 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.217991    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-stop-kube-rbac-proxy-sar-config\""
Jul 28 17:44:45.218121 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.218018    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 28 17:44:45.218121 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.218055    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 17:44:45.218234 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.218150    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-jwrfk\""
Jul 28 17:44:45.218234 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.218201    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 28 17:44:45.218337 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.218263    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 28 17:44:45.225127 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.225092    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"]
Jul 28 17:44:45.232292 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.232253    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:45.354091 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.354054    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-v2-predictor-77f778d864-rctkr\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.354252 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.354122    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kserve-provision-location\") pod \"isvc-canary-stop-v2-predictor-77f778d864-rctkr\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.354252 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.354200    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fbwj\" (UniqueName: \"kubernetes.io/projected/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kube-api-access-4fbwj\") pod \"isvc-canary-stop-v2-predictor-77f778d864-rctkr\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.354252 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.354239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-77f778d864-rctkr\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.354355 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.354310    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-cabundle-cert\") pod \"isvc-canary-stop-v2-predictor-77f778d864-rctkr\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.455292 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.455207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-v2-predictor-77f778d864-rctkr\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.455448 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.455359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kserve-provision-location\") pod \"isvc-canary-stop-v2-predictor-77f778d864-rctkr\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.455448 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.455391    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fbwj\" (UniqueName: \"kubernetes.io/projected/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kube-api-access-4fbwj\") pod \"isvc-canary-stop-v2-predictor-77f778d864-rctkr\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.455448 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.455416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-77f778d864-rctkr\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.455646 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.455463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-cabundle-cert\") pod \"isvc-canary-stop-v2-predictor-77f778d864-rctkr\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.455713 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:44:45.455657    2563 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-serving-cert: secret "isvc-canary-stop-v2-predictor-serving-cert" not found
Jul 28 17:44:45.455713 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:44:45.455713    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-proxy-tls podName:b69800cd-c226-4ccc-8d2f-c4d17b4c0557 nodeName:}" failed. No retries permitted until 2026-07-28 17:44:45.955697962 +0000 UTC m=+1662.787929188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-proxy-tls") pod "isvc-canary-stop-v2-predictor-77f778d864-rctkr" (UID: "b69800cd-c226-4ccc-8d2f-c4d17b4c0557") : secret "isvc-canary-stop-v2-predictor-serving-cert" not found
Jul 28 17:44:45.455844 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.455727    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kserve-provision-location\") pod \"isvc-canary-stop-v2-predictor-77f778d864-rctkr\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.456032 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.456012    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-v2-predictor-77f778d864-rctkr\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.456148 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.456129    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-cabundle-cert\") pod \"isvc-canary-stop-v2-predictor-77f778d864-rctkr\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.465971 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.465948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fbwj\" (UniqueName: \"kubernetes.io/projected/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kube-api-access-4fbwj\") pod \"isvc-canary-stop-v2-predictor-77f778d864-rctkr\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.616176 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.616136    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:45.691212 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.691182    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="703b2083-5569-4c66-80ff-db3e01de8193" path="/var/lib/kubelet/pods/703b2083-5569-4c66-80ff-db3e01de8193/volumes"
Jul 28 17:44:45.960532 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.960497    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-77f778d864-rctkr\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.963166 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.963143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-proxy-tls\") pod \"isvc-canary-stop-v2-predictor-77f778d864-rctkr\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") " pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:45.993921 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:45.993884    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:46.128100 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:46.128075    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:46.259536 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:46.259510    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"]
Jul 28 17:44:46.261644 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:44:46.261619    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb69800cd_c226_4ccc_8d2f_c4d17b4c0557.slice/crio-3140ddb448921c8198fde458012ae93ac0907f45251a70dcabbed1889bb8ad38 WatchSource:0}: Error finding container 3140ddb448921c8198fde458012ae93ac0907f45251a70dcabbed1889bb8ad38: Status 404 returned error can't find the container with id 3140ddb448921c8198fde458012ae93ac0907f45251a70dcabbed1889bb8ad38
Jul 28 17:44:46.840548 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:46.840507    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" event={"ID":"b69800cd-c226-4ccc-8d2f-c4d17b4c0557","Type":"ContainerStarted","Data":"51174514180ffccc1b408d1300d807398b5493a2f1674eee03fa2006e9c77b47"}
Jul 28 17:44:46.841026 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:46.840569    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" event={"ID":"b69800cd-c226-4ccc-8d2f-c4d17b4c0557","Type":"ContainerStarted","Data":"3140ddb448921c8198fde458012ae93ac0907f45251a70dcabbed1889bb8ad38"}
Jul 28 17:44:50.858331 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:50.858290    2563 generic.go:356] "Generic (PLEG): container finished" podID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerID="51174514180ffccc1b408d1300d807398b5493a2f1674eee03fa2006e9c77b47" exitCode=0
Jul 28 17:44:50.858733 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:50.858344    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" event={"ID":"b69800cd-c226-4ccc-8d2f-c4d17b4c0557","Type":"ContainerDied","Data":"51174514180ffccc1b408d1300d807398b5493a2f1674eee03fa2006e9c77b47"}
Jul 28 17:44:51.864039 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:51.864008    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" event={"ID":"b69800cd-c226-4ccc-8d2f-c4d17b4c0557","Type":"ContainerStarted","Data":"cfecd776e9344d2385af0a874ffbbe410ee412c84359b9d9b107c79f43c7db13"}
Jul 28 17:44:51.864403 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:51.864067    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" event={"ID":"b69800cd-c226-4ccc-8d2f-c4d17b4c0557","Type":"ContainerStarted","Data":"f306f20bb68b27c4b85955409c6d749ca2878261f092984403095205f7773601"}
Jul 28 17:44:51.864403 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:51.864290    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:51.883565 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:51.883515    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" podStartSLOduration=3.309108743 podStartE2EDuration="6.883498568s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.574389825s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:44:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:44:51.883197178 +0000 UTC m=+1668.715428437" watchObservedRunningTime="2026-07-28 17:44:51.883498568 +0000 UTC m=+1668.715729829"
Jul 28 17:44:52.868740 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:52.868709    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:52.870116 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:52.870089    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 28 17:44:53.873624 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:53.873583    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 28 17:44:58.878513 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:58.878484    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:44:58.879025 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:44:58.878998    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 28 17:45:08.879435 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:45:08.879384    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 28 17:45:18.879646 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:45:18.879609    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 28 17:45:28.879412 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:45:28.879369    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 28 17:45:38.879907 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:45:38.879872    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 28 17:45:48.879360 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:45:48.879325    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 28 17:45:58.878942 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:45:58.878903    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 28 17:46:08.880776 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:08.880746    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:46:15.236273 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:15.236209    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"]
Jul 28 17:46:15.236834 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:15.236456    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kserve-container" containerID="cri-o://f306f20bb68b27c4b85955409c6d749ca2878261f092984403095205f7773601" gracePeriod=30
Jul 28 17:46:15.236834 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:15.236513    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kube-rbac-proxy" containerID="cri-o://cfecd776e9344d2385af0a874ffbbe410ee412c84359b9d9b107c79f43c7db13" gracePeriod=30
Jul 28 17:46:15.439890 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:15.439847    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:46:15.539209 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:15.539177    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:46:16.239911 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:16.239882    2563 generic.go:356] "Generic (PLEG): container finished" podID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerID="cfecd776e9344d2385af0a874ffbbe410ee412c84359b9d9b107c79f43c7db13" exitCode=2
Jul 28 17:46:16.240300 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:16.239965    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" event={"ID":"b69800cd-c226-4ccc-8d2f-c4d17b4c0557","Type":"ContainerDied","Data":"cfecd776e9344d2385af0a874ffbbe410ee412c84359b9d9b107c79f43c7db13"}
Jul 28 17:46:18.874924 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:18.874873    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.35:8643/healthz\": dial tcp 10.134.0.35:8643: connect: connection refused"
Jul 28 17:46:18.879237 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:18.879207    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 28 17:46:19.982915 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:19.982892    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:46:20.056597 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.056508    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kserve-provision-location\") pod \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") "
Jul 28 17:46:20.056597 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.056555    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kube-rbac-proxy-sar-config\") pod \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") "
Jul 28 17:46:20.056911 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.056632    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fbwj\" (UniqueName: \"kubernetes.io/projected/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kube-api-access-4fbwj\") pod \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") "
Jul 28 17:46:20.056911 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.056676    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-proxy-tls\") pod \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") "
Jul 28 17:46:20.056911 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.056713    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-cabundle-cert\") pod \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\" (UID: \"b69800cd-c226-4ccc-8d2f-c4d17b4c0557\") "
Jul 28 17:46:20.056911 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.056881    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "b69800cd-c226-4ccc-8d2f-c4d17b4c0557" (UID: "b69800cd-c226-4ccc-8d2f-c4d17b4c0557"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:46:20.057110 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.057007    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b69800cd-c226-4ccc-8d2f-c4d17b4c0557" (UID: "b69800cd-c226-4ccc-8d2f-c4d17b4c0557"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:46:20.057110 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.057021    2563 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kserve-provision-location\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:46:20.057252 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.057213    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "b69800cd-c226-4ccc-8d2f-c4d17b4c0557" (UID: "b69800cd-c226-4ccc-8d2f-c4d17b4c0557"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:46:20.058952 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.058928    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kube-api-access-4fbwj" (OuterVolumeSpecName: "kube-api-access-4fbwj") pod "b69800cd-c226-4ccc-8d2f-c4d17b4c0557" (UID: "b69800cd-c226-4ccc-8d2f-c4d17b4c0557"). InnerVolumeSpecName "kube-api-access-4fbwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:46:20.059038 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.059002    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b69800cd-c226-4ccc-8d2f-c4d17b4c0557" (UID: "b69800cd-c226-4ccc-8d2f-c4d17b4c0557"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:46:20.158323 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.158282    2563 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:46:20.158323 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.158319    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fbwj\" (UniqueName: \"kubernetes.io/projected/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-kube-api-access-4fbwj\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:46:20.158323 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.158330    2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-proxy-tls\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:46:20.158323 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.158338    2563 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b69800cd-c226-4ccc-8d2f-c4d17b4c0557-cabundle-cert\") on node \"ip-10-0-136-239.ec2.internal\" DevicePath \"\""
Jul 28 17:46:20.259868 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.259834    2563 generic.go:356] "Generic (PLEG): container finished" podID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerID="f306f20bb68b27c4b85955409c6d749ca2878261f092984403095205f7773601" exitCode=0
Jul 28 17:46:20.259868 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.259870    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" event={"ID":"b69800cd-c226-4ccc-8d2f-c4d17b4c0557","Type":"ContainerDied","Data":"f306f20bb68b27c4b85955409c6d749ca2878261f092984403095205f7773601"}
Jul 28 17:46:20.260084 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.259894    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"
Jul 28 17:46:20.260084 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.259917    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr" event={"ID":"b69800cd-c226-4ccc-8d2f-c4d17b4c0557","Type":"ContainerDied","Data":"3140ddb448921c8198fde458012ae93ac0907f45251a70dcabbed1889bb8ad38"}
Jul 28 17:46:20.260084 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.259943    2563 scope.go:117] "RemoveContainer" containerID="cfecd776e9344d2385af0a874ffbbe410ee412c84359b9d9b107c79f43c7db13"
Jul 28 17:46:20.271413 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.271320    2563 scope.go:117] "RemoveContainer" containerID="f306f20bb68b27c4b85955409c6d749ca2878261f092984403095205f7773601"
Jul 28 17:46:20.279459 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.279437    2563 scope.go:117] "RemoveContainer" containerID="51174514180ffccc1b408d1300d807398b5493a2f1674eee03fa2006e9c77b47"
Jul 28 17:46:20.284867 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.284844    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"]
Jul 28 17:46:20.287824 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.287785    2563 scope.go:117] "RemoveContainer" containerID="cfecd776e9344d2385af0a874ffbbe410ee412c84359b9d9b107c79f43c7db13"
Jul 28 17:46:20.288104 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:46:20.288084    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfecd776e9344d2385af0a874ffbbe410ee412c84359b9d9b107c79f43c7db13\": container with ID starting with cfecd776e9344d2385af0a874ffbbe410ee412c84359b9d9b107c79f43c7db13 not found: ID does not exist" containerID="cfecd776e9344d2385af0a874ffbbe410ee412c84359b9d9b107c79f43c7db13"
Jul 28 17:46:20.288163 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.288113    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfecd776e9344d2385af0a874ffbbe410ee412c84359b9d9b107c79f43c7db13"} err="failed to get container status \"cfecd776e9344d2385af0a874ffbbe410ee412c84359b9d9b107c79f43c7db13\": rpc error: code = NotFound desc = could not find container \"cfecd776e9344d2385af0a874ffbbe410ee412c84359b9d9b107c79f43c7db13\": container with ID starting with cfecd776e9344d2385af0a874ffbbe410ee412c84359b9d9b107c79f43c7db13 not found: ID does not exist"
Jul 28 17:46:20.288163 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.288133    2563 scope.go:117] "RemoveContainer" containerID="f306f20bb68b27c4b85955409c6d749ca2878261f092984403095205f7773601"
Jul 28 17:46:20.288237 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.288158    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-v2-predictor-77f778d864-rctkr"]
Jul 28 17:46:20.288391 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:46:20.288371    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f306f20bb68b27c4b85955409c6d749ca2878261f092984403095205f7773601\": container with ID starting with f306f20bb68b27c4b85955409c6d749ca2878261f092984403095205f7773601 not found: ID does not exist" containerID="f306f20bb68b27c4b85955409c6d749ca2878261f092984403095205f7773601"
Jul 28 17:46:20.288437 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.288397    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f306f20bb68b27c4b85955409c6d749ca2878261f092984403095205f7773601"} err="failed to get container status \"f306f20bb68b27c4b85955409c6d749ca2878261f092984403095205f7773601\": rpc error: code = NotFound desc = could not find container \"f306f20bb68b27c4b85955409c6d749ca2878261f092984403095205f7773601\": container with ID starting with f306f20bb68b27c4b85955409c6d749ca2878261f092984403095205f7773601 not found: ID does not exist"
Jul 28 17:46:20.288437 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.288413    2563 scope.go:117] "RemoveContainer" containerID="51174514180ffccc1b408d1300d807398b5493a2f1674eee03fa2006e9c77b47"
Jul 28 17:46:20.288664 ip-10-0-136-239 kubenswrapper[2563]: E0728 17:46:20.288648    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51174514180ffccc1b408d1300d807398b5493a2f1674eee03fa2006e9c77b47\": container with ID starting with 51174514180ffccc1b408d1300d807398b5493a2f1674eee03fa2006e9c77b47 not found: ID does not exist" containerID="51174514180ffccc1b408d1300d807398b5493a2f1674eee03fa2006e9c77b47"
Jul 28 17:46:20.288710 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:20.288671    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51174514180ffccc1b408d1300d807398b5493a2f1674eee03fa2006e9c77b47"} err="failed to get container status \"51174514180ffccc1b408d1300d807398b5493a2f1674eee03fa2006e9c77b47\": rpc error: code = NotFound desc = could not find container \"51174514180ffccc1b408d1300d807398b5493a2f1674eee03fa2006e9c77b47\": container with ID starting with 51174514180ffccc1b408d1300d807398b5493a2f1674eee03fa2006e9c77b47 not found: ID does not exist"
Jul 28 17:46:21.690696 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:21.690664    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" path="/var/lib/kubelet/pods/b69800cd-c226-4ccc-8d2f-c4d17b4c0557/volumes"
Jul 28 17:46:25.454531 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:25.454494    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:46:25.714541 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:46:25.714454    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:10.837378 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:48:10.837342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:10.929032 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:48:10.928999    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:26.722705 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:48:26.722671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:26.782012 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:48:26.781976    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:31.897172 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:48:31.897136    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:32.243360 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:48:32.243262    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:41.980092 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:48:41.980059    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:47.151107 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:48:47.151069    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:47.375153 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:48:47.375116    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:50:17.331426 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:50:17.331388    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:50:22.415455 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:50:22.415422    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:50:22.517526 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:50:22.517488    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:50:43.763504 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:50:43.763470    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:51:52.584965 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:51:52.584931    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:51:59.102212 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:51:59.102176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:51:59.204253 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:51:59.204199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:18.499389 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:18.499355    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:18.568990 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:18.568954    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:28.811828 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:28.811773    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:28.925084 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:28.925030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:29.016841 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:29.016805    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:31.515004 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:31.514967    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tdwcc_09a1f566-ddd6-4867-be93-31d4d4b9f98f/global-pull-secret-syncer/0.log"
Jul 28 17:52:31.565996 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:31.565971    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log"
Jul 28 17:52:31.648844 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:31.648776    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-239.ec2.internal_f5a2e8ae67128845bf7e17c11605aa90/haproxy/0.log"
Jul 28 17:52:34.742754 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:34.742714    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:34.883662 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:34.883632    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75wzw_79c76dc5-da15-4018-af28-c2e1694def83/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:35.625329 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:35.625291    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-crv2w_9469e45c-b060-49d7-84c3-4145dd93f053/kube-state-metrics/0.log"
Jul 28 17:52:35.654843 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:35.654812    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-crv2w_9469e45c-b060-49d7-84c3-4145dd93f053/kube-rbac-proxy-main/0.log"
Jul 28 17:52:35.714409 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:35.714380    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-crv2w_9469e45c-b060-49d7-84c3-4145dd93f053/kube-rbac-proxy-self/0.log"
Jul 28 17:52:35.821444 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:35.821416    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-87hcl_caa58b29-4b1a-4c1f-b3e2-63d5eba8e5db/monitoring-plugin/0.log"
Jul 28 17:52:35.960660 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:35.960554    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mbb6v_41ef7f50-2193-4a50-87ac-67156b096874/node-exporter/0.log"
Jul 28 17:52:36.000967 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:36.000937    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mbb6v_41ef7f50-2193-4a50-87ac-67156b096874/kube-rbac-proxy/0.log"
Jul 28 17:52:36.038133 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:36.038108    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mbb6v_41ef7f50-2193-4a50-87ac-67156b096874/init-textfile/0.log"
Jul 28 17:52:36.176257 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:36.176232    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-tjbs9_44382ef3-6f81-4975-bf37-de90506f9469/kube-rbac-proxy-main/0.log"
Jul 28 17:52:36.201216 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:36.201184    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-tjbs9_44382ef3-6f81-4975-bf37-de90506f9469/kube-rbac-proxy-self/0.log"
Jul 28 17:52:36.227516 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:36.227452    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-tjbs9_44382ef3-6f81-4975-bf37-de90506f9469/openshift-state-metrics/0.log"
Jul 28 17:52:36.510626 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:36.510596    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-l8dbb_3b0db1a4-8933-4cd8-9d4e-3532fd47396b/prometheus-operator-admission-webhook/0.log"
Jul 28 17:52:36.644305 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:36.644272    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc7467688-kwc9l_8c00fe89-f91e-413b-a8c6-e4e1895260b9/thanos-query/0.log"
Jul 28 17:52:36.676131 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:36.676109    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc7467688-kwc9l_8c00fe89-f91e-413b-a8c6-e4e1895260b9/kube-rbac-proxy-web/0.log"
Jul 28 17:52:36.700820 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:36.700776    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc7467688-kwc9l_8c00fe89-f91e-413b-a8c6-e4e1895260b9/kube-rbac-proxy/0.log"
Jul 28 17:52:36.727529 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:36.727508    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc7467688-kwc9l_8c00fe89-f91e-413b-a8c6-e4e1895260b9/prom-label-proxy/0.log"
Jul 28 17:52:36.757000 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:36.756978    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc7467688-kwc9l_8c00fe89-f91e-413b-a8c6-e4e1895260b9/kube-rbac-proxy-rules/0.log"
Jul 28 17:52:36.782416 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:36.782356    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dc7467688-kwc9l_8c00fe89-f91e-413b-a8c6-e4e1895260b9/kube-rbac-proxy-metrics/0.log"
Jul 28 17:52:38.119001 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:38.118944    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-7xgtq_11b040c7-84fb-47ec-b6b0-9ee6d7ff5aa4/networking-console-plugin/0.log"
Jul 28 17:52:39.090582 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.090551    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c654d48b5-h7w87_3b0c7ec6-7000-4ffa-9090-e22982e80cbb/console/0.log"
Jul 28 17:52:39.728618 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.728584    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"]
Jul 28 17:52:39.729030 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.728923    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kube-rbac-proxy"
Jul 28 17:52:39.729030 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.728935    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kube-rbac-proxy"
Jul 28 17:52:39.729030 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.728946    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="storage-initializer"
Jul 28 17:52:39.729030 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.728952    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="storage-initializer"
Jul 28 17:52:39.729030 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.728969    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kserve-container"
Jul 28 17:52:39.729030 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.728974    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kserve-container"
Jul 28 17:52:39.729030 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.729030    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kserve-container"
Jul 28 17:52:39.729248 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.729042    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b69800cd-c226-4ccc-8d2f-c4d17b4c0557" containerName="kube-rbac-proxy"
Jul 28 17:52:39.732050 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.732031    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:39.734433 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.734410    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cjjwk\"/\"openshift-service-ca.crt\""
Jul 28 17:52:39.735173 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.735159    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cjjwk\"/\"default-dockercfg-dvp87\""
Jul 28 17:52:39.735173 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.735169    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cjjwk\"/\"kube-root-ca.crt\""
Jul 28 17:52:39.745430 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.745408    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"]
Jul 28 17:52:39.817577 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.817535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djndk\" (UniqueName: \"kubernetes.io/projected/39860a93-6fee-4e2a-94c0-4ca972a5e487-kube-api-access-djndk\") pod \"perf-node-gather-daemonset-wgcpl\" (UID: \"39860a93-6fee-4e2a-94c0-4ca972a5e487\") " pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:39.817762 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.817593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39860a93-6fee-4e2a-94c0-4ca972a5e487-sys\") pod \"perf-node-gather-daemonset-wgcpl\" (UID: \"39860a93-6fee-4e2a-94c0-4ca972a5e487\") " pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:39.817762 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.817610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39860a93-6fee-4e2a-94c0-4ca972a5e487-proc\") pod \"perf-node-gather-daemonset-wgcpl\" (UID: \"39860a93-6fee-4e2a-94c0-4ca972a5e487\") " pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:39.817762 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.817668    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39860a93-6fee-4e2a-94c0-4ca972a5e487-podres\") pod \"perf-node-gather-daemonset-wgcpl\" (UID: \"39860a93-6fee-4e2a-94c0-4ca972a5e487\") " pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:39.817762 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.817713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39860a93-6fee-4e2a-94c0-4ca972a5e487-lib-modules\") pod \"perf-node-gather-daemonset-wgcpl\" (UID: \"39860a93-6fee-4e2a-94c0-4ca972a5e487\") " pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:39.918732 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.918701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39860a93-6fee-4e2a-94c0-4ca972a5e487-lib-modules\") pod \"perf-node-gather-daemonset-wgcpl\" (UID: \"39860a93-6fee-4e2a-94c0-4ca972a5e487\") " pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:39.918972 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.918782    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djndk\" (UniqueName: \"kubernetes.io/projected/39860a93-6fee-4e2a-94c0-4ca972a5e487-kube-api-access-djndk\") pod \"perf-node-gather-daemonset-wgcpl\" (UID: \"39860a93-6fee-4e2a-94c0-4ca972a5e487\") " pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:39.918972 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.918865    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39860a93-6fee-4e2a-94c0-4ca972a5e487-sys\") pod \"perf-node-gather-daemonset-wgcpl\" (UID: \"39860a93-6fee-4e2a-94c0-4ca972a5e487\") " pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:39.918972 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.918887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39860a93-6fee-4e2a-94c0-4ca972a5e487-proc\") pod \"perf-node-gather-daemonset-wgcpl\" (UID: \"39860a93-6fee-4e2a-94c0-4ca972a5e487\") " pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:39.918972 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.918924    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39860a93-6fee-4e2a-94c0-4ca972a5e487-podres\") pod \"perf-node-gather-daemonset-wgcpl\" (UID: \"39860a93-6fee-4e2a-94c0-4ca972a5e487\") " pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:39.918972 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.918930    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39860a93-6fee-4e2a-94c0-4ca972a5e487-lib-modules\") pod \"perf-node-gather-daemonset-wgcpl\" (UID: \"39860a93-6fee-4e2a-94c0-4ca972a5e487\") " pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:39.919196 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.918982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39860a93-6fee-4e2a-94c0-4ca972a5e487-sys\") pod \"perf-node-gather-daemonset-wgcpl\" (UID: \"39860a93-6fee-4e2a-94c0-4ca972a5e487\") " pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:39.919196 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.919034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39860a93-6fee-4e2a-94c0-4ca972a5e487-proc\") pod \"perf-node-gather-daemonset-wgcpl\" (UID: \"39860a93-6fee-4e2a-94c0-4ca972a5e487\") " pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:39.919196 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.919061    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39860a93-6fee-4e2a-94c0-4ca972a5e487-podres\") pod \"perf-node-gather-daemonset-wgcpl\" (UID: \"39860a93-6fee-4e2a-94c0-4ca972a5e487\") " pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:39.927651 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:39.927623    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djndk\" (UniqueName: \"kubernetes.io/projected/39860a93-6fee-4e2a-94c0-4ca972a5e487-kube-api-access-djndk\") pod \"perf-node-gather-daemonset-wgcpl\" (UID: \"39860a93-6fee-4e2a-94c0-4ca972a5e487\") " pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:40.042080 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:40.042057    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:40.178035 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:40.178010    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"]
Jul 28 17:52:40.180707 ip-10-0-136-239 kubenswrapper[2563]: W0728 17:52:40.180681    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod39860a93_6fee_4e2a_94c0_4ca972a5e487.slice/crio-83f2e9137cddfdd24bd7ec98814e35039da674136d4c4618d0183cf50bdc48e5 WatchSource:0}: Error finding container 83f2e9137cddfdd24bd7ec98814e35039da674136d4c4618d0183cf50bdc48e5: Status 404 returned error can't find the container with id 83f2e9137cddfdd24bd7ec98814e35039da674136d4c4618d0183cf50bdc48e5
Jul 28 17:52:40.756519 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:40.756495    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zbcdc_5752d920-0452-446a-b3ee-9c76b72ceda0/dns/0.log"
Jul 28 17:52:40.778448 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:40.778425    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zbcdc_5752d920-0452-446a-b3ee-9c76b72ceda0/kube-rbac-proxy/0.log"
Jul 28 17:52:40.801620 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:40.801591    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nc97c_7911e02d-0046-4260-8006-0c44bd288d44/dns-node-resolver/0.log"
Jul 28 17:52:40.916314 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:40.916283    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl" event={"ID":"39860a93-6fee-4e2a-94c0-4ca972a5e487","Type":"ContainerStarted","Data":"87defc5c2f483de58ffde8ffbe7e7759076e99e8bd8048a3a4dfc16dda044337"}
Jul 28 17:52:40.916482 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:40.916331    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl" event={"ID":"39860a93-6fee-4e2a-94c0-4ca972a5e487","Type":"ContainerStarted","Data":"83f2e9137cddfdd24bd7ec98814e35039da674136d4c4618d0183cf50bdc48e5"}
Jul 28 17:52:40.916482 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:40.916424    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:40.935564 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:40.935518    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl" podStartSLOduration=1.935503663 podStartE2EDuration="1.935503663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:52:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:52:40.933838527 +0000 UTC m=+2137.766069776" watchObservedRunningTime="2026-07-28 17:52:40.935503663 +0000 UTC m=+2137.767734943"
Jul 28 17:52:41.303347 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:41.303317    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5497fb74fb-qg822_80b23439-c00f-4371-83bb-f310d313b706/registry/0.log"
Jul 28 17:52:41.370436 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:41.370399    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n4p4l_c72a9af3-651a-493b-b70f-5f70b05ebdf5/node-ca/0.log"
Jul 28 17:52:42.445908 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:42.445877    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mxg6l_8537c98d-4f50-4d39-b36e-598c5b23bce9/serve-healthcheck-canary/0.log"
Jul 28 17:52:42.897375 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:42.897347    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hjqct_654aefc2-49e8-4014-85bf-c9ab3f564acb/kube-rbac-proxy/0.log"
Jul 28 17:52:42.921176 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:42.921136    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hjqct_654aefc2-49e8-4014-85bf-c9ab3f564acb/exporter/0.log"
Jul 28 17:52:42.941333 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:42.941302    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hjqct_654aefc2-49e8-4014-85bf-c9ab3f564acb/extractor/0.log"
Jul 28 17:52:45.212352 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:45.212322    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-85d8b8ddfc-pt46g_0f6fd9fa-24d2-45bf-92a8-af7e334af205/manager/0.log"
Jul 28 17:52:45.237462 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:45.237438    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-84fc959947-9289r_83adef5b-3b04-4b8a-87ca-f964b7cf0af9/manager/0.log"
Jul 28 17:52:45.360456 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:45.360431    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-75d9cdbddf-lk9sx_4ea431ab-b7ad-4382-b910-1b7d43223c6a/manager/0.log"
Jul 28 17:52:46.931135 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:46.931106    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cjjwk/perf-node-gather-daemonset-wgcpl"
Jul 28 17:52:51.165138 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:51.165060    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn9rg_551eb815-630c-41f7-888d-39ef9ed0681b/kube-multus-additional-cni-plugins/0.log"
Jul 28 17:52:51.188663 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:51.188638    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn9rg_551eb815-630c-41f7-888d-39ef9ed0681b/egress-router-binary-copy/0.log"
Jul 28 17:52:51.210580 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:51.210551    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn9rg_551eb815-630c-41f7-888d-39ef9ed0681b/cni-plugins/0.log"
Jul 28 17:52:51.231193 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:51.231171    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn9rg_551eb815-630c-41f7-888d-39ef9ed0681b/bond-cni-plugin/0.log"
Jul 28 17:52:51.251703 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:51.251684    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn9rg_551eb815-630c-41f7-888d-39ef9ed0681b/routeoverride-cni/0.log"
Jul 28 17:52:51.273563 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:51.273534    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn9rg_551eb815-630c-41f7-888d-39ef9ed0681b/whereabouts-cni-bincopy/0.log"
Jul 28 17:52:51.294701 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:51.294676    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kn9rg_551eb815-630c-41f7-888d-39ef9ed0681b/whereabouts-cni/0.log"
Jul 28 17:52:51.324539 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:51.324514    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n8656_184d85bc-8ddc-40a9-bbfc-65dd6679d5a8/kube-multus/0.log"
Jul 28 17:52:51.459102 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:51.459024    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gzx6v_cd4c39fa-bc1a-43d4-bd68-a32079e1b915/network-metrics-daemon/0.log"
Jul 28 17:52:51.509464 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:51.509440    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gzx6v_cd4c39fa-bc1a-43d4-bd68-a32079e1b915/kube-rbac-proxy/0.log"
Jul 28 17:52:52.810947 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:52.810908    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc2qj_030e36e0-4ec2-43b9-a317-e4e58138cc29/ovn-controller/0.log"
Jul 28 17:52:52.827527 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:52.827502    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc2qj_030e36e0-4ec2-43b9-a317-e4e58138cc29/ovn-acl-logging/0.log"
Jul 28 17:52:52.851553 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:52.851532    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc2qj_030e36e0-4ec2-43b9-a317-e4e58138cc29/kube-rbac-proxy-node/0.log"
Jul 28 17:52:52.876367 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:52.876306    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc2qj_030e36e0-4ec2-43b9-a317-e4e58138cc29/kube-rbac-proxy-ovn-metrics/0.log"
Jul 28 17:52:52.896043 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:52.896021    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc2qj_030e36e0-4ec2-43b9-a317-e4e58138cc29/northd/0.log"
Jul 28 17:52:52.921003 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:52.920981    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc2qj_030e36e0-4ec2-43b9-a317-e4e58138cc29/nbdb/0.log"
Jul 28 17:52:52.943460 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:52.943439    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc2qj_030e36e0-4ec2-43b9-a317-e4e58138cc29/sbdb/0.log"
Jul 28 17:52:52.989480 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:52.989455    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc2qj_030e36e0-4ec2-43b9-a317-e4e58138cc29/ovnkube-controller/0.log"
Jul 28 17:52:53.995033 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:53.994944    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-64z5r_0352e080-a0e6-4977-9f2c-fef0f6488583/network-check-target-container/0.log"
Jul 28 17:52:54.896932 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:54.896901    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-wbrnt_98a2385b-450b-4192-bfd2-f6e192a0b1a1/iptables-alerter/0.log"
Jul 28 17:52:55.622542 ip-10-0-136-239 kubenswrapper[2563]: I0728 17:52:55.622501    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-8shmh_ddc85677-135d-4969-8239-538f62db9d7f/tuned/0.log"